get_metrics.forecast_ordinal

For ordinal forecasts, the default scoring rules are:<ul>
<li>"log_score" = <code>logs_categorical()</code></li>
<li>"rps" = <code>rps_ordinal()</code></li>
</ul>

handle-metrics

Facilitate the evaluation of forecasts in a convenient
framework based on data.table. It allows user to to check their forecasts
and diagnose issues, to visualise forecasts and missing data, to transform
data before scoring, to handle missing forecasts, to aggregate scores, and
to visualise the results of the evaluation. The package mostly focuses on
the evaluation of probabilistic forecasts and allows evaluating several
different forecast types and input formats. Find more information about the
package in the Vignettes as well as in the accompanying paper,
<doi:10.48550/arXiv.2205.07090>.

Nikos Bosse

scoringutils

Utilities for Scoring and Assessing Predictions

Sam Abbott

Hugo Gruson

Johannes Bracher

Toshiaki Asakura 

James Mba Azam

Sebastian Funk

Michael Chirico

get_metrics.forecast_ordinal function

<dl><dt>x</dt>
<dd>A forecast object (a validated data.table with predicted and
observed values, see <code>as_forecast_binary()</code>).</dd>
<dt>select</dt>
<dd>A character vector of scoring rules to select from the list. If
<code>select</code> is <code>NULL</code> (the default), all possible scoring rules are returned.</dd>
<dt>exclude</dt>
<dd>A character vector of scoring rules to exclude from the list.
If <code>select</code> is not <code>NULL</code>, this argument is ignored.</dd>
<dt>...</dt>
<dd>unused</dd></dl>

Arguments

Get default metrics for nominal forecasts — get_metrics.forecast_ordinal

<dl>

<dt>x</dt>
<dd>A forecast object (a validated data.table with predicted and
observed values, see <code>as_forecast_binary()</code>).</dd>


<dt>select</dt>
<dd>A character vector of scoring rules to select from the list. If
<code>select</code> is <code>NULL</code> (the default), all possible scoring rules are returned.</dd>


<dt>exclude</dt>
<dd>A character vector of scoring rules to exclude from the list.
If <code>select</code> is not <code>NULL</code>, this argument is ignored.</dd>


<dt>...</dt>
<dd>unused</dd>

</dl>

Get default metrics for nominal forecasts

get_metrics.forecast_ordinal: Get default metrics for nominal forecasts

Description

Usage

Arguments

See Also

Examples