vocabulary_size

A two-element vector holding the defaults for the smallest and
largest possible values, respectively.

range

A <code>trans</code> object from the <code>scales</code> package, such as
<code>scales::log10_trans()</code> or <code>scales::reciprocal_trans()</code>. If not provided,
the default is used which matches the units used in <code>range</code>. If no
transformation, <code>NULL</code>.

trans

Used in <code>textrecipes::step_tokenize_sentencepiece()</code> and
<code>textrecipes::step_tokenize_bpe()</code>.

Many models contain tuning parameters (i.e. parameters that
cannot be directly estimated from the data). These tools can be used
to define objects for creating, simulating, or validating values for
such parameters.

Hannah Frick

vocabulary_size: Number of tokens in vocabulary

Description

Usage

Arguments

Examples