serialize_tokens

Creates a serialized object of tokens, called by <code>tokens()</code>.

internal

tokens

A fast, flexible, and comprehensive framework for
quantitative text analysis in R.  Provides functionality for corpus management,
creating and manipulating tokens and n-grams, exploring keywords in context,
forming and manipulating sparse matrices
of documents by features and feature co-occurrences, analyzing keywords, computing feature similarities and
distances, applying content dictionaries, applying supervised and unsupervised machine learning,
visually representing text and text analyses, and more.

Kenneth Benoit

quanteda

Quantitative Analysis of Textual Data

Kohei Watanabe

Haiyan Wang

Paul Nulty

Adam Obeng

Stefan Müller

Akitaka Matsuo

William Lowe

Christian Müller

Olivier Delmarcelle

European Research Council 

serialize_tokens function

<dl><dt>x</dt>
<dd>a list of character vectors</dd>
<dt>types_reserved</dt>
<dd>optional pre-existing types for mapping of tokens</dd>
<dt>...</dt>
<dd>additional arguments</dd></dl>

Arguments

Function to serialize list-of-character tokens — serialize_tokens

<dl>

<dt>x</dt>
<dd>a list of character vectors</dd>


<dt>types_reserved</dt>
<dd>optional pre-existing types for mapping of tokens</dd>


<dt>...</dt>
<dd>additional arguments</dd>

</dl>

Function to serialize list-of-character tokens

serialize_tokens: Function to serialize list-of-character tokens

Description

Usage

Value

Arguments