tokens_restore

Compounds segments of tokens marked by special markers. The beginning and
the end of the segments should be marked by U+E001 and U+E002 respectively.

internal

tokens

A fast, flexible, and comprehensive framework for
quantitative text analysis in R.  Provides functionality for corpus management,
creating and manipulating tokens and n-grams, exploring keywords in context,
forming and manipulating sparse matrices
of documents by features and feature co-occurrences, analyzing keywords, computing feature similarities and
distances, applying content dictionaries, applying supervised and unsupervised machine learning,
visually representing text and text analyses, and more.

Kenneth Benoit

quanteda

Quantitative Analysis of Textual Data

Kohei Watanabe

Haiyan Wang

Paul Nulty

Adam Obeng

Stefan Müller

Akitaka Matsuo

William Lowe

Christian Müller

Olivier Delmarcelle

European Research Council 

tokens_restore function

<dl><dt>x</dt>
<dd>tokens object</dd></dl>

Arguments

Restore special tokens — tokens_restore

<dl>

<dt>x</dt>
<dd>tokens object</dd>

</dl>

Restore special tokens

tokens_restore: Restore special tokens

Description

Usage

Value

Arguments