tokens_serialize

optional pre-existing types for mapping of tokens

types_reserved

Creates a serialized object of tokens, called by <code><a rd-options="" href="/link/tokens?package=quanteda&version=1.1.1" data-mini-rdoc="quanteda::tokens">tokens</a></code>.

internal

tokens

A fast, flexible, and comprehensive framework for
quantitative text analysis in R.  Provides functionality for corpus management,
creating and manipulating tokens and ngrams, exploring keywords in context,
forming and manipulating sparse matrices
of documents by features and feature co-occurrences, analyzing keywords, computing feature similarities and
distances, applying content dictionaries, applying supervised and unsupervised machine learning,
visually representing text and text analyses, and more.

Kenneth Benoit

quanteda

Quantitative Analysis of Textual Data

Kohei Watanabe

Paul Nulty

Adam Obeng

Haiyan Wang

Stefan M<c3><bc>ller

Benjamin Lauderdale

Will Lowe

tokens_serialize function

Creates a serialized object of tokens, called by <code><a rd-options='' href='tokens'>tokens</a></code>.

Function to serialized list-of-character tokens — tokens_serialize

Function to serialized list-of-character tokens

tokens_serialize: Function to serialized list-of-character tokens

Description

Usage

Arguments

Value