Learn R Programming

quanteda (version 4.1.0)

serialize_tokens: Function to serialize list-of-character tokens

Description

Creates a serialized object of tokens, called by tokens().

Usage

serialize_tokens(x, types_reserved = NULL, ...)

Value

a list the serialized tokens found in each text

Arguments

x

a list of character vectors

types_reserved

optional pre-existing types for mapping of tokens

...

additional arguments