tokens_serialize: Function to serialized list-of-character tokens
Description
Creates a serialized object of tokens, called by tokens
.
Usage
tokens_serialize(x, types_reserved = NULL, ...)
Arguments
x
a list of character vectors
types_reserved
optional pre-existing types for mapping of tokens
Value
a list the serialized tokens found in each text