Learn R Programming

quanteda (version 4.1.0)

tokens_restore: Restore special tokens

Description

Compounds a sequence of tokens marked by special markers. The beginning and the end of the sequence should be marked by U+E001 and U+E002 respectively.

Usage

tokens_restore(x)

Arguments

x

tokens object