quanteda (version 4.1.0)

tokens-class: Base method extensions for tokens objects

Description

Extensions of base R functions for tokens objects.

Usage

# S3 method for tokens
unlist(x, recursive = FALSE, use.names = TRUE)
# S3 method for tokens
[(x, i, drop_docid = TRUE)
# S3 method for tokens
+(t1, t2)
# S3 method for tokens_xptr
c(...)
# S3 method for tokens
c(...)

Value

unlist returns a simple vector of characters from a tokens object.

c(...) and + return a tokens object whose documents have been added as a single sequence of documents.

Arguments

x

a tokens object

recursive

a required argument for unlist but inapplicable to tokens objects.

i

document names or indices for documents to extract.

drop_docid

if TRUE, docid for documents are removed as the result of extraction.

t1

tokens one to be added

t2

tokens two to be added

Examples

toks <- tokens(c(d1 = "one two three", d2 = "four five six", d3 = "seven eight"))
str(toks)
toks[c(1,3)]
# combining tokens
toks1 <- tokens(c(doc1 = "a b c d e", doc2 = "f g h"))
toks2 <- tokens(c(doc3 = "1 2 3"))
toks1 + toks2
c(toks1, toks2)