Learn R Programming

quanteda (version 0.9.9-65)

as.tokens: coercion, checking, and combining functions for tokens objects

Description

Coercion functions to and from tokens objects, checks for whether an object is a tokens object, and functions to combine tokens objects.

Usage

as.tokens(x)

# S3 method for list as.tokens(x)

# S3 method for collocations as.tokens(x)

# S3 method for tokens as.list(x, ...)

# S3 method for tokens unlist(x, recursive = FALSE, use.names = TRUE)

# S3 method for tokens as.character(x, use.names = FALSE, ...)

is.tokens(x)

# S3 method for tokens +(t1, t2)

# S3 method for tokens c(...)

Arguments

x

object to be coerced or checked

...

for c.tokens only, tokens objects to be concatenated

recursive

a required argument for unlist but inapplicable to tokens objects

use.names

logical; preserve names if TRUE. For as.character and unlist only.

t1

tokens one to be added

t2

tokens two to be added

Value

as.tokens returns a quanteda tokens object

as.list returns a simple list of characters from a tokens object

unlist returns a simple vector of characters from a tokens object

as.character returns a character vector from a tokens object

is.tokens returns TRUE if the object is of class tokens, FALSE otherwise.

c(...) and + return a tokens object whose documents have been added as a single sequence of documents.

Examples

Run this code
# NOT RUN {
# combining tokens
toks1 <- tokens(c("a b c d e", "f g h"))
toks2 <- tokens(c("1 2 3"))
toks1 + toks2
c(toks1, toks2)

# }

Run the code above in your browser using DataLab