Learn R Programming

tm (version 0.7-12)

getTokenizers: Tokenizers

Description

Predefined tokenizers.

Usage

getTokenizers()

Arguments

Value

A character vector with tokenizers provided by package tm.

See Also

Boost_tokenizer, MC_tokenizer and scan_tokenizer.

Examples

Run this code
getTokenizers()

Run the code above in your browser using DataLab