Learn R Programming
tm (version 0.5-9.1)

getTokenizers: List Available Tokenizers

Description

List available tokenizers.

Usage

getTokenizers()

Arguments

Value

  • A character vector with available tokenizers.

See Also

MC_tokenizer and scan_tokenizer.

Examples

Run this code
getTokenizers()

Run the code above in your browser using DataLab