as_phrasemachine

Noun phrases are of common interest when doing natural language processing. Extracting noun phrases
from text can be done easily by defining a sequence of Parts of Speech tags. For example this sequence of POS tags
can be seen as a noun phrase: Adjective, Noun, Preposition, Noun. 
This function recodes Universal POS tags to one of the following 1-letter tags, in order to simplify writing regular expressions
to find Parts of Speech sequences:<ul>
<li>A: adjective</li>
<li>C: coordinating conjuction</li>
<li>D: determiner</li>
<li>M: modifier of verb</li>
<li>N: noun or proper noun</li>
<li>P: preposition</li>
<li>O: other elements</li>
</ul>After which identifying a simple noun phrase can be just expressed by using the following 
regular expression (A|N)*N(P+D*(A|N)*N)* which basically says
start with adjective or noun, another noun, a preposition, determiner adjective or noun and next a noun again.

This natural language processing toolkit provides language-agnostic
'tokenization', 'parts of speech tagging', 'lemmatization' and 'dependency
parsing' of raw text. Next to text parsing, the package also allows you to train
annotation models based on data of 'treebanks' in 'CoNLL-U' format as provided
at <https://universaldependencies.org/format.html>. The techniques are explained
in detail in the paper: 'Tokenizing, POS Tagging, Lemmatizing and Parsing UD 2.0
with UDPipe', available at <doi:10.18653/v1/K17-3009>.
The toolkit also contains functionalities for commonly used data manipulations on texts
which are enriched with the output of the parser. Namely functionalities and algorithms
for collocations, token co-occurrence, document term matrix handling,
term frequency inverse document frequency calculations,
information retrieval metrics (Okapi BM25), handling of multi-word expressions,
keyword detection (Rapid Automatic Keyword Extraction, noun phrase extraction, syntactical patterns)
sentiment scoring and semantic similarity analysis.

Jan Wijffels

udpipe

Tokenization, Parts of Speech Tagging, Lemmatization and
Dependency Parsing with the 'UDPipe' 'NLP' Toolkit

BNOSAC 

Institute of Formal and Applied Linguistics, Faculty of Mathematics and Physics, Charles University in Prague, Czech Republic 

Milan Straka 

Jana Straková 

as_phrasemachine function

<dl><dt>x</dt>
<dd>a character vector of POS tags for example by using <code>udpipe_annotate</code></dd>
<dt>type</dt>
<dd>either 'upos' or 'penn-treebank' indicating to recode Universal Parts of Speech tags to the counterparts
as described in the description, or to recode Parts of Speech tags as known in the Penn Treebank to the counterparts
as described in the description</dd></dl>

Arguments

Noun phrases are of common interest when doing natural language processing. Extracting noun phrases
from text can be done easily by defining a sequence of Parts of Speech tags. For example this sequence of POS tags
can be seen as a noun phrase: Adjective, Noun, Preposition, Noun. 
This function recodes Universal POS tags to one of the following 1-letter tags, in order to simplify writing regular expressions
to find Parts of Speech sequences:<ul>
<li>A: adjective</li>
<li>C: coordinating conjuction</li>
<li>D: determiner</li>
<li>M: modifier of verb</li>
<li>N: noun or proper noun</li>
<li>P: preposition</li>
<li>O: other elements</li>
</ul>After which identifying a simple noun phrase can be just expressed by using the following 
regular expression (A|N)*N(P+D*(A|N)*N)* which basically says
start with adjective or noun, another noun, a preposition, determiner adjective or noun and next a noun again.

Convert Parts of Speech tags to one-letter tags which can be used to identify phrases based on regular expressions — as_phrasemachine

<dl>

<dt>x</dt>
<dd>a character vector of POS tags for example by using <code>udpipe_annotate</code></dd>


<dt>type</dt>
<dd>either 'upos' or 'penn-treebank' indicating to recode Universal Parts of Speech tags to the counterparts
as described in the description, or to recode Parts of Speech tags as known in the Penn Treebank to the counterparts
as described in the description</dd>

</dl>

as_phrasemachine: Convert Parts of Speech tags to one-letter tags which can be used to identify phrases based on regular expressions

Description

Usage

Value

Arguments

Details

See Also

Examples