bdparData

A manually collected data set containing e-mails and SMS messages from the
nutritional and health domain classified as spam and non-spam (with a ratio
of 50%). In addition the dataset contains two variables: (i) path which
indicates the location of the target file and, (ii) source which contains
the raw text comprising each file.

datasets

Provide a tool to easily build customized data flows to pre-process large volumes
of information from different sources. To this end, 'bdpar' allows to (i) easily use and
create new functionalities and (ii) develop new data source extractors according to the
user needs. Additionally, the package provides by default a predefined data flow
to extract and pre-process the most relevant information (tokens, dates, ... ) from some textual
sources (SMS, Email, YouTube comments).

Miguel Ferreiro-D<c3><ad>az

bdpar

Big Data Preprocessing Architecture

Miguel Ferreiro-Díaz

David Ruano-Ordás

Tomás R. Cotos-Yañez

José Ramón Méndez Reboredo

University of Vigo 

bdparData function

A data frame with 20 rows and 2 variables:<dl>
 <dt>path</dt>
<dd>File path.</dd> <dt>source</dt>
<dd>File content.</dd>
</dl>

Format

Example of the content of the files to be preprocessed. — bdparData

A data frame with 20 rows and 2 variables:<dl>
 <dt>path</dt>
<dd>File path.</dd>

 <dt>source</dt>
<dd>File content.</dd>


</dl>

bdparData: Example of the content of the files to be preprocessed.

Description

Usage

Arguments

Format