A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish

Marcos Orellana; Andrea Trujillo; Priscila Cedillo

doi:10.1007/978-3-030-39442-4_10

A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish

Marcos Orellana
, Andrea Trujillo
, Priscila Cedillo

Universidad del Azuay

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

Natural Language Processing (NLP) is used to identify key information, generating predictive models, and explaining global events or trends. Also, NLP is supported during the process to create knowledge. Therefore, it is important to apply refinement techniques in major stages such as preprocessing, when data is frequently produced and processed with poor results. This document analyzes and measures the impact of combinations of preprocessing techniques and libraries for short texts that have been written in Spanish. These techniques were applied in tweets for analysis of sentiments considering evaluation parameters in its analysis, the processing time and characteristics of the techniques for each library. The performed experimentation provides readers insights for choosing the appropriate combination of techniques during preprocessing. The results show improvement of up to 5% to 9% in the performance of the classification.

Original language	English
Title of host publication	Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC
Editors	Kohei Arai, Supriya Kapoor, Rahul Bhatia
Publisher	Springer
Pages	111-124
Number of pages	14
ISBN (Print)	9783030394417
DOIs	https://doi.org/10.1007/978-3-030-39442-4_10
State	Published - 2020
Event	Future of Information and Communication Conference, FICC 2020 - San Francisco, United States Duration: 5 Mar 2020 → 6 Mar 2020

Publication series

Name	Advances in Intelligent Systems and Computing
Volume	1130 AISC
ISSN (Print)	2194-5357
ISSN (Electronic)	2194-5365

Conference

Conference	Future of Information and Communication Conference, FICC 2020
Country/Territory	United States
City	San Francisco
Period	5/03/20 → 6/03/20

Keywords

Natural Language Processing
Preprocessing
Sentiment analysis
Text mining
Twitter

Access to Document

10.1007/978-3-030-39442-4_10

Cite this

Orellana, M., Trujillo, A., & Cedillo, P. (2020). A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish. In K. Arai, S. Kapoor, & R. Bhatia (Eds.), Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC (pp. 111-124). (Advances in Intelligent Systems and Computing; Vol. 1130 AISC). Springer. https://doi.org/10.1007/978-3-030-39442-4_10

Orellana, Marcos ; Trujillo, Andrea ; Cedillo, Priscila. / A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish. Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC. editor / Kohei Arai ; Supriya Kapoor ; Rahul Bhatia. Springer, 2020. pp. 111-124 (Advances in Intelligent Systems and Computing).

@inproceedings{e86bb24f7e7845d7810a1f86b95a1e29,

title = "A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish",

abstract = "Natural Language Processing (NLP) is used to identify key information, generating predictive models, and explaining global events or trends. Also, NLP is supported during the process to create knowledge. Therefore, it is important to apply refinement techniques in major stages such as preprocessing, when data is frequently produced and processed with poor results. This document analyzes and measures the impact of combinations of preprocessing techniques and libraries for short texts that have been written in Spanish. These techniques were applied in tweets for analysis of sentiments considering evaluation parameters in its analysis, the processing time and characteristics of the techniques for each library. The performed experimentation provides readers insights for choosing the appropriate combination of techniques during preprocessing. The results show improvement of up to 5\% to 9\% in the performance of the classification.",

keywords = "Natural Language Processing, Preprocessing, Sentiment analysis, Text mining, Twitter",

author = "Marcos Orellana and Andrea Trujillo and Priscila Cedillo",

note = "Publisher Copyright: {\textcopyright} 2020, Springer Nature Switzerland AG.; Future of Information and Communication Conference, FICC 2020 ; Conference date: 05-03-2020 Through 06-03-2020",

year = "2020",

doi = "10.1007/978-3-030-39442-4\_10",

language = "Ingl{\'e}s",

isbn = "9783030394417",

series = "Advances in Intelligent Systems and Computing",

publisher = "Springer",

pages = "111--124",

editor = "Kohei Arai and Supriya Kapoor and Rahul Bhatia",

booktitle = "Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC",

}

Orellana, M, Trujillo, A & Cedillo, P 2020, A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish. in K Arai, S Kapoor & R Bhatia (eds), Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC. Advances in Intelligent Systems and Computing, vol. 1130 AISC, Springer, pp. 111-124, Future of Information and Communication Conference, FICC 2020, San Francisco, United States, 5/03/20. https://doi.org/10.1007/978-3-030-39442-4_10

A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish. / Orellana, Marcos; Trujillo, Andrea; Cedillo, Priscila.
Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC. ed. / Kohei Arai; Supriya Kapoor; Rahul Bhatia. Springer, 2020. p. 111-124 (Advances in Intelligent Systems and Computing; Vol. 1130 AISC).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish

AU - Orellana, Marcos

AU - Trujillo, Andrea

AU - Cedillo, Priscila

PY - 2020

Y1 - 2020

N2 - Natural Language Processing (NLP) is used to identify key information, generating predictive models, and explaining global events or trends. Also, NLP is supported during the process to create knowledge. Therefore, it is important to apply refinement techniques in major stages such as preprocessing, when data is frequently produced and processed with poor results. This document analyzes and measures the impact of combinations of preprocessing techniques and libraries for short texts that have been written in Spanish. These techniques were applied in tweets for analysis of sentiments considering evaluation parameters in its analysis, the processing time and characteristics of the techniques for each library. The performed experimentation provides readers insights for choosing the appropriate combination of techniques during preprocessing. The results show improvement of up to 5% to 9% in the performance of the classification.

AB - Natural Language Processing (NLP) is used to identify key information, generating predictive models, and explaining global events or trends. Also, NLP is supported during the process to create knowledge. Therefore, it is important to apply refinement techniques in major stages such as preprocessing, when data is frequently produced and processed with poor results. This document analyzes and measures the impact of combinations of preprocessing techniques and libraries for short texts that have been written in Spanish. These techniques were applied in tweets for analysis of sentiments considering evaluation parameters in its analysis, the processing time and characteristics of the techniques for each library. The performed experimentation provides readers insights for choosing the appropriate combination of techniques during preprocessing. The results show improvement of up to 5% to 9% in the performance of the classification.

KW - Natural Language Processing

KW - Preprocessing

KW - Sentiment analysis

KW - Text mining

KW - Twitter

UR - https://www.scopus.com/pages/publications/85081305147

U2 - 10.1007/978-3-030-39442-4_10

DO - 10.1007/978-3-030-39442-4_10

M3 - Contribución a la conferencia

AN - SCOPUS:85081305147

SN - 9783030394417

T3 - Advances in Intelligent Systems and Computing

SP - 111

EP - 124

BT - Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC

A2 - Arai, Kohei

A2 - Kapoor, Supriya

A2 - Bhatia, Rahul

PB - Springer

T2 - Future of Information and Communication Conference, FICC 2020

Y2 - 5 March 2020 through 6 March 2020

ER -

Orellana M, Trujillo A, Cedillo P. A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish. In Arai K, Kapoor S, Bhatia R, editors, Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC. Springer. 2020. p. 111-124. (Advances in Intelligent Systems and Computing). doi: 10.1007/978-3-030-39442-4_10

A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

FOG Computing applied to monitoring devices used in assisted life environments (Environment Living); Study case: platform for the elderly.

Cite this

A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Projects

FOG Computing applied to monitoring devices used in assisted life environments (Environment Living); Study case: platform for the elderly.

Cite this