A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish

Marcos Orellana; Andrea Trujillo; Priscila Cedillo

doi:10.1007/978-3-030-39442-4_10

A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish

Marcos Orellana
, Andrea Trujillo
, Priscila Cedillo

Universidad del Azuay

Producción científica: Capítulo del libro/informe/acta de congreso › Contribución a la conferencia › revisión exhaustiva

2 Citas (Scopus)

Resumen

Natural Language Processing (NLP) is used to identify key information, generating predictive models, and explaining global events or trends. Also, NLP is supported during the process to create knowledge. Therefore, it is important to apply refinement techniques in major stages such as preprocessing, when data is frequently produced and processed with poor results. This document analyzes and measures the impact of combinations of preprocessing techniques and libraries for short texts that have been written in Spanish. These techniques were applied in tweets for analysis of sentiments considering evaluation parameters in its analysis, the processing time and characteristics of the techniques for each library. The performed experimentation provides readers insights for choosing the appropriate combination of techniques during preprocessing. The results show improvement of up to 5% to 9% in the performance of the classification.

Idioma original	Inglés
Título de la publicación alojada	Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC
Editores	Kohei Arai, Supriya Kapoor, Rahul Bhatia
Editorial	Springer
Páginas	111-124
Número de páginas	14
ISBN (versión impresa)	9783030394417
DOI	https://doi.org/10.1007/978-3-030-39442-4_10
Estado	Publicada - 2020
Evento	Future of Information and Communication Conference, FICC 2020 - San Francisco, Estados Unidos Duración: 5 mar. 2020 → 6 mar. 2020

Serie de la publicación

Nombre	Advances in Intelligent Systems and Computing
Volumen	1130 AISC
ISSN (versión impresa)	2194-5357
ISSN (versión digital)	2194-5365

Conferencia

Conferencia	Future of Information and Communication Conference, FICC 2020
País/Territorio	Estados Unidos
Ciudad	San Francisco
Período	5/03/20 → 6/03/20

Acceder al documento

10.1007/978-3-030-39442-4_10

Otros archivos y enlaces

Enlace a la publicación en Scopus

Fog Computing Aplicado A Monitoreo De Dispositivos Usados En Ambientes De Vida Asistidos (Ambient Assisted Living); Caso De Estudio: Plataforma Para El Adulto Mayor.
Cedillo Orellana, I. P. (Director), Campos Argudo, K. P. (Investigador), Granda Juca, M. F. (Investigador), Ortiz Segarra, J. I. (Investigador), Parra Gonzalez, L. O. (Investigador), Acosta-Urigüen, M. I. (Investigador Asociado), Erazo Garzon, L. X. (Investigador Asociado), Orellana Cordero, M. P. (Investigador Asociado), Bermeo Arpi, A. E. (Personal Tecnico Asimilado), Arias Ochoa, J. H. (Ayudante De Investigacion) & Arteaga Garcia, E. J. (Ayudante De Investigacion)
3/09/18 → 2/09/20
Proyecto: Investigación

Citar esto

Orellana, M., Trujillo, A., & Cedillo, P. (2020). A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish. En K. Arai, S. Kapoor, & R. Bhatia (Eds.), Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC (pp. 111-124). (Advances in Intelligent Systems and Computing; Vol. 1130 AISC). Springer. https://doi.org/10.1007/978-3-030-39442-4_10

Orellana, Marcos ; Trujillo, Andrea ; Cedillo, Priscila. / A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish. Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC. editor / Kohei Arai ; Supriya Kapoor ; Rahul Bhatia. Springer, 2020. pp. 111-124 (Advances in Intelligent Systems and Computing).

@inproceedings{e86bb24f7e7845d7810a1f86b95a1e29,

title = "A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish",

abstract = "Natural Language Processing (NLP) is used to identify key information, generating predictive models, and explaining global events or trends. Also, NLP is supported during the process to create knowledge. Therefore, it is important to apply refinement techniques in major stages such as preprocessing, when data is frequently produced and processed with poor results. This document analyzes and measures the impact of combinations of preprocessing techniques and libraries for short texts that have been written in Spanish. These techniques were applied in tweets for analysis of sentiments considering evaluation parameters in its analysis, the processing time and characteristics of the techniques for each library. The performed experimentation provides readers insights for choosing the appropriate combination of techniques during preprocessing. The results show improvement of up to 5\% to 9\% in the performance of the classification.",

keywords = "Natural Language Processing, Preprocessing, Sentiment analysis, Text mining, Twitter",

author = "Marcos Orellana and Andrea Trujillo and Priscila Cedillo",

note = "Publisher Copyright: {\textcopyright} 2020, Springer Nature Switzerland AG.; Future of Information and Communication Conference, FICC 2020 ; Conference date: 05-03-2020 Through 06-03-2020",

year = "2020",

doi = "10.1007/978-3-030-39442-4\_10",

language = "Ingl{\'e}s",

isbn = "9783030394417",

series = "Advances in Intelligent Systems and Computing",

publisher = "Springer",

pages = "111--124",

editor = "Kohei Arai and Supriya Kapoor and Rahul Bhatia",

booktitle = "Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC",

}

Orellana, M, Trujillo, A & Cedillo, P 2020, A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish. En K Arai, S Kapoor & R Bhatia (eds.), Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC. Advances in Intelligent Systems and Computing, vol. 1130 AISC, Springer, pp. 111-124, Future of Information and Communication Conference, FICC 2020, San Francisco, Estados Unidos, 5/03/20. https://doi.org/10.1007/978-3-030-39442-4_10

A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish. / Orellana, Marcos; Trujillo, Andrea; Cedillo, Priscila.
Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC. ed. / Kohei Arai; Supriya Kapoor; Rahul Bhatia. Springer, 2020. p. 111-124 (Advances in Intelligent Systems and Computing; Vol. 1130 AISC).

Producción científica: Capítulo del libro/informe/acta de congreso › Contribución a la conferencia › revisión exhaustiva

TY - GEN

T1 - A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish

AU - Orellana, Marcos

AU - Trujillo, Andrea

AU - Cedillo, Priscila

PY - 2020

Y1 - 2020

N2 - Natural Language Processing (NLP) is used to identify key information, generating predictive models, and explaining global events or trends. Also, NLP is supported during the process to create knowledge. Therefore, it is important to apply refinement techniques in major stages such as preprocessing, when data is frequently produced and processed with poor results. This document analyzes and measures the impact of combinations of preprocessing techniques and libraries for short texts that have been written in Spanish. These techniques were applied in tweets for analysis of sentiments considering evaluation parameters in its analysis, the processing time and characteristics of the techniques for each library. The performed experimentation provides readers insights for choosing the appropriate combination of techniques during preprocessing. The results show improvement of up to 5% to 9% in the performance of the classification.

AB - Natural Language Processing (NLP) is used to identify key information, generating predictive models, and explaining global events or trends. Also, NLP is supported during the process to create knowledge. Therefore, it is important to apply refinement techniques in major stages such as preprocessing, when data is frequently produced and processed with poor results. This document analyzes and measures the impact of combinations of preprocessing techniques and libraries for short texts that have been written in Spanish. These techniques were applied in tweets for analysis of sentiments considering evaluation parameters in its analysis, the processing time and characteristics of the techniques for each library. The performed experimentation provides readers insights for choosing the appropriate combination of techniques during preprocessing. The results show improvement of up to 5% to 9% in the performance of the classification.

KW - Natural Language Processing

KW - Preprocessing

KW - Sentiment analysis

KW - Text mining

KW - Twitter

UR - https://www.scopus.com/pages/publications/85081305147

U2 - 10.1007/978-3-030-39442-4_10

DO - 10.1007/978-3-030-39442-4_10

M3 - Contribución a la conferencia

AN - SCOPUS:85081305147

SN - 9783030394417

T3 - Advances in Intelligent Systems and Computing

SP - 111

EP - 124

BT - Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC

A2 - Arai, Kohei

A2 - Kapoor, Supriya

A2 - Bhatia, Rahul

PB - Springer

T2 - Future of Information and Communication Conference, FICC 2020

Y2 - 5 March 2020 through 6 March 2020

ER -

Orellana M, Trujillo A, Cedillo P. A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish. En Arai K, Kapoor S, Bhatia R, editores, Advances in Information and Communication - Proceedings of the 2020 Future of Information and Communication Conference FICC. Springer. 2020. p. 111-124. (Advances in Intelligent Systems and Computing). doi: 10.1007/978-3-030-39442-4_10

A Comparative Evaluation of Preprocessing Techniques for Short Texts in Spanish

Resumen

Serie de la publicación

Conferencia

Acceder al documento

Otros archivos y enlaces

Huella

Proyectos

Fog Computing Aplicado A Monitoreo De Dispositivos Usados En Ambientes De Vida Asistidos (Ambient Assisted Living); Caso De Estudio: Plataforma Para El Adulto Mayor.

Citar esto