Pre-processing Tasks in Indonesian Twitter Messages

International Conference on Computing and Applied Informatics 2016

物理学;计算机科学

Hidayatullah, A.F.^1 ; Ma'Arif, M.R.^2

Department of Informatics, Universitas Islam Indonesia, Jl. Kaliurang KM 14 5 Sleman, Yogyakarta, Indonesia^1

Department of Informatics Management, STMIK Jend. Achmad Yani Yogyakarta, Jl. Ringroad Barat, Banyuraden, Gamping, Yogyakarta, Indonesia^2

关键词: Data characteristics;    Indonesia;    Indonesians;    Pre-processing;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/801/1/012072/pdf
DOI  :  10.1088/1742-6596/801/1/012072

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

Twitter text messages are very noisy. Moreover, tweet data are unstructured and complicated enough. The focus of this work is to investigate pre-processing technique for Twitter messages in Bahasa Indonesia. The main goal of this experiment is to clean the tweet data for further analysis. Thus, the objectives of this pre-processing task is simply removing all meaningless character and left valuable words. In this research, we divide our proposed pre-processing experiments into two parts. The first part is common pre-processing task. The second part is a specific pre-processing task for tweet data. From the experimental result we can conclude that by employing a specific pre-processing task related to tweet data characteristic we obtained more valuable result. The result obtained is better in terms of less meaningful word occurrence which is not significant in number comparing to the result obtained by just running common pre-processing tasks.