Preprocessing Arabic text on social media

Heliyon

Yasser Al-Dossari¹  Abdulaziz Al-Sumari²  Anwer Hilal²  Abdullah Al-Yahy²  Mohamed Osman Hegazi² 

[1] Corresponding author.;Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al-Kharj 11942, Saudi Arabia;

关键词: Natural language processing;    Information extraction;    Information retrieval;    Database;    Data analysis;    Knowledge discovery;   

DOI  :  

来源: DOAJ

【 摘 要 】

Currently, social media plays an important role in daily life and routine. Millions of people use social media for different purposes. Large amounts of data flow through online networks every second, and these data contain valuable information that can be extracted if the data are properly processed and analyzed. However, most of the processing results are affected by preprocessing difficulties. This paper presents an approach to extract information from social media Arabic text. It provides an integrated solution for the challenges in preprocessing Arabic text on social media in four stages: data collection, cleaning, enrichment, and availability. The preprocessed Arabic text is stored in structured database tables to provide a useful corpus to which, information extraction and data analysis algorithms can be applied. The experiment in this study reveals that the implementation of the proposed approach yields a useful and full-featured dataset and valuable information. The resultant dataset presented the Arabic text in three structured levels with more than 20 features. Additionally, the experiment provides valuable information and processed results such as topic classification and sentiment analysis.

【 授权许可】

Unknown