Sentiment Analysis System using Hybrid Word Embeddings with Convolutional Recurrent Neural Network

The international arab journal of information technology

article

Fahd Alotaibi¹  Vishal Gupta² 

[1] Faculty of Computing and Information Technology, King Abdulaziz University;Department of Computer Science and Engineering, University Institute of Engineering and Technology, Panjab University Chandigarh

关键词: Analysis of sentiments;    convolutional neural networks;    part of speech tagging;    natural language processing;    word2Vec;    GloVe;    fastText;    hybrid embedding;    recurrent neural networks;   

DOI  :  10.34028/iajit/19/3/6

学科分类：计算机科学（综合）

来源: Zarqa University

【 摘 要 】

There have been wide ranges of innovations in sentiment analysis in recent past, with most effective ones involving use of various word embeddings methods for analysis of sentiments. GloVe and Word2Vec are acclaimed to be two most frequently used. A common problem with simple pre-trained embedding methods is that these ignore information related to sentiments of input texts and further depend on large text corpus for training purpose and generation of relevant vectors which is hindrance to researches involving smaller sized corpuses. The aim of proposed study is to propose a novel methodology for sentiment analysis that uses hybrid embeddings with a target to enhance features of available pre-trained embedding. Proposed hybrid embeddings use Part of Speech (POS) tagging and word2position vector over fastText with varied assortments of attached vectors to the pre-trained embedding vectors. The resultant form of hybrid embeddings is fed to our ensemble network-Convolutional Recurrent Neural Network (CRNN). The methodology has been tested for accuracy via different Ensemble models of deep learning and standard sentiment dataset with accuracy value of 90.21 using Movie Review (MVR) Dataset V2. Results show that proposed methodology is effective for sentiment analysis and is capable of incorporating even more linguistic knowledge-based techniques to further improve results of sentiment analysis.

【 授权许可】

Unknown