Authors:
Koyel Chakraborty,Sudeshna Sani,Rajib Bag,DOI NO:
https://doi.org/10.26782/jmcms.2020.01.00008Keywords:
Machine learning,Neural Network,Sentiment Analysis,Multilingual Tweets,Abstract
India is a country of having versatile language and culture. Here, people speak in 22 different languages. With the help of Google Indic keyboard people can express their sentiments about any product, news, incidents, laws, games etc. over the social media in their native languages from individual smart phones, tablets or laptops. Sentiment analysis (SA) itself is a tough job, while multilingual SA is even harder as the style of expression varies in different languages. Among the existing approaches of SA till now the machine learning approach through neural network has overcome the limitations of others. The main aim of this paper is to represent a detailed study of the outputs generated from three different models implemented using Convolution Neural Network(CNN), Simple Recurrent Neural Network(RNN) and an amalgamated model of CNN and Long Short Term Memory (LSTM) without worrying about versatility of multilingualism using 2600 sample reviews in Hindi and Bengali. It is anticipated that the experimental results on these realistic reviews will prove to be effective for further research work.Refference:
I. A. B. Goldberg, and X. Zhu, “Seeing stars when there aren’t many stars:
graph-based semi- supervised learning for sentiment categorization” In
Proceedings of the First Workshop on Graph Based Methods for Natural
Language Processing, Association for Computational Linguistics, pp. 45-
52,2006.
A. Hassan, N. Mohammed, and A. K. A. Azad, “Sentiment analysis on bangle and
romanized bangla text (BRBT) using deep recurrent models,” Computing Research
Repository (CoRR), vol. bs/1610.00369, 2016. [Online]. Available:
http://arxiv.org/abs/1610.00369.
A. Trivedi, A. Srivastava, I. Singh, K. Singh, and S. K. Gupta, “Literature Survey on
Design and Implementation of Processing Model for Polarity Identification on
Textual Data of English.” IJCSI,2011.
B. G. Patra, D. Das,, A. Das, and R. Prasath, “Shared task on sentiment analysis in
indian languages (sail) tweets-an overview”, In International Conference on Mining
Intelligence and Knowledge xploration, pp. 650-655,Springer International
Publishing, December, 2015.
B. Pang, and L. Lee, “Opinion Mining and sentiment analysis,”, Foundations and
trends in information retrieval, 2(1-2), 1-135, 2008
B. Pang, L. Lee, “A sentimental education: Sentiment analysis using subjectivity
summarization based on minimum cuts” In Proceedings of the 42nd annual meeting
on Association for Computational Linguistics (p. 271),2004.
J. Mech. Cont.& Math. Sci., Vol.-15, No.-1, January (2020) pp 108-117
Copyright reserved © J. Mech. Cont.& Math. Sci.
Koyel Chakraborty et al
116
B. Pang, L. Lee, and S. Vaithyanathan, “Thumbs up?: sentiment classification using
machine learning techniques”. In Proceedings of the ACL-02 conference on
Empirical methods in natural language processing, Association for Computational
Linguistics, Vol. 10, pp. 79- 86,2002
Bullinaria, J.A., “Recurrent neural networks”. Neural Computation: Lecture, 2013.12.
E. Riloff, and J. Wiebe “Learning extraction patterns for subjective expressions” In
Proceedings of the 2003 conference on Empirical methods in natural language
processing, Association for Computational Linguistics, pp. 105-112,2003.
F. Zhu, and X. Zhang, “Impact of online consumer reviews on sales: The moderating
role of product and consumer characteristics” Journal of Marketing, 74(2), 133-
148,2010.
Gers, F.A., J. Schmidhuber, and F. Cummins, “Learning to forget: Continual
prediction with LSTM”. Neural computation, 2000.12(10): p.2451-2471.
Hochreiter, S. and J. Schmidhuber, “Long short-term memory”. Neural
computation,1997. 9(8): p. 735-1780.22.
J. Kim, G. Chern, D. Feng, E. Shaw, and E Hovy, “Mining and assessing discussions
on the web through speech act analysis” In Proceedings of the Workshop on Web
Content Mining with Human Language Technologies at the 5th International
Semantic Web Conference,2006.
J. Zhao, K. Liu, and G. Wang “Adding redundant features for CRFs based sentence
sentiment classification” In Proceedings of the conference on empirical methods in
natural language processing Association for Computational Linguistics, pp. 117-
126,2008.
K. Dave, S. Lawrence, and D. M. Pennock, “Mining the peanut gallery: Opinion
extraction and semantic classification of product reviews” In Proceedings of the 12th
international conference on World Wide Web, ACM, pp. 519-528,2003.
Kamal Sarkar, “Sentiment Polarity Detection in Bengali Tweets Using Deep
Convolutional Neural Networks”, https://doi.org/10.1515/jisys-2017-0418.
K Sarkar, M Bhowmick, “Sentiment polarity detection in bengali tweets using
multinomial Naïve Bayes and support vector machines”, – 2017 IEEE Calcutta
Conference (CALCON), 2017.
L-W Ku, Y.T. Liang, and H-H Chen, “Opinion Extraction,Summarization and
Tracking in News and Blog Corpora” In AAAI Spring Symposium: Computational
Approaches to AnalyzingWeblogs,2006.
M. Wiegand, A. Balahur, B. Roth, D. Klakow, and A. Montoyo, “A survey on the
role of negation in sentiment analysis” In Proceedings of the workshop on negation
J. Mech. Cont.& Math. Sci., Vol.-15, No.-1, January (2020) pp 108-117
Copyright reserved © J. Mech. Cont.& Math. Sci.
Koyel Chakraborty et al
117
and speculation in natural language processing, Association for Computational
Linguistics, pp. 60-68, 2010.
Q. Miao, Q. Li, and D. Zeng, “Fine grained opinion mining by integrating multiple
review sources” Journal of the American society for information science and
technology, 61(11), 2288-2299,2010.
Rajaram, Santhoshkumar & Geetha, M.. (2019). “Deep Learning Approach for
Emotion Recognition from Human Body Movements with Feed forward Deep
Convolution Neural Networks”. Procedia Computer Science. 152. 158-165.
10.1016/j.procs.2019.05.038.
R. Narayanan, B. Liu, and A. Choudhary, “Sentiment analysis of conditional
sentences” In Proceedings of the 2009 Conference on Empirical Methods in Natural
Language Processing, Association for Computational Linguistics, Vol. 1, pp. 180-
189,2009.
R. Prabowo, & M. Thelwall, “Sentiment analysis: A combined approach” Journal of
Informetrics, 3(2), 143-157, 2009.
R. Socher, A. Perelygin, J. Y. Wu, J. Chuang, C. D. Manning, A. Y. Ng and C. Potts,
“Recursive deep models for semantic compositionality over a sentiment Treebank”,
in: Proceedings of the Conference on Empirical Methods in Natural
LanguageProcessing (EMNLP), vol. 1631, p. 1642, ACL, Seattle, USA,2013.
S. Chowdhury and W. Chowdhury, “Performing sentiment analysis in bangla
microblog posts,” 2014 International Conference on Informatics, Electronics &
Vision (ICIEV), vol. 00, pp. 1–6,2014.
T. Joachims, “Making large scale SVM learning practical”,1999.
T. Mullen, and N. Collier, “Sentiment Analysis using Support Vector Machines with
Diverse Information Sources” In EMNLP, Vol. 4, pp.412-418, 2004.
Y. Kim, “Convolutional neural networks for sentence classification,” in the
Proceedings of the 2014 Conference on Empirical Methods in Natural Language
Processing, pp. 1746– 1751,2014.
Y. Zhang and B. C. Wallace, “A sensitivity analysis of (and practitioners’ guide to)
convolutional neural networks for sentence classification,” Computing Research
Repository (CoRR), vol. abs/1510.03820, 2015. [Online]. Available:
http://arxiv.org/abs/1510.03820.