Knowledge Discovery and DataNo Access

Application of Support Vector Machine for Arabic Sentiment Classification Using Twitter-Based Dataset

College of Computer Science and Information Technology, Community College Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia

E-mail Address: snalyami@iau.edu.sa

Search for more papers by this author

and

Sunday O. Olatunji

College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia

E-mail Address: osunday@iau.edu.sa

Search for more papers by this author

https://doi.org/10.1142/S0219649220400183Cited by:17 (Source: Crossref)

This article is part of the issue:

Special Issue on Intelligent Computing Systems and Data Analytics Applications (ICSDAA)
Guest Editor: Fadi Thabtah

Abstract

Sentiment classification is the process of classifying emotions and opinions in texts. In this study, the problem of Arabic sentiment analysis was addressed. A support vector machine (SVM) model was proposed to classify opinions in Arabic micro-texts as being positive or negative. To evaluate the performance of the SVM model, a dataset was built from tweets discussing several social issues in Saudi Arabia. These issues include changes that were implemented by the country as part of a newly established vision, known as Saudi Arabia Vision 2030. The constructed dataset was manually annotated according to the sentiment conveyed in the text. To achieve the best sentiment classification accuracy, several procedures were implemented within the proposed framework including light stemming, feature extraction (Ngrams, emoji and tweet-topic features), parameter optimisation and feature-set reduction. The experimental results revealed excellent outcomes. An accuracy of 89.83% was achieved using the proposed SVM model.

Keywords:

References

Abuaiadah, D, Di Rajendran and M Jarrar [2018] Clustering Arabic tweets for sentiment analysis. In Proceedings of IEEE/ACS International Conference on Computer Systems and Applications, AICCSA, 2017 October, pp. 449–456. Available at https://doi.org/10.1109/AICCSA.2017.162. Google Scholar
Ahmad, K, D Cheng and Y Almas [2007] Multi-lingual sentiment analysis of financial news streams. In Proceedings of 1st International Workshop on Grid Technology for Financial Modeling and Simulation — PoS(GRID2006), p. 001. Trieste, Italy: Sissa Medialab. Available at https://doi.org/10.22323/1.026.0001. Google Scholar
Al-Ayyoub, M, AA Khamaiseh, Y Jararweh and MN Al-Kabi [2018] A comprehensive survey of arabic sentiment analysis. Information Processing and Management, 56(2), 320–342. Available at https://doi.org/10.1016/j.ipm.2018.07.006. Web of Science, Google Scholar
Al-Azani, S and E-SM El-Alfy [2018a] Combining emojis with Arabic textual features for sentiment classification. In 2018 9th International Conference on Information and Communication Systems, ICICS 2018, 2018 January, pp. 139–144. Available at https://doi.org/10.1109/IACS.2018.8355456. Google Scholar
Al-Azani, S and ES El-Alfy [2018b] Emojis-based sentiment classification of Arabic microblogs using deep recurrent neural networks. In 2018 International Conference on Computing Sciences and Engineering, ICCSE 2018 - Proceedings, pp. 1–6. Available at https://doi.org/10.1109/ICCSE1.2018.8374211. Google Scholar
Al-Azani, S and ESM El-Alfy [2017] Using word embedding and ensemble learning for highly imbalanced data sentiment analysis in short Arabic text. Procedia Computer Science, 109, 359–366. Available at https://doi.org/10.1016/j.procs.2017.05.365. Google Scholar
Al-Moslmi, T, M Albared, A Al-Shabi, N Omar and S Abdullah [2017] Arabic senti-lexicon: Constructing publicly available language resources for Arabic sentiment analysis. Journal of Information Science, 016555151668390. Available at https://doi.org/10.1177/0165551516683908. Web of Science, Google Scholar
Al-Radaideh, QA and GY Al-Qudah [2017] Application of rough set-based feature selection for Arabic sentiment analysis. Cognitive Computation, 9(4), 436–445. Available at https://doi.org/10..1007/s12559-017-9477-1. Web of Science, Google Scholar
Al-Rubaiee, H, R Qiu and D Li [2016] Identifying Mubasher software products through sentiment analysis of Arabic tweets. In 2016 International Conference on Industrial Informatics and Computer Systems, CIICS 2016. Available at https://doi.org/10.1109/ICCSII.2016.7462396. Google Scholar
Al-Smadi, M, M Al-Ayyoub, Y Jararweh and O Qawasmeh [2018] Enhancing aspect-based sentiment analysis of Arabic hotels’ reviews using morphological, syntactic and semantic features. Information Processing and Management. Available at https://doi.org/10.1016/j.ipm.2018.01.006. Web of Science, Google Scholar
Al-Smadi, M, O Qawasmeh, M Al-Ayyoub, Y Jararweh and B Gupta [2017] Deep recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews. Journal of Computational Science. Available at https://doi.org/10.1016/j.jocs.2017.11.006. Web of Science, Google Scholar
Al-Thubaity, A, Q Alqahtani and A Aljandal [2018] Sentiment lexicon for sentiment analysis of Saudi dialect tweets. Procedia Computer Science, 142, 301–307. Available at https://doi.org/10.1016/j.procs.2018.10.494. Google Scholar
Al-Twairesh, N, H Al-Khalifa, A Al-Salman and Y Al-Ohali [2017] AraSenTi-Tweet: A corpus for Arabic sentiment analysis of Saudi Tweets. Procedia Computer Science, 117, 63–72. Available at https://doi.org/10.1016/j.procs.2017.10.094. Google Scholar
Alayba, A, V Palade, M England and R Iqbal (2017). Arabic language sentiment analysis on health services. Available at https://doi.org/978-1-5090-6628-5. Google Scholar
Aldayel, HK and AM Azmi [2016] Arabic tweets sentiment analysis — A hybrid scheme. Journal of Information Science, 42(6), 782–797. Available at https://doi.org/10.1177/0165551515610513. Web of Science, Google Scholar
Altaher, A [2017] Hybrid approach for sentiment analysis of Arabic tweets based on deep learning model and features weighting. International Journal of Advanced and Applied Sciences, 4(8), 43–49. Available at https://doi.org/10.21833/ijaas.2017.08.007. Web of Science, Google Scholar
Alwakid, G, T Osman and T Hughes-Roberts [2017] Challenges in sentiment analysis for Arabic social networks. Procedia Computer Science, 117, 89–100. Available at https://doi.org/10.1016/j.procs.2017.10.097. Google Scholar
Arabic Sentiment Analysis Dataset SS2030 Dataset — Kaggle. (2019). Available at https://www.kaggle.com/snalyami3/arabic-sentiment-analysis-dataset-ss2030-dataset. Accessed on 27 May 2019. Google Scholar
Assiri, A, A Emam and H Al-Dossari [2018] Towards enhancement of a lexicon-based approach for Saudi dialect sentiment analysis. Journal of Information Science, 44(2), 184–202. Available at https://doi.org/10.1177/0165551516688143. Web of Science, Google Scholar
Badarneh, O, M Al-ayyoub, N Alhindawi, LA Tawalbeh and Y Jararweh (2018). Fine-grained emotion analysis of Arabic Tweets?: A multi-target multi-label approach. Available at https://doi.org/10.1109/ICSC.2018.00070. Google Scholar
Baly, R, G El-Khoury, R Moukalled, R Aoun, H Hajj, KB Shaban and W El-Hajj [2017] Comparative evaluation of sentiment analysis methods across Arabic dialects. Procedia Computer Science, 117, 266–273. Available at https://doi.org/10.1016/j.procs.2017.10.118. Google Scholar
Bobichev, V, O Kanishcheva and O Cherednichenko [2017] Sentiment analysis in the Ukrainian and Russian news. In 2017 IEEE First Ukraine Conference on Electrical and Computer Engineering (UKRCON), pp. 1050–1055. New York: IEEE. Available at https://doi.org/10.1109/UKRCON.2017.8100410. Google Scholar
Budiharto, W and M Meiliana [2018] Prediction and analysis of Indonesia Presidential election from Twitter using sentiment analysis. Journal of Big Data, 5(1), 51. Available at https://doi.org/10.1186/s40537-018-0164-1. Google Scholar
Cortes, C and V Vapnik [1995] Support vector networks. Machine Learning, 20(3), 273–297. Available at https://doi.org/10.1007/BF00994018. Web of Science, Google Scholar
Cui, S, D Wang, Y Wang, PW Yu and Y Jin [2018] An improved support vector machine-based diabetic readmission prediction. Computer Methods and Programs in Biomedicine, 166, 123–135. Available at https://doi.org/10.1016/j.cmpb.2018.10.012. Web of Science, Google Scholar
El-Naggar, N, Y El-Sonbaty and M Abou El-Nasr [2018] Sentiment analysis of modern standard Arabic and Egyptian dialectal Arabic tweets. In Proceedings of Computing Conference 2017, 2018–Janua (July), pp. 880–887. Available at https://doi.org/10.1109/SAI.2017.8252198. Google Scholar
Elshakankery, K and MF Ahmed [2019] HILATSA: A hybrid incremental learning approach for Arabic tweets sentiment analysis. Egyptian Informatics Journal. Available at https://doi.org/10.1016/j.eij.2019.03.002. Web of Science, Google Scholar
Hussien, WA, YM Tashtoush, M Al-Ayyoub and MN Al-Kabi [2016] Are emoticons good enough to train emotion classifiers of Arabic tweets? In Proceedings — CSIT 2016: 2016 7th International Conference on Computer Science and Information Technology, Available at https://doi.org/10.1109/CSIT.2016.7549459. Google Scholar
Itani, M, C Roast and S Al-Khayatt [2017] Developing resources for sentiment analysis of informal Arabic text in social media. Procedia Computer Science, 117, 129–136. Available at https://doi.org/10.1016/j.procs.2017.10.101. Google Scholar
Joachims, T (1998). Text categorization with support vector machines: Learning with many relevant features. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 1398, 137–142. Available at https://doi.org/10.1007/s13928716. Google Scholar
Kralj Novak, P, J Smailović, B Sluban and I Mozetič [2015] Sentiment of Emojis. PLOS ONE, 10(12), e0144296. Available at https://doi.org/10.1371/journal.pone.0144296. Web of Science, Google Scholar
Motaz Saad (2014). Arabic computational linguistics download — SourceForge.net. Available at https://sourceforge.net/projects/ar-text-mining/. Accessed on 1 January 2019. Google Scholar
Muhammad Abdul-Mageed, Mona T., Diab, MK [2013] Subjectivity and sentiment analysis of modern standard Arabic and Arabic microblogs. In Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, (3), pp. 55–64. Available at https://doi.org/10.1016/j.procs.2017.10.094. Google Scholar
Olatunji, SO [2017] Improved email spam detection model based on support vector machines. Neural Computing and Applications, 1–9. Available at https://doi.org/10.1007/s00521-017-3100-y. Google Scholar
Pang, B and L Lee (2008). Opinion Mining and Sentiment Analysis. Foundations and Trends $®$ in Information Retrieval, Vol. 2. Available at https://doi.org/10.1561/1500000011. Google Scholar
Read, J [2005] Using emoticons to reduce dependency in machine learning techniques for sentiment classification. In Proceedings of the ACL Student Research Workshop on — ACL ’05, p. 43. Morristown, NJ, USA: Association for Computational Linguistics. Available at https://doi.org/10.3115/1628960.1628969. Google Scholar
Refaee, EAA and EA Ahmad (2016). Sentiment Analysis for micro-blogging platforms in Arabic. Available at http://www.ros.hw.ac.uk/handle/10399/3166. Accessed on 30 January 2019. Google Scholar
Rushdi-Saleh, M, MT Martín-Valdivia and LA Ureña-López [2011] OCA: Opinion corpus for Arabic Mohammed. Journal of the American Society for Information Science and Technology, 62(10), 2045–2054. Available at https://doi.org/10.1002/asi.21598. Web of Science, Google Scholar
Sharma, A, A Sharma, RK Singh and MD Upadhayay [2017] Hybrid Classifier for sentiment analysis using effective pipelining. International Research Journal of Engineering and Technology (IRJET), 4(8), 2276–2281. Available at https://irjet.net/archives/V4/i8/IRJET-V4I8411.pdf. Google Scholar
Sun, Y, M Fang and X Wang [2018] A novel stock recommendation system using Guba sentiment analysis. Personal and Ubiquitous Computing, 22(3), 575–587. Available at https://doi.org/10.1007/s00779-018-1121-x. Web of Science, Google Scholar
The Social Clinic (2018). Available at http://www.thesocialclinic.com/saudi-arabia-ranks-first-on-twitter-worldwide/. Accessed on 28 December 2018. Google Scholar
Wahbeh, A, M Al-Kabi, Q Al-Radaideh, E Al-Shawakfa and I Alsmadi [2011] The effect of stemming on Arabic text classification. International Journal of Information Retrieval Research, 1(3), 54–70. Available at https://doi.org/10.4018/ijirr.2011070104. Google Scholar
Wang, H, B Zheng, SW Yoon and HS Ko [2018] A support vector machine-based ensemble algorithm for breast cancer diagnosis. European Journal of Operational Research, 267(2), 687–699. Available at https://doi.org/10.1016/j.ejor.2017.12.001. Web of Science, Google Scholar
Wilson, T, J Wiebe and P Hoffmann [2009] Recognizing contextual polarity: An exploration of features for phrase-level sentiment analysis. Computational Linguistics, 35(3), 399–433. Available at https://doi.org/10.1162/coli.08-012-R1-06-90. Web of Science, Google Scholar
Yergesh, B, G Bekmanova and A Sharipbay [2019] Sentiment analysis of Kazakh text and their polarity. Web Intelligence, 17(1), 9–15. Available at https://doi.org/10.3233/WEB-190396. Web of Science, Google Scholar