TEJAS Journal of Technologies and Humanitarian Science

Megha Agarwal
IT Department, Dr. Shakuntala Misra National Rehabilitation University, UP-India

Author

Vinodini Katiyar
IT Department, Dr. Shakuntala Misra National Rehabilitation University, UP-India

Author

Vandana Patel
IT Department, Dr. Shakuntala Misra National Rehabilitation University, UP-India

Author

Bineet Kumar Gupta
Department of Computer Science and Information Systems, Institute of Technology, Shri Ramswaroop Memorial University, Barabanki, 225003

Author

📜 License:

This work is licensed under a Creative Commons Attribution 4.0 International License

• Share — Copy and Redistribute the material
• Adapt — Remix, Transform, and build upon the material
• The licensor cannot revoke these freedoms as long as you follow the license terms.

Abstract:

The rapid expansion of social media has led to the generation of massive volumes of data, emphasizing the need to extract valuable insights, categorize information, and predict user sentiments effectively. Text classification, a prominent domain within natural language processing (NLP), focuses on organizing unstructured textual data into sentiment categories to enhance its interpretability. Achieving high accuracy in sentiment categorization calls for refined and efficient text classification techniques. Although Deep Learning models have considerably advanced this field, there remains room for optimization. This study applies the NLP framework to a WhatsApp group dataset to identify sentiment patterns and evaluates five Deep Learning models: Neural Network, Recurrent Neural Network (RNN), Long Short-Term Memory (LSTM), Bidirectional LSTM, and Convolutional Neural Network (CNN). Furthermore, it introduces a hybrid CNN–BiLSTM model that integrates feature extraction mechanisms with specific activations, dropouts, filters, kernel sizes, and layered structures to enhance sentiment prediction. The performance of the proposed architecture is benchmarked against existing research. Among individual models, LSTM and BiLSTM achieved the highest accuracy of 81 percent, while the proposed hybrid model attained an improved accuracy of 88 percent on the same dataset, demonstrating superior effectiveness in sentiment classification.

References

[1] M. P. Akhter, Z. Jiangbin, I. R. Naqvi, M. Abdelmajeed, A. Mehmood, and M. T. Sadiq, “Document-level text classification using single-layer multisize filters convolutional neural network,” IEEE Access, vol. 8, no. Ml,pp. 42689–42707, 2020. doi: 10.1109/ACCESS.2020.2976744
[2] A. Wahdan, S. Hantoobi, S. A. Salloum, and K. Shaalan, “A systematic review of text classification research basedon deep learning models in Arabic language,” Int. J. Electr. Comput. Eng., vol. 6629–6643, 2020. doi: 10.11591/IJECE.V10I6.PP6629-6643 10, no. 6, pp.
[3] W. Fang, H. Luo, S. Xu, P. E. D. Love, Z. Lu, and C. Ye, “Automated text classification of near-misses from safety reports: An improved deep learning approach,” Adv. Eng. Informatics, vol. 44, no. March 2019, 101060, 2020. doi: 10.1016/j.aei.2020.101060 for text
[4] Z. Liu, C. Lu, H. Huang, S. Lyu, and Z. Tao, “Hierarchical Multi- granularity attention- based hybrid neural network classification,” 10.1109/ACCESS.2020.3016727 IEEE Access, vol. 8, pp. 149362–149371, 2020. doi:
[5] H. Yang, L. Luo, L. P. Chueng, D. Ling, and F. Chin, “Deep learning and its applications to natural language processing,” in Deep Learning: Fundamentals, Theory and Applications, 2019, pp. 89–109.
[6] R. Joshi, P. Goel, and R. Joshi, “Deep learning for hindi text classification: A comparison,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics, 2020, pp. 94–101. doi: 10.1007/978-3-030-44689-5_9
[7] Q. Li et al., “A survey on text classification: From shallow to deep learning,” IEEE Trans. NEURAL NETWORKS Learn. Syst., vol. 31, no. 11, pp. 1–21, 2020.
[8] F. Zaman, M. Shardlow, S. Hassan, and N. Radi, “HTSS : A novel hybrid text summarisation and simplification architecture,” Inf. Process. Manag., vol. 57, no. 6, 102351, 2020. doi: 10.1016/j.ipm.2020.102351
[9] K. Pasupa, T. Seneewong, and N. Ayutthaya, “Thai sentiment analysis with deep learning techniques: A comparative study based on word embedding , POS-tag , and sentic features,” Sustain. Cities Soc., vol. 50, no. 7, 101615, 2019. doi: 10.1016/j.scs.2019.101615
[10] K. Miok, D. Nguyen-Doan, B. Škrlj, D. Zaharie, and M. Robnik- Šikonja, “Prediction uncertainty estimation for hate speech classification,” Statistical Language and Speech Processing, pp. 286–298, 2019.
[11] H. Faris, I. Aljarah, M. Habib, and P. A. Castillo, “Hate speech detection using word embedding and deep learning in the arabic language context,” in Proc. 9th International Conference on Pattern Recognition Applications andMethods (ICPRAM 2020), 2022, pp. 453–460. doi: 10.5220/0008954004530460
[12] A. Garain, “The titans at semeval-2019 task 6: Offensive language identification, categorization and target identification,” in Proc. 13th International Workshop on Semantic Evaluation (SemEval- 2019), 2019, pp. 759762.
[13] B. Jang, M. Kim, G. Harerimana, S. Kang, and J. W. Kim, “Applied sciences Bi-LSTM Model to increase accuracy in text classification: Combining Word2vec CNN and attention mechanism,” Appl. Sci., vol. 10, no. 17, 5841, 2020.
[14] N. Jin, J. Wu, X. Ma, K. Yan, and Y. Mo, “Multi-task learning model based on multi-scale CNN and LSTM for sentiment classification,” IEEE Access, vol. 8, pp. 77060–77072, 2020. doi: 10.1109/ACCESS.2020.2989428
[15] F. E. Ayo, O. Folorunso, F. T. Ibharalu, and I. A. Osinuga, “Machine learning techniques for hate speech classification of twitter data: State-of-the-art, future challenges and research directions,” Comput. Sci. Rev., vol. 38, 100311, 2020. doi: 10.1016/j.cosrev.2020.100311