Logo
International Journal of
Research in Advanced Engineering and Technology
ARCHIVES
VOL. 10, ISSUE 2 (2024)
Fine-tuning pre-trained language models for grammatical acceptability, correction, sentiment analysis, and emotion detection
Authors
Rahaman Nagiur, Al-Muqaddam Anas, Khudyanzarov Shokhzodjon, Shamalik Garlyyev, Hussien Mohammed
Abstract

Clear and effective writing is essential for successful communication in diverse personal, professional, and academic contexts. However, crafting high-quality text can be challenging, requiring proficiency in grammar, nuanced expression of sentiment, and accurate conveyance of emotion. While existing writing assistance tools offer some support, they often need more holistically addressing these multifaceted aspects of writing. This research presents a novel Natural Language Processing (NLP) pipeline designed to provide comprehensive writing assistance by integrating four key functionalities: grammatical acceptability classification, grammar correction, sentiment analysis, and emotion detection. We leverage the power of fine-tuned pre-trained transformer models, specifically RoBERTa and FLAN-T5, to achieve robust performance across these tasks. Our pipeline employs a modular architecture, allowing for specialized training and evaluation of each component.

Furthermore, a conditional grammar correction step, triggered by the grammatical acceptability classifier, enhances efficiency by preventing unnecessary modifications to already well-formed sentences. Experimental results on benchmark datasets, including CoLA, Lang-8, SST-2, and GoEmotions, demonstrate the effectiveness of our approach. Our findings indicate that the proposed pipeline outperforms baseline models. This research contributes to the advancement of automated writing assistance, offering a comprehensive and robust framework for enhancing written communication's quality and emotional impact.
Download
Pages:43-49
How to cite this article:
Rahaman Nagiur, Al-Muqaddam Anas, Khudyanzarov Shokhzodjon, Shamalik Garlyyev, Hussien Mohammed "Fine-tuning pre-trained language models for grammatical acceptability, correction, sentiment analysis, and emotion detection". International Journal of Research in Advanced Engineering and Technology, Vol 10, Issue 2, 2024, Pages 43-49
Download Author Certificate

Please enter the email address corresponding to this article submission to download your certificate.