Comparative Evaluation of Automatic Labeling and Modeling Strategies for Indonesian Sentiment Analysis: Methodology and Performance Evaluation

Latifa, Khoiriya, Handayanto, Agung, Dwi M.S, Nur Latifah, Bhandari, Rahul ORCID: https://orcid.org/0000-0001-5162-134X, Trong Hien, Ton Nguyen and Pirnazarov, Doston ORCID: https://orcid.org/0009-0000-1405-0461 (2026) Comparative Evaluation of Automatic Labeling and Modeling Strategies for Indonesian Sentiment Analysis: Methodology and Performance Evaluation. Advance Sustainable Science Engineering and Technology, 8 (3): 0260308. University of PGRI Semarang . ISSN 2715-4211 Available at: https://doi.org/10.26877/asset.v8i3.2862

[thumbnail of Comparative Evaluation of Automatic Labeling and Modeling Strategies.pdf]
Preview
Text
Comparative Evaluation of Automatic Labeling and Modeling Strategies.pdf - Published Version
Available under License Creative Commons Attribution Share Alike.

Download (527kB) | Preview

Abstract

Sentiment analysis is vital for understanding consumer perception, yet Indonesian sentiment classification faces challenges due to labeled data scarcity and computational constraints. This study advances automatic labeling techniques and establishes performance benchmarks for Indonesian text. The research compares two labeling approaches InSet Lexicon and IndoBERT based Hugging Face pipeline on 8,447 Tapera-related opinions. Results show InSet Lexicon produced a highly skewed distribution (89.66% neutral), while the IndoBERT pipeline achieved a more balanced distribution (47.66% neutral, 38.43% positive, 13.91% negative).. Evaluation of various modeling strategies revealed that combining InSet Lexicon + TF-IDF with Naïve Bayes or Random Forest achieved scores above 85%. While RNN-LSTM reached >90% accuracy, it required significant resources. Notably, fine-tuning IndoBERT with optimal hyperparameters yielded the most robust performance, achieving 80–90% accuracy with a low validation loss of 0.1. The study concludes that for small datasets (<12,000 samples), the most effective strategies for Indonesian sentiment analysis are either the InSet Lexicon paired with traditional Machine Learning or automatic labeling using pre-trained models followed by rigorous fine-tuning.

Item Type: Article
Uncontrolled Keywords: Automatic labeling | Low resources nlp | Postagging | Sentiment analysis | Vectorization
Subjects: Physical, Life and Health Sciences > Computer Science
Vol/Issue no. published date: July 2026
Depositing User: Mr. Syed Anas Ali
Date Deposited: 14 Jul 2026 11:14
Last Modified: 14 Jul 2026 11:14
Official URL: https://doi.org/10.26877/asset.v8i3.2862
URI: https://pure.jgu.edu.in/id/eprint/12032

Downloads

Downloads per month over past year

Actions (login required)

View Item
View Item