Latifa, Khoiriya, Handayanto, Agung, Dwi M.S, Nur Latifah, Bhandari, Rahul
ORCID: https://orcid.org/0000-0001-5162-134X, Trong Hien, Ton Nguyen and Pirnazarov, Doston
ORCID: https://orcid.org/0009-0000-1405-0461
(2026)
Comparative Evaluation of Automatic Labeling and Modeling Strategies for Indonesian Sentiment Analysis: Methodology and Performance Evaluation.
Advance Sustainable Science Engineering and Technology, 8 (3): 0260308.
University of PGRI Semarang
.
ISSN 2715-4211
Available at: https://doi.org/10.26877/asset.v8i3.2862
Comparative Evaluation of Automatic Labeling and Modeling Strategies.pdf - Published Version
Available under License Creative Commons Attribution Share Alike.
Download (527kB) | Preview
Abstract
Sentiment analysis is vital for understanding consumer perception, yet Indonesian sentiment classification faces challenges due to labeled data scarcity and computational constraints. This study advances automatic labeling techniques and establishes performance benchmarks for Indonesian text. The research compares two labeling approaches InSet Lexicon and IndoBERT based Hugging Face pipeline on 8,447 Tapera-related opinions. Results show InSet Lexicon produced a highly skewed distribution (89.66% neutral), while the IndoBERT pipeline achieved a more balanced distribution (47.66% neutral, 38.43% positive, 13.91% negative).. Evaluation of various modeling strategies revealed that combining InSet Lexicon + TF-IDF with Naïve Bayes or Random Forest achieved scores above 85%. While RNN-LSTM reached >90% accuracy, it required significant resources. Notably, fine-tuning IndoBERT with optimal hyperparameters yielded the most robust performance, achieving 80–90% accuracy with a low validation loss of 0.1. The study concludes that for small datasets (<12,000 samples), the most effective strategies for Indonesian sentiment analysis are either the InSet Lexicon paired with traditional Machine Learning or automatic labeling using pre-trained models followed by rigorous fine-tuning.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Automatic labeling | Low resources nlp | Postagging | Sentiment analysis | Vectorization |
| Subjects: | Physical, Life and Health Sciences > Computer Science |
| Vol/Issue no. published date: | July 2026 |
| Depositing User: | Mr. Syed Anas Ali |
| Date Deposited: | 14 Jul 2026 11:14 |
| Last Modified: | 14 Jul 2026 11:14 |
| Official URL: | https://doi.org/10.26877/asset.v8i3.2862 |
| URI: | https://pure.jgu.edu.in/id/eprint/12032 |
Downloads
Downloads per month over past year
Dimensions
Dimensions