Analisis Sentimen Ulasan Wisatawan terhadap Destinasi Wisata di Sumatera Utara Menggunakan IndoBERT
DOI:
https://doi.org/10.46880/jmika.Vol10No2.pp910-918Keywords:
IndoBERT, Sentiment Analysis, Tourist Reviews, Text Classification, Class ImbalanceAbstract
The growth of tourist reviews on travel destinations generates textual information that can potentially be used to understand tourists' perceptions, but sentiment classification faces challenges due to class distribution imbalance. This study aims to analyze the performance of IndoBERT in classifying tourist reviews into positive, neutral, and negative categories. The study uses a fine-tuning approach on IndoBERT with 1,500 tourist reviews and evaluates performance using accuracy, precision, recall, F1-score, and a classification report. The test results showed an accuracy of 72.67%, precision of 52.80%, recall of 72.67%, and an F1-score of 61.16%. However, class-wise analysis showed that the model only did well in identifying the neutral class, with a recall of 100% and an F1-score of 84.17%, while the negative and positive classes both scored 0% for precision, recall, and F1-score. This condition is related to the dominance of the neutral class at 73.07% in the dataset. This finding shows that accuracy alone isn't enough to evaluate a model on imbalanced sentiment data, and strategies to handle class imbalance are needed to improve the model's ability to recognize positive and negative sentiments.
References
Alnahhal, M., Tabash, M. I., Safi, S. K., Al-Absy, M. S., & Mamadiyarov, Z. (2026). A Comparative Study of Imbalance-Handling Methods in Multiclass Predictive Maintenance. In Computation (Vol. 14, Number 4, p. 88). https://doi.org/10.3390/computation14040088
Amin, M. (2023). Confusion Matrix in Three-class Classification Problems: A Step-by-Step Tutorial. Journal of Engineering Research, 7, 0. https://doi.org/10.21608/erjeng.2023.296718
Bangkalang, D., & Setiyawati, N. (2025). Perbandingan Bidirectional Encoder Representations from Transformers (BERT) Language Model pada Deteksi Emosi. Jurnal Pendidikan Dan Teknologi Indonesia, 5, 2952–2960. https://doi.org/10.52436/1.jpti.988
Benkendorf, D. J., Schwartz, S. D., Cutler, D. R., & Hawkins, C. P. (2023). Correcting for the effects of class imbalance improves the performance of machine-learning based species distribution models. Ecological Modelling, 483, 110414. https://doi.org/https://doi.org/10.1016/j.ecolmodel.2023.110414
Carvalho, M., Pinho, A. J., & Brás, S. (2025). Resampling approaches to handle class imbalance: a review from a data perspective. Journal of Big Data, 12(1), 71. https://doi.org/10.1186/s40537-025-01119-4
Chen, W., Yang, K., Yu, Z., Shi, Y., & Chen, C. L. P. (2024). A survey on imbalanced learning: latest research, applications and future directions. Artificial Intelligence Review, 57(6), 137. https://doi.org/10.1007/s10462-024-10759-6
Conciatori, M., Valletta, A., & Segalini, A. (2024). Improving the quality evaluation process of machine learning algorithms applied to landslide time series analysis. Computers & Geosciences, 184, 105531. https://doi.org/https://doi.org/10.1016/j.cageo.2024.105531
Farhadpour, S., Warner, T., & Maxwell, A. (2024). Selecting and Interpreting Multiclass Loss and Accuracy Assessment Metrics for Classifications with Class Imbalance: Guidance and Best Practices. Remote Sensing, 16, 533. https://doi.org/10.3390/rs16030533
Gupta, R. (2024). Bidirectional encoders to state-of-the-art: a review of BERT and its transformative impact on natural language processing. Информатика. Экономика. Управление - Informatics. Economics. Management, 3, 311–320. https://doi.org/10.47813/2782-5280-2024-3-1-0311-0320
Hellín, C. J., Olmedo, A. A., Valledor, A., Gómez, J., López-Benítez, M., & Tayebi, A. (2024). Unraveling the Impact of Class Imbalance on Deep-Learning Models for Medical Image Classification. In Applied Sciences (Vol. 14, Number 8, p. 3419). https://doi.org/10.3390/app14083419
Holm, A. N., Wright, D., & Augenstein, I. (2023). Revisiting Softmax for Uncertainty Approximation in Text Classification. In Information (Vol. 14, Number 7, p. 420). https://doi.org/10.3390/info14070420
Islam, M. S., Xiangdong, L., & Ahmed, J. (2026). BERT: advancements in language understanding for different NLP tasks: challenges and future perspectives. Journal of Electrical Systems and Information Technology, 13(1), 49. https://doi.org/10.1186/s43067-026-00341-1
Koto, F., Rahimi, A., Lau, J., & Baldwin, T. (2020). IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP. https://doi.org/10.18653/v1/2020.coling-main.66
Kristiyanti, D., Sanjaya, S., Tjokro, V., & Suhali, J. (2024). Dealing imbalance dataset problem in sentiment analysis of recession in Indonesia. IAES International Journal of Artificial Intelligence (IJ-AI), 13, 2060. https://doi.org/10.11591/ijai.v13.i2.pp2060-2072
Munir, R. A. (2025). Analisis sentimen cuitan di media sosial X tentang program makan bergizi gratis dengan metode NLP. Jurnal Informatika dan Teknik Elektro Terapan, 13(3). https://doi.org/10.23960/jitet.v13i3.6912
Nasrabadi, H., & Moattar, M. (2025). Sentiment Analysis of Imbalanced Dataset through Data Augmentation and Generative Annotation using DistilBERT and Low-Rank Fine-Tuning. https://doi.org/10.21203/rs.3.rs-5879286/v1
Nassr, Z., Benabbou, F., Sael, N., & Hamim, T. (2025). Improving Sentiment Analysis Performance on Imbalanced Moroccan Dialect Datasets Using Resample and Feature Extraction Techniques. In Information (Vol. 16, Number 1, p. 39). https://doi.org/10.3390/info16010039
Nurwanda, N., Suarna, N., & Prihartono, W. (2024). Penerapan NLP (Natural Language Processing) Dalam Analisis Sentimen Pengguna Telegram di Playstore. JATI (Jurnal Mahasiswa Teknik Informatika), 8, 1841–1846. https://doi.org/10.36040/jati.v8i2.8469
Purwanto, D. D. (2026). Empirical Evaluation of IndoBERT and LSTM for Sentiment Analysis of Tourism Reviews: A Data-Driven Study on Kenjeran Park. 7(1), 463–474.
Putri, A., Sulistianingsih, N., & Rismayati, R. (2025). Pengaruh Teknik Representasi Teks Bag-of-Words dan TF-IDF terhadap Akurasi Klasifikasi Sentimen Teks Multi-Domain. JTIM : Jurnal Teknologi Informasi Dan Multimedia, 7, 675–688. https://doi.org/10.35746/jtim.v7i4.756
Singgalen, Y. (2025). Performance Analysis of IndoBERT for Sentiment Classification in Indonesian Hotel Review Data. Journal of Information System Research (JOSH), 6, 976–986. https://doi.org/10.47065/josh.v6i2.6505
Sujon, K. M., Hassan, R., Choi, K., & Samad, M. A. (2025). Accuracy, precision, recall, f1-score, or MCC? empirical evidence from advanced statistics, ML, and XAI for evaluating business predictive models. Journal of Big Data, 12(1), 268. https://doi.org/10.1186/s40537-025-01313-4
Syah, M., Puspa, A., Idhom, M., & Trimono. (2025). Perbandingan Representasi Teks Tf-Idf Dan Bert Terhadap Akurasi Cosine Similarity Dalam Penilaian Otomatis Jawaban Berbasis Teks. Data Sciences Indonesia (DSI), 5, 47–59. https://doi.org/10.47709/dsi.v5i1.6021
Tampubolon, A., Sihotang, W., Ginting, M., & Sipayung, S. (2026). Analisis Sentimen Masyarakat Pada Media Sosial X Terhadap Kepemimpinan Presiden Prabowo Subianto Tahun 2025 Menggunakan Algoritma Naïve Bayes. Jurnal Minfo Polgan, 14, 3616–3625. https://doi.org/10.33395/jmp.v14i2.15837
Tandi, T. Y., Abidin, T. F., & Riza, H. (2025). Incorporation of IndoBERT and Machine Learning Features to Improve the Performance of Indonesian Textual Entailment Recognition. Journal of Information Systems Engineering and Business Intelligence, 11(2 SE-Articles), 173–186. https://doi.org/10.20473/jisebi.11.2.173-186
Terven, J., Cordova-Esparza, D.-M., Romero-González, J.-A., Ramírez-Pedraza, A., & Chávez-Urbiola, E. A. (2025). A comprehensive survey of loss functions and metrics in deep learning. Artificial Intelligence Review, 58(7), 195. https://doi.org/10.1007/s10462-025-11198-7
Toraman, C., Yilmaz, E., Şahinuç, F., & Ozcelik, O. (2022). Impact of Tokenization on Language Models: An Analysis for Turkish. https://doi.org/10.48550/arXiv.2204.08832
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Ommi Alfina, M. Safii
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
