Comparison of Random Forest and SVM in Sentiment Analysis of Education Reform

Authors

  • Nur Hayati Informatika, Universitas Muhammadiyah Karanganyar
  • Nova Tri Romadloni Informatika, Universitas Muhammadiyah Karanganyar

DOI:

https://doi.org/10.71302/jbidai.v9i1.92

Keywords:

Sentimen Analysis, youtube comments, educational reform, random forest, SVM

Abstract

This study aims to compare the performance of the Random Forest and Support Vector Machine (SVM) algorithms in conducting sentiment analysis on YouTube comments related to education reform in Indonesia. The dataset used in this study consisted of 981 comments collected from the YouTube platform, and randomly labeled with two categories: "positive" and "negative." The labeling process was carried out using Microsoft Excel, while data processing was carried out using RapidMiner software. Model evaluation was carried out using the cross-validation method to obtain more objective results and avoid overfitting. The results showed that the Random Forest algorithm obtained an accuracy of 99.87% ± 0.40% with a micro average of 99.87%, while the SVM algorithm produced an accuracy of 90.58% ± 3.78% with a micro average of 90.57%. Based on these results, it can be concluded that Random Forest has superior performance in classifying comment sentiment compared to SVM. This is due to Random Forest's ability to combine several decision trees to produce more stable and accurate predictions. The findings of this study can be a reference for other researchers in selecting the right algorithm for sentiment analysis on text data, especially in the context of education and public opinion.

References

[1] A. Safira, A. S. Masyarakat…, and F. N. Hasan, “ANALISIS SENTIMEN MASYARAKAT TERHADAP PAYLATER MENGGUNAKAN METODE NAIVE BAYES CLASSIFIER,” Jurnal Sistem Informasi, vol. 5, no. 1, 2023.

[2] A. Susanto, I. Agung Dzulkarnain, P. Studi Statistika, and F. Matematika Dan Ilmu Pengetahuan Alam, “Analisis Sentimen Data Twitter Topik Ekonomi Dan Industri Dengan Metode Naive Bayes Dan Random Forest,” Jurnal Ilmiah Wahana Pendidikan, Oktober, vol. 2023, no. 20, pp. 59–65, doi: 10.5281/zenodo.8398895.

[3] F. A. Abdullah, G. Nusantara Bakry, S. Fatimah, Z. Fibaeti, and I. Komunikasi, “MUKASI: Jurnal Ilmu Komunikasi Analisis Sentimen dan Jaringan Pada Video Youtube Malaka ‘Memahami Danantara dengan Mudah,’” vol. 4, no. 3, pp. 750–761, 2025, doi: 10.54259/mukasi.v4i3.5162.

[4] R. Tjut Adek, Z. Fitri, and S. C. Siregar, “Analisis Sentimen Komentar Pada Saluran Youtube Beauty Vlogger Berbahasa Indonesia Menggunakan Metode Support Vector Machine,” Jurnal Algoritme, vol. 5, no. 2, pp. 164–175, Apr. 2025, doi: 10.35957/algoritme.v5i2.9692.

[5] N. Arita, “ANALISIS SENTIMEN PENGGUNA YOUTUBE TERHADAP ANIME SPY X FAMILY BAHASA INDONESIA MENGGUNAKAN NAÏVE BAYES,” Jurnal Informatika dan Teknik Elektro Terapan, vol. 13, no. 3, Jul. 2025, doi: 10.23960/jitet.v13i3.7362.

[6] R. A. Firsttama, A. A. Arifiyanti, and D. S. Y. Kartika, “Analisis Sentimen Komentar Youtube Konferensi Tingkat Tinggi G20 Menggunakan Metode Naive Bayes,” Jurnal Teknologi Dan Sistem Informasi Bisnis, vol. 6, no. 2, pp. 282–285, Apr. 2024, doi: 10.47233/jteksis.v6i2.1263.

[7] A. N. Syafia, M. F. Hidayattullah, and W. Suteddy, “Studi Komparasi Algoritma SVM Dan Random Forest Pada Analisis Sentimen Komentar Youtube BTS,” vol. 8, no. 3, 2023.

[8] H. Al Rasyid Harpizon et al., “Analisis Sentimen Komentar Di YouTube Tentang Ceramah Ustadz Abdul Somad Menggunakan Algoritma Naïve Bayes,” Jurnal Nasional Komputasi dan Teknologi Informasi, vol. 5, no. 1, 2022.

[9] S. Risyani, J. K. Sihotang, A. L. Prastia, A. Putra, and R. Fahlapi, “PERBEDAAN SISTEM PENDIDIKAN INDONESIA DENGAN NEGARA-NEGARA DI ASIA TENGGARA,” Educatioanl Journal: General and Specific Research, vol. 4, no. Juni, pp. 343–350, 2024.

[10] L. Eko Wahyudi et al., “Mengukur Kualitas Pendidikan di Indonesia,” 2022. [Online]. Available: https://jurnal.maarifnumalang.id/

[11] R. Rosdiana, F. Yuniar, D. A. Solihin, A. Amaliah, and S. Anwar, “Reformasi Pendidikan Global: Membangun Sistem Pendidikan yang Responsif terhadap Perubahan Sosial dan Teknologi,” Edu Cendikia: Jurnal Ilmiah Kependidikan, vol. 4, no. 03, pp. 1825–1838, Dec. 2024, doi: 10.47709/educendikia.v4i03.5605.

[12] D. Yunanda Putri, P. Studi Pendidikan Agama Islam, and S. Sangatta Kutai Timur, “Transformasi Pendidikan Indonesia di Era Reformasi: Analisis Perubahan, Tantangan, dan Harapan,” JIMU, 2025.

[13] A. Alhabeeb, M. Mohammed Abusharhah, T. Hariguna, and A. Rafi Hananto, “INTERNATIONAL JOURNAL ON INFORMATICS VISUALIZATION journal homepage : www.joiv.org/index.php/joiv INTERNATIONAL JOURNAL ON INFORMATICS VISUALIZATION An Investigation into Indonesian Students’ Opinions on Educational Reforms through the Use of Machine Learning and Sentiment Analysis.” [Online]. Available: www.joiv.org/index.php/joiv

[14] F. Khusna, S. Nur’aini, K. Umam, and M. R. Handayani, “EVALUASI EFEKTIVITAS SUPPORT VECTOR MACHINE DAN RANDOM FOREST DALAM KLASIFIKASI ULASAN PENGGUNA APLIKASI STREAMING VIDIO,” JSiI | Jurnal Sistem Informasi, vol. 12, no. 2, 2025.

[15] OECD Digital Education Outlook 2023. in OECD Digital Education Outlook. OECD Publishing, 2023. doi: 10.1787/c74f03de-en.

[16] S. Rifky, “Dampak Penggunaan Artificial Intelligence Bagi Pendidikan Tinggi,” Indonesian Journal of Multidisciplinary on Social and Technology, vol. 2, no. 1, pp. 37–42, Feb. 2024, doi: 10.31004/ijmst.v2i1.287.

[17] Chely Aulia Misrun, E. Haerani, M. Fikry, and E. Budianita, “Analisis sentimen komentar youtube terhadap Anies Baswedan sebagai bakal calon presiden 2024 menggunakan metode naive bayes classifier,” Jurnal CoSciTech (Computer Science and Information Technology), vol. 4, no. 1, pp. 207–215, Apr. 2023, doi: 10.37859/coscitech.v4i1.4790.

[18] Asmara Andhini, Fadilah Nuria Handayani, Intan Diasih, and Nurmalitasari, “Analisis Sentimen Opini Publik pada Channel Youtube Mata Najwa Menggunakan Metode SVM,” Jurnal Teknik Informatika dan Teknologi Informasi, vol. 5, no. 2, pp. 139–154, Jul. 2025, doi: 10.55606/jutiti.v5i2.5426.

[19] A. N. Nurkalyisah, A. Triayudi, and I. D. Sholihati, “Analisis Sentimen pada Twitter Berbahasa Indonesia Terhadap Penurunan Performa Layanan Indihome dan Telkomsel,” Jurnal Sistem dan Teknologi Informasi (JustIN), vol. 10, no. 4, p. 387, Dec. 2022, doi: 10.26418/justin.v10i4.50858.

[20] N. Rochmawati, A. Khanif Zyen, and N. A. Widiastuti, “Comparison of Support Vector Machine (SVM) and Random Forest Algorithms in the Analysis of Social Media X User Sentiment Towards the TNI Bill,” 2025. [Online]. Available: http://jurnal.polibatam.ac.id/index.php/JAIC

[21] O. Audrey, D. E. Ratnawati, and I. Arwani, “Analisis Sentimen Pengguna Twitter Terhadap Opini Non Fungible Token di Indonesia Menggunakan Algoritma Random Forest Classifier,” 2022. [Online]. Available: http://j-ptiik.ub.ac.id

[22] S. Raihan Putri and L. Rosnita, “Sentiment Analysis of Youtube and Gotube Reviews on Google Play Using the Support Vector Machine (SVM) Method in Indonesia,” 2025. [Online]. Available: http://jurnal.polibatam.ac.id/index.php/JAIC

[23] N. K. T. A. Saputri, I. G. A. Gunadi, and I. M. G. Sunarya, “Analisis Sentimen Pelayanan Daring di Fakultas Teknik dan Kejuruan Universitas Pendidikan Ganesha Menggunakan Algoritma Naïve Bayes dan LSTM,” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 4, no. 3, pp. 1120–1129, Jul. 2024, doi: 10.57152/malcom.v4i3.1336.

Published

06/30/2026

How to Cite

Hayati, N., & Romadloni, N. T. (2026). Comparison of Random Forest and SVM in Sentiment Analysis of Education Reform. Journal of Big Data Analytic and Artificial Intelligence, 9(1), 7–14. https://doi.org/10.71302/jbidai.v9i1.92