DEEP LEARNING SOLUTION FOR SPARSITY PROBLEM TO IMPROVE RECOMMENDATION QUALITY

Sri Lestari, Tiwuk Mariana

Abstract


Recommendation systems have become indispensable across various platforms due to their ability to enhance personalized services. However, these systems face a critical challenge known as sparsity. Sparsity occurs when there are numerous gaps in data, making user preferences unknown. This results in less relevant recommendations, reducing system effectiveness and diminishing user satisfaction. Moreover, it can lead to missed business opportunities. The purpose of this study is to address the sparsity problem using Deep Learning to enhance recommendation quality. The research stages include literature review (SLR), data collection from the Netflix Prize dataset obtained from kaggle.com, data preprocessing, Deep Learning implementation, testing, analysis, and conclusions. The stages of this study are conducted literature study (SLR), data collection, data preprocessing, Deep Learning implementation, testing and analysis, and conclusions. The method of this study is carried out data preprocessing and imputaion using several existing methods by using the Netflix Prize dataset, data taken from kaggle.com. The result of this study shows that the Deep Learning method is able to solve the sparsity problem to improve the quality of recommendations, because the experimental results states that the Root Mean Squared Error (RMSE) value is the smallest compared to the Matrix-Factorization, SVD, KNN and other methods.

Keywords


Recommendation System; Sparsity; Deep Learning

Full Text:

PDF

References


Sri Lestari, M. Elrico Afdila, and Yan Aditiya Pratama, “Imputation Missing Value to Overcome Sparsity Problems in The Recommendation System,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 7, no. 6, pp. 1285–1291, 2023, doi: 10.29207/resti.v7i6.5300.

M. Rahman, I. A. Shama, S. Rahman, and R. Nabil, “Hybrid Recommendation System To Solve Cold Start Problem,” J. Theor. Appl. Inf. Technol., vol. 100, no. 11, pp. 3562–3580, 2022.

M. Singh, “Scalability and sparsity issues in recommender datasets: a survey,” Knowl. Inf. Syst., vol. 62, no. 1, pp. 1–43, 2020, doi: 10.1007/s10115-018-1254-2.

Mohamad Fahmi Hafidz and Sri Lestari, “Solution to Scalability and Sparsity Problems in Collaborative Filtering using K-Means Clustering and Weight Point Rank (WP-Rank),” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 7, no. 4, pp. 743–750, 2023, doi: 10.29207/resti.v7i4.4543.

G. Behera and N. Nain, “Handling data sparsity via item metadata embedding into deep collaborative recommender system,” J. King Saud Univ. - Comput. Inf. Sci., vol. 34, no. 10, pp. 9953–9963, 2022, doi: 10.1016/j.jksuci.2021.12.021.

Y. Yang, D. Hooshyar, and H. S. Lim, “GPS: Factorized group preference-based similarity models for sparse sequential recommendation,” Inf. Sci. (Ny)., vol. 481, pp. 394–411, 2019, doi: 10.1016/j.ins.2018.12.053.

H. T. Jia et al., “Application of graph neural network and feature information enhancement in relation inference of sparse knowledge graph,” J. Electron. Sci. Technol., vol. 21, no. 2, p. 100194, 2023, doi: 10.1016/j.jnlest.2023.100194.

Y. Luo, W. Peng, Y. Fan, H. Pang, X. Xu, and X. Wu, “Explicit sparse self-attentive network for CTR prediction,” Procedia Comput. Sci., vol. 183, no. 2018, pp. 690–695, 2021, doi: 10.1016/j.procs.2021.02.116.

W. Zhang, X. Zhang, H. Wang, and D. Chen, “A deep variational matrix factorization method for recommendation on large scale sparse dataset,” Neurocomputing, vol. 334, pp. 206–218, 2019, doi: 10.1016/j.neucom.2019.01.028.

M. Safitri, F. Rahmadani, E. Loniza, and S. Anggoro, Simple Visible Light Spectrophotometer Design Using 620 Nm Optical Filter, vol. 746 LNEE. 2021. doi: 10.1007/978-981-33-6926-9_54.

S. Lestari, T. B. Adji, and A. E. Permanasari, “Performance Comparison of Rank Aggregation Using Borda and Copeland in Recommender System,” 2018 Int. Work. Big Data Inf. Secur. IWBIS 2018, no. March 2019, pp. 69–74, 2018, doi: 10.1109/IWBIS.2018.8471722.

S. Lestari, T. B. Adji, and A. E. Permanasari, “NRF: Normalized Rating Frequency for Collaborative Filtering Paper,” Proc. ICAITI 2018 - 1st Int. Conf. Appl. Inf. Technol. Innov. Towar. A New Paradig. Des. Assist. Technol. Smart Home Care, pp. 19–25, 2018, doi: 10.1109/ICAITI.2018.8686743.

S. Lestari, T. B. Adji, and A. E. Permanasari, “WP-Rank: Rank aggregation based collaborative filtering method in recommender system,” Int. J. Eng. Technol., vol. 7, no. 4, pp. 193–197, 2018, doi: 10.14419/ijet.v7i4.40.24431.

Aria Maulana, Muhammad Rivaldi Asyhari, Yufis Azhar, and Vinna Rahmayanti Setyaning Nastiti, “Disease Detection on Rice Leaves through Deep Learning with InceptionV3 Method,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 7, no. 5, pp. 1147–1154, 2023, doi: 10.29207/resti.v7i5.4344.

F. Zamachsari and N. Puspitasari, “Penerapan Deep Learning dalam Deteksi Penipuan Transaksi Keuangan Secara Elektronik,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 5, no. 2, pp. 203–212, 2021, doi: 10.29207/resti.v5i2.2952.

Umar Aditiawarman, Dimas Erlangga, Teddy Mantoro, and Lutfil Khakim, “Face Recognition of Indonesia’s Top Government Officials Using Deep Convolutional Neural Network,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 7, no. 1, pp. 113–119, 2023, doi: 10.29207/resti.v7i1.4437.

A. Priyatama, Z. Sari, and Y. Azhar, “Deep Learning Implementation using Convolutional Neural Network for Alzheimer’s Classification,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 7, no. 2, pp. 310–217, 2023, doi: 10.29207/resti.v7i2.4707.

A. Fareed, S. Hassan, S. Brahim, and Z. Halim, “Machine Learning with Applications A collaborative filtering recommendation framework utilizing social networks,” Mach. Learn. with Appl., vol. 14, no. January, p. 100495, 2023, doi: 10.1016/j.mlwa.2023.100495.

W. Zhang, X. Zhang, H. Wang, and D. Chen, “Neurocomputing A deep variational matrix factorization method for recommendation on large scale sparse dataset,” Neurocomputing, vol. 334, pp. 206–218, 2019, doi: 10.1016/j.neucom.2019.01.028.

N. Heidari and A. Koochari, “An attention-based deep learning method for solving the cold-start and sparsity issues of recommender systems,” no. September 2022, 2023, doi: 10.1016/j.knosys.2022.109835.

Z. Romadhon, E. Sediyono, and C. E. Widodo, “Various Implementation of Collaborative Filtering-Based Approach on Recommendation Systems using Similarity,” Kinet. Game Technol. Inf. Syst. Comput. Network, Comput. Electron. Control, vol. 4, no. 3, pp. 179–186, 2020, doi: 10.22219/kinetik.v5i3.1062.

M. Hasan, “A Comprehensive Collaborating Filtering Approach using Extended Matrix Factorization and Autoencoder in Recommender System,” vol. 10, no. 6, 2019.

J. Jiang, W. Li, A. Dong, Q. Gou, and X. Luo, “A Fast Deep AutoEncoder for high-dimensional and sparse matrices in recommender systems,” Neurocomputing, vol. 412, pp. 381–391, 2020, doi: 10.1016/j.neucom.2020.06.109.

H. Yuwafi, F. Marisa, and I. D. Wijaya, “Implementasi Data Mining Untuk Menentukan Santri Berprestasi Di Pp . Manaarulhuda Dengan Metode Clustering Algoritma K-Means,” J. SPIRIT, vol. 11, no. 1, pp. 22–29, 2019.

Y. Zhang, H. Xu, and X. Yu, “The Recommendation Algorithm Based on Improved Conditional Variational Autoencoder and Constrained Probabilistic Matrix Factorization,” Appl. Sci., vol. 13, no. 21, p. 12027, 2023, doi: 10.3390/app132112027.




DOI: https://doi.org/10.29100/jipi.v11i1.7027

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika)
ISSN 2540-8984
Published by
Prodi Pendidikan Teknologi Informasi
Universitas Bhinneka PGRI

Website :https://jurnal.stkippgritulungagung.ac.id/index.php/jipi/index
Email: jipistkippti@gmail.com

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.