AN SVM-BASED APPROACH FOR DETECTING DATA DEFINITION LANGUAGE OPERATIONS IN INDONESIAN NATURAL LANGUAGE

Yayak Kartika Sari
Fahrur Rozi
Agung Prasetya


DOI: https://doi.org/10.29100/joeict.v8i2.1649

Abstract


Text-to-SQL is an approach that enables users to interact with data-bases using natural language, eliminating the need to understand SQL syntax. However, most existing approaches translate input sentences directly into final SQL queries without explicitly identifying the type of SQL operation involved. This may obscure the distinction between structural and manipulative commands and increase the risk of execut-ing unintended or destructive queries. This study proposes separating the identification of SQL operation types—specifically Data Definition Language (DDL) commands—as a standalone classification task using the Support Vector Machine (SVM) algorithm. Indonesian-language sentences are preprocessed through tokenization, stopword removal, and stemming, then transformed into feature vectors using TF-IDF with unigram and bigram representations. Experiments were conducted on a dataset of 800 Indonesian sentences covering four DDL operations: CREATE, ALTER, DROP, and TRUNCATE. The results show that the proposed SVM model achieved an average accuracy of 93.05%, out-performing baseline models such as Naive Bayes and Random Forest. These findings indicate that early identification of SQL operation types can enhance the accuracy, efficiency, and safety of Text-to-SQL sys-tems. This work also highlights the importance of developing NLP ap-proaches tailored for the Indonesian language in the context of data-base querying.

Keywords


E-Modul, Lectora, Simulasi Digital

Full Text:

PDF

Article Metrics :

References


T. Yu et al., ‘Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-SQL task’, in Pro-ceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 2018, pp. 3911–3921.

A.-M. Popescu, O. Etzioni, and H. Kautz, ‘Towards a theory of natural language interfaces to databases’, in Proceedings of the 8th inter-national conference on Intelligent user interfaces, 2003, pp. 149–157.

I. Androutsopoulos, G. D. Ritchie, and P. Thanisch, ‘Natural language interfaces to databases—an introduction’, Natural Language Engi-neering, vol. 1, no. 1, pp. 29–81, 1995.

A.-M. Popescu, O. Etzioni, and H. Kautz, ‘Towards a theory of natural language interfaces to databases’, in Proceedings of the 8th inter-national conference on Intelligent user interfaces, 2003, pp. 149–157.

E. Goldberg and M. Safran, ‘Using natural-language processing to produce relational queries’, in Proceedings of the 13th annual meeting on Association for Computational Linguistics, ACL, 1985, pp. 183–189.

I. Androutsopoulos, G. D. Ritchie, and P. Thanisch, ‘Natural language interfaces to databases—an introduction’, Natural Language Engi-neering, vol. 1, no. 1, pp. 29–81, 1995.

A. Setzer and R. Gaizauskas, ‘A template-based approach to information extraction’, in Proceedings of the IJCAI Workshop on Text Min-ing and Link Analysis, 2001, pp. 65–72.

R. Rajkumar and M. White, ‘Template-based natural language generation for semantic querying’, in Proceedings of the 13th European Workshop on Natural Language Generation, 2011, pp. 65–75.

H. Liu, Y. Zhang, and C. Zhai, ‘A template-based approach for user query presentation in E-commerce’, in Proceedings of the 15th inter-national conference on World Wide Web, 2006, pp. 1053–1054.

A. Andrenucci and E. Sneiders, ‘A survey on natural language question answering systems’, Tech. Rep. 2005: 06, Institute of Computer Science, University of Latvia, vol. 14, no. 1, pp. 1–25, 2005.

V. Zhong, C. Xiong, and R. Socher, ‘Seq2SQL: Generating structured queries from natural language using reinforcement learning’, in Pro-ceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2017, pp. 959–970.

P. Yin and G. Neubig, ‘TranX: A transition-based neural abstract syntax parser for semantic parsing and code generation’, in EMNLP, 2018, pp. 5–14.

R. Jia and P. Liang, ‘Data recombination for neural semantic parsing’, in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2016, pp. 12–22.

L. Dong and M. Lapata, ‘Language to logical form with neural attention’, in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2016, pp. 33–43.

B. Wang, Y. Xie, P. Liu, M. Gardner, and N. A. Smith, ‘Text-to-SQL in the wild: A naturally-distributed dataset for multilingual text-to-SQL evaluation’, Transactions of the Association for Computational Linguistics, vol. 11, pp. 128–145, 2023.

T. Scholak, H. Schütze, and D. Bahdanau, ‘Picard: Parsing incrementally for constrained auto-regressive decoding from language models’, in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021, pp. 10322–10328.

B. Li, Y. Li, L. Wang, Y. Zhang, and X. Li, ‘Resdsql: Decoupling schema linking and skeleton parsing for text-to-sql parsers’, in Proceed-ings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL), 2023.

M. Chen et al., ‘Evaluating Large Language Models Trained on Code’. 2021.

D. Zhang and W. S. Lee, ‘Text classification using support vector machine with multi-word features’, in Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, 2003, pp. 366–367.

C. Cortes and V. Vapnik, ‘Support-vector networks’, Machine Learning, vol. 20, no. 3, pp. 273–297, 1995.

Y. Wahba, N. Madhavji, and J. Steinbacher, ‘A Comparison of SVM against Pre-trained Language Models (PLMs) for Text Classification Tasks’, arXiv preprint arXiv:2211.02563, 2022.

T. Hai, J. Zhou, S. Abolfath Zadeh, and others, ‘Evaluation of Text Classification Using Support Vector Machine Compared with Naive Bayes, Random Forest Decision Tree and K‑NN’, in Proceedings of ICACTCE’23, Lecture Notes in Networks and Systems, 2023, pp. 321–331.

B. Clavié and M. Alphonsus, ‘The Unreasonable Effectiveness of the Baseline: Discussing SVMs in Legal Text Classification’, arXiv preprint arXiv:2109.07234, 2021.