Husnul Khotami Kindi
Nungki Selviandro
Gia Wulandari



Advances in Autonomous Vehicle (AV) technology have made this topic popular in recent years, both large and small companies have started to develop this AV technology. Apart from large companies, several researchers are also interested in developing this technology. However, due to cost constraints and security issues, the researchers developed AV using a computer simulation approach. The main objective of this paper is to create a simulation (AV). The simulation was created using Udacity self-driving-car from Unity 3D. The first step we took was to take a dataset in the form of images from a number of participants by manually driving a car in a simulation to get Human-driving-behavior. After the dataset is obtained, the AV model formation process will then be carried out using the deep learning method of the Convolutional Neural Network algorithm. In this research, a good AV simulation has been successfully made, the car can run perfectly following the track without experiencing a collision or going off the track. From the results of the testing carried out, the model that was built got pretty good results where the accuracy was 71% and the loss was 0.0165.

Full Text:


Article Metrics :


S. Kato, E. Takeuchi, Y. Ishigura, Y. Ninomiya, K. Takeda, and T. Hamada, “AN OPEN APPROACH TO AUTONOMOUS VEHICLES,” IEEE Micro, vol. 35, no. 6, pp. 60–68, Dec. 2015.

A. Faisal, M. Kamruzzaman, T. Yigitcanlar, and G. Currie, “Understanding autonomous vehicles,” J Transp Land Use, vol. 12, no. 1, pp. 45–72, 2019, doi: 10.2307/26911258.

“Waymo Driver – Waymo.” (accessed Jan. 29, 2023).

Y. Guang et al., “Survey on Autonomous Vehicle Simulation Platforms,” 2021 8th International Conference on Dependable Systems and Their Applications (DSA), Aug. 2021.

L. H. Meftah and R. Braham, “A virtual simulation environment using deep learning for autonomous vehicles obstacle avoidance,” in Proceedings - 2020 IEEE International Conference on Intelligence and Security Informatics, ISI 2020, Nov. 2020. doi: 10.1109/ISI49825.2020.9280513.

S. Du, H. Guo, and A. Simpson, “Self-Driving Car Steering Angle Prediction Based on Image Recognition,” Dec. 2019, [Online]. Available:

M. v Smolyakov, A. I. Frolov, V. N. Volkov, and I. v Stelmashchuk, “Self-Driving Car Steering Angle Prediction Based On Deep Neural Network An Example Of CarND Udacity Simulator.”

A. Dosovitskiy, G. Ros, F. Codevilla, A. López, and V. Koltun, “CARLA: An Open Urban Driving Simulator.”

L. Li, K. Ota, and M. Dong, “Humanlike Driving: Empirical Decision-Making System for Autonomous Vehicles,” IEEE Trans Veh Technol, vol. 67, no. 8, pp. 6814–6823, Aug. 2018, doi: 10.1109/TVT.2018.2822762.

S. Wang, D. Jia, and X. Weng, “Deep Reinforcement Learning for Autonomous Driving,” Nov. 2018, [Online]. Available:

D. Krajzewicz, G. Hertkorn, and P. Wagner, “SUMO (Simulation of Urban MObility) An open-source traffic simulation.”

Institute of Electrical and Electronics Engineers, Institute of Electrical and Electronics Engineers. Morocco Section, and Jāmiʻat al-Ḥasan al-Thānī. Ecole Normale Supérieure de l’Enseignement Technique de Mohammedia, ICOA 2018 Optimization : proceedings of the 2018 International Conference on Optimization and Applications (ICOA) : April 26-27, 2018, Mohammedia, Morocco.

Institute of Electrical and Electronics Engineers, Intelligent Transportation Systems (ITSC), 2010 13th International IEEE Conference on : date,19-22 Sept. 2010.

“RoadView Simulated Traffic Scene Viewpoint Image Sequence Road GIS Data Testing Assignment Evaluating Method Visualization Self-driving Trail Evaluation Result.”

L. Guofa, Y. Yifan, Q. Xingda, C. Dongpu, and L. Keqiang, “A deep learning based image enhancement approach for autonomous driving at night,” Knowl Based Syst, vol. 213, Feb. 2021.

M. I. Razzak, S. Naz, and A. Zaib, “Deep learning for medical image processing: Overview, challenges and the future,” in Lecture Notes in Computational Vision and Biomechanics, vol. 26, Springer Netherlands, 2018, pp. 323–350. doi: 10.1007/978-3-319-65981-7_12.

J. Gu et al., “Recent advances in convolutional neural networks,” Pattern Recognit, vol. 77, pp. 354–377, May 2018, doi: 10.1016/j.patcog.2017.10.013.

M. Bojarski et al., “End to End Learning for Self-Driving Cars,” Apr. 2016, [Online]. Available: