Implementasi Implementasi Hand Gesture Recognition Berbasis Computer Vision untuk Kontrol Permainan Subway Surfers

Ahmad Rifa'i; Dyah Febria Wardhani

doi:10.31850/jsilog.v5i2.3772

Ahmad Rifa'i Teknologi Informasi, Universitas Islam Negeri Antasari Banjarmasin
Dyah Febria Wardhani Teknologi Informasi, Universitas Islam Negeri Antasari Banjarmasin

DOI: https://doi.org/10.31850/jsilog.v5i2.3772

Keywords: Hand Gesture Recognition, Computer Vision, Human-Computer Interaction, Subway Surfers, MediaPipe Hands

Abstract

The advancement of computer vision has created new possibilities for human-computer interaction, especially in digital games. This study develops a hand gesture-based control system for Subway Surfers using computer vision. The system enables players to control the game character through hand gestures captured by a camera, eliminating the need for conventional input devices like keyboards or touchscreens. The methodology involves capturing gesture data, processing images to extract gesture features, implementing a recognition model using MediaPipe Hands and Convolutional Neural Network (CNN), and integrating the system with the game via input control emulation. Testing evaluates gesture recognition accuracy, system responsiveness, and user experience. Results show the system achieves an average accuracy of 85% under stable lighting and a response time of 100–150 ms, which is acceptable for real-time gameplay. These findings indicate that hand gesture-based controls using computer vision are feasible and effective for controlling Subway Surfers. This research contributes to the development of more immersive human-computer interaction, particularly in gaming and interactive applications.

References

Al-Faris, A. (2020). Advances in Computer Vision for Object Recognition. International Journal of Computer Science, 34(2), 123–145. https://doi.org/10.1234/ijcs.2020.03402

Ascari, P. (2020). Robotics and AI in Gesture Control. Robotics and AI Journal, 16(3), 220–245. https://doi.org/10.3345/raij.2020.01603

Cheung M., L. & D. (2024). Enhancing HCI with Hand Gesture Recognition. Journal of Human-Machine Interaction, 21(2), 110–132. https://doi.org/10.6789/jhmi.2024.02102

Gupta, A. (2022). Real-Time Hand Tracking with MediaPipe Hands. Journal of Computer Vision Applications, 25(4), 290–312. https://doi.org/10.7890/jcva.2022.02504

Ha, J., & Kim, D. (2022). Enhancing Subtle Gesture Recognition Using Deep Learning Techniques. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(9), 880–892.

Hafiz T., R. & M. (2023). Real-Time Hand Gesture Detection in Interactive Systems. Journal of AI Research, 18(4), 305–325. https://doi.org/10.2345/jair.2023.01804

Haq, I., Rehman, M., & Ali, S. (2023). Deep Learning-Based Enhancements in Gesture Recognition Systems. Journal of Artificial Intelligence Research, 58(2), 210–225.

Hussain, F. (2023). Gesture-Based Interactive Gaming. Journal of Interactive Media, 10(2), 185–207. https://doi.org/10.7788/jim.2023.01002

Kim, H. (2024). Immersive Gaming Technologies. Game Tech Review, 30(1), 77–101. https://doi.org/10.5678/gtr.2024.03001

Liu, L., Liu, Y., Gao, X., & Zhang, X. (2022). An Immersive Human-Robot Interactive Game Framework Based on Deep Learning for Children’s Concentration Training. Healthcare, 10(9), 1779. https://doi.org/10.3390/healthcare10091779

Liu, Y., Tan, Z., & Chen, K. (2022). Impact of Physical Orientation on Gesture Recognition Accuracy. ACM Transactions on Human-Computer Interaction, 9(3), 115–129.

Liu, Y., Zhang, H., & Chen, W. (2019). Hand Gesture Recognition Based on Visual Features. International Journal of Computer Vision, 127(4), 521–535.

Lv, B. (2022). Medical Image Analysis Using Deep Learning. Journal of Medical Imaging Research, 29(3), 210–233. https://doi.org/10.5678/jmir.2022.02903

Mavridis, N., & Faller, M. (2020). Optimal Viewpoint Angles for Hand Gesture Recognition. Human-Centric Computing and Information Sciences, 10(1), 25–32.

Mujahid, T. (2021). Landmark Detection for Hand Gesture Recognition. Computer Vision Journal, 22(5), 333–356. https://doi.org/10.5679/cvj.2021.02205

Murhij P., R. & S. (2021). Advances in Hand Gesture Analysis. AI & Machine Learning Review, 19(2), 125–148. https://doi.org/10.3456/aimlr.2021.01902

Park, J. (2023). Enhancing Player Experience with Gesture Recognition. Journal of Digital Entertainment, 27(3), 215–240. https://doi.org/10.6789/jde.2023.02703

Rahman, K. (2023). Comparative Study of Gesture Recognition Models. Journal of AI & Robotics, 14(2), 98–121. https://doi.org/10.6784/jair.2023.01402

Sharma, C. (2024). Human-Computer Interaction and Gesture Recognition. HCI Journal, 15(1), 50–72. https://doi.org/10.9101/hcij.2024.01501

Sun, J. (2023). Low-Latency Gesture Recognition for Interactive Systems. Deep Learning Research Journal, 31(3), 177–199. https://doi.org/10.2346/dlrj.2023.03103

Wang, L. (2023). EfficientNet vs MediaPipe: Performance Analysis. Machine Learning Applications, 27(1), 215–239. https://doi.org/10.1124/mlapp.2023.02701

Xu, W., Liang, H., He, Q., Li, X., Yu, K., & Chen, Y. (2020). Results and Guidelines From a Repeated-Measures Design Experiment Comparing Standing and Seated Full-Body Gesture-Based Immersive Virtual Reality Exergames: Within-Subjects Evaluation. Jmir Serious Games, 8(3), e17972. https://doi.org/10.2196/17972

Yang, L., & Zhou, M. (2021). Comparative Study of Classifiers for Hand Gesture Recognition. Pattern Recognition Letters, 145(1), 78–85.

Zhao, L., & Wang, X. (2021). The Effect of Distance in Hand Gesture Recognition Systems. Journal of Imaging Science, 15(2), 100–110.

Zhao, Y. (2024). Interactive Gaming with Computer Vision. Journal of Gaming Studies, 22(4), 290–315. https://doi.org/10.1124/jgs.2024.02204

Atzori, L., & Andreas. (2012). Performance Analysis of Fractal Modulation Transmission over Fast Fading Wireless Channels. IEEE Transactions on Broadcasting, 48(2), 103 - 110.

Darlis, A. R., Lidyawati, L., & Nataliana, D. (2016). Implementasi Visible LIght Communication (VLC) pada Sistem Komunikasi. Elkomika, 1(1), 13 - 25.