TEJAS Journal of Technologies and Humanitarian Science

Hand Posture Detection and Mouse Controller

Lara Biswas

Author

📜 License:

This work is licensed under a Creative Commons Attribution 4.0 International License

• Share — Copy and Redistribute the material
• Adapt — Remix, Transform, and build upon the material
• The licensor cannot revoke these freedoms as long as you follow the license terms.

Abstract:

After the pandemic there is huge shift in technology field. The hand posture detection and mouse are one of those virtual technology research field. The virtual mouse controller has a functionality of the real mouse to let the user communicate with the system. It is a step towards Human Machine Interaction. Although there are different Bluetooth devices that perform the functionality of a mouse but it’s not completely physical free. This controller only requires a single hardware (webcam) that captures the frames, analyze them to predict the detection and perform mouse functionality using the gesture of user’s hand. This reduces the need of any external device to perform the functionality of the mouse and allows enhancing of computing experience.

References

[1]. Chang-Yi Kaoa* and Chin-Shyurng Fahna www.elsevier.com/Iocate/procedia D9515011@mail.ntust.edutw, No.43, Sec.4, KeelungRd., Taipei, 106, Taiwan, R.O.C [2]. J. Katona, “A review of human–computer interaction and virtual reality research fields in cognitive InfoCommunications,” Applied Sciences, vol. 11, no. 6, p. 2646, 2021.

[3]. L. Thomas, “Virtual mouse using hand gesture,” International Research Journal of Engineering and Technology (IRJET, vol. 5, no. 4, 2018.

[4]. D. L. Quam, “Gesture recognition with a Data Glove,” IEEE Conference on Aerospace and Electronics, vol. 2, pp. 755–760, 1990.

[5]. K. P. Vinay, “Cursor control using hand gestures,” International Journal of Critical Accounting, vol. 09758887, 2016.

[6]. J. T. Camillo Lugaresi, “MediaPipe: A Framework for Building Perception Pipelines,” 2019

[7]. https://www.tutorialspoint.com› opencv.

[8]. https://pypi.org/project/autopy/

[9]. P. Nandhini, J. Jaya, and J. George, “Computer vision system for food quality evaluation—a review,” in Proceedings of the 2013 International Conference on Current Trends in Engineering and Technology (ICCTET), pp. 85–87, Coimbatore, India, July 2013.

[10]. J. Jaya and K. Thanushkodi, “Implementation of certain system for medical image diagnosis,” European Journal of Scientific Research, vol. 53, no. 4, pp. 561–567, 2011.

[11]. P. Nandhini and J. Jaya, “Image segmentation for food quality evaluation using computer vision system,” International Journal of Engineering Research and Applications, vol. 4, no. 2, pp. 1–3, 2014.

[12]. V. Bazarevsky and G. R. Fan Zhang. On-Device, MediaPipe for Real-Time Hand Tracking.

[13]. K. Pulli, A. Baksheev, K. Kornyakov, and V. Eruhimov, “Realtime computer vision with openCV,” Queue, vol. 10, no. 4, pp. 40–56, 2012.

[14]. D.-S. Tran, N.-H. Ho, H.-J. Yang, S.-H. Kim, and G. S. Lee, “Real-time virtual mouse system using RGB D images and fingertip detection,” Multimedia Tools and ApplicationsMultimedia Tools and Applications, vol. 80, no. 7, pp. 10473–10490, 2021.

[15]. A. Haria, A. Subramanian, N. Asokkumar, S. Poddar, and J. S. Nayak, “Hand gesture recognition for human computer interaction,” Procedia Computer Science, vol. 115, pp. 367–374, 2017.

[16]. K. H. Shibly, S. Kumar Dey, M. A. Islam, and S. Iftekhar Showrav, “Design and development of hand gesture based virtual mouse,” in Proceedings of the 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT), pp. 1–5, Dhaka, Bangladesh, May 2019.

[17]. Verma, S. B., & Saravanan, C. (2018, September). Performance analysis of various fusion methods in multimodal biometric. In 2018 International Conference on Computational and Characterization Techniques in Engineering & Sciences (CCTES) (pp. 5–8). IEEE