Hand Gesture Controlled Robot for Multifunctional Operations

Abstract

This paper presents the design and implementation of a hand gesture-controlled robot capable of performing various tasks such as climbing poles, spraying pesticides, cutting grass, and monitoring temperature and humidity. The system leverages an accelerometer sensor to capture hand movements and communicates with a robotic system using Bluetooth technology. This approach offers a hands-free, intuitive interface for users, enhancing accessibility and operational efficiency in applications ranging from agriculture to assistive technology.

Introduction

Overview:
Hand gesture recognition systems have gained attention for their ability to enable intuitive and contactless human-computer interaction. These systems are especially beneficial for individuals with disabilities, robotics, gaming, and virtual reality. Using technologies like accelerometers, microcontrollers (e.g., Arduino), Bluetooth modules, and RF transmitters, these robots interpret hand gestures to control robotic movement.

Literature Review:
Several researchers have implemented gesture-controlled robots using various technologies:

• Iyer et al. used RF433 and an ADXL355 accelerometer.

• Chanda et al. created a smartphone-controlled robot using Bluetooth and Arduino.

• Deepak et al. utilized Zigbee and ADXL345 for wireless gesture control.

• Jawalekar used Arduino and RF for gesture detection via ADXL355.

• Setia et al. used ATmega16 and ADXL335 for long-range RF communication.

• Samanta et al. incorporated AT89C51 with MMA7361L accelerometer and RF modules with encoders/decoders.

Project Description:
The current project implements a hand-gesture-controlled robot using:

• Transmitter Unit: Includes an ADXL accelerometer, Arduino UNO, and Bluetooth (HC-05), powered by a 9V battery. It reads hand gestures and transmits data wirelessly.

• Receiver Unit: Uses Arduino UNO, HC-05, motor driver (L298N), and four motors powered by a 12V battery. It receives gesture data and controls the motors accordingly.

Methodology:

• Hand gestures are detected via accelerometer.

• Arduino processes gesture data and sends it via Bluetooth.

• Receiver Arduino decodes the data and drives the motors using the motor driver.

Applications:
Gesture control is applied in:

• Robotics and prosthetics

• Virtual and augmented reality

• Automotive interfaces

• Education and museums

• Entertainment and art

• Smart retail (mirrors, dressing rooms)

• Accessibility for elderly or disabled users

Results & Benefits:

• Enhances user experience with natural, touchless interaction

• Improves hygiene, especially in public or healthcare settings

• Supports users with mobility limitations

• Enables multitasking, safety in industrial and driving environments

• Adds immersive, intuitive control in gaming and virtual environments

• Offers customization and cleaner shared surfaces

Conclusion

The Hand Gestures Controlled Robot that enables users to control a robotic arm using simple hand gestures, thereby the field of human-robot interaction. This innovative system utilizes sensors, microcontrollers, and machine learning algorithms to recognize and interpret hand movements, providing a seamless and intuitive user experience. The robot\'s ability to learn and adapt to different hand gestures makes it an invaluable tool for various applications, including healthcare, education, and entertainment. For instance, it can be used to assist individuals with disabilities or limited mobility, allowing them to interact with their environment in a more meaningful way. This project demonstrates the possibilities of creating intuitive and interactive human-robot interfaces, which can have far-reaching implications for applications such as assistive technology, gaming, and education. With its impressive accuracy, responsiveness, and user-friendly interface, the hand gestures robot car is a significant step forward in the development of gesture-based robotics, and its potential applications are vast and exciting. This project demonstrates the potential for robotics and to improve the quality of life for individuals with disabilities, and to enhance the overall human experience. The possibilities are endless, and it will be exciting to see how this technology evolves and improves in the future

References

[1] Pranay Iyer, Sanjana Tarekar and Dr. Swati Dixit, “Hand Gesture Controlled Robot” in IEEE Journal of Selected Topics in Quantum Electronics, vol. 25, no. 3, Nagpur,India, pp. 1-5, 2019 [2] Premangshu Chanda, Pallab Kanti Mukherjee, Subrata Modak, Asoke Nath, “Gesture Controlled Robot using Arduino and Android”, vol. 5, no. 6, pp. 6784-6791, 2016 [3] Deepak, B & Soubagya Nayak and Jalumuru Nalini, “Development of Gesture Controlled Robot Using 3-Axis Accelerometer”, vol. 9, no. 41, pp. 315-324, 2016 [4] Prajwal Ashwin Jawalekar, “Robot Control by Using Human Hand Gestures”, vol. 6, no. 4, pp. 661-665, 2018 [5] Setia, Archika and Mittal, Surbhi and Nigam, Padmini and Singh, Shalini and Gangwar, Surendra, “Hand Gesture Recognition Based Robot Using Accelerometer Sensor”, vol. 4, no. 5, pp. 1058-1063, 2015 [6] Samanta, Argha & Kumar, Sangharsh and Saraswat, Deepak & Das, Bharnab & Kumar, Vibhuti and Channi, Harpreet Kaur, “Modeling and Designing of Gesture Control Robot” vol. 6, no. 7, pp. 723-729,2017

Copyright

Copyright © 2025 Rashika M E, Mamatha J.. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.