Review on AI Based Gesture Home Automation

Abstract

In today’s fast?growing technological world, automation has become an essential part of modern living. Home automation systems are designed to make daily life easier, safer, and more comfortable. This project presents an AI based gesture home automation system with voice control that allows users to control home appliances such as lights and fans without physically touching any switches. The system uses Artificial Intelligence and computer vision techniques to recognize hand gestures through a camera, while voice commands are identified using speech recognition technology. The recognized gesture or voice command is processed and sent to a microcontroller, which controls the appliances using relay modules. This system is especially helpful for elderly and physically challenged people, as it provides a touchless and easy?to?use interface. Experimental results show that the system works accurately and efficiently in real?time conditions, making it suitable for smart home applications.

Introduction

Smart home technology has become increasingly important with advancements in Artificial Intelligence (AI), Internet of Things (IoT), and embedded systems. Traditional home automation systems rely on manual switches or mobile applications, which can be inconvenient for some users. To address these limitations, this project proposes an AI-based home automation system that combines gesture control and voice control, enabling touchless and hands-free operation for improved convenience and accessibility.

The system works by capturing hand gestures through a camera and processing them using computer vision and AI algorithms to recognize predefined gestures mapped to specific appliance functions. In parallel, voice commands are captured via a microphone and converted into text using speech recognition techniques, allowing users to control appliances verbally. Recognized gestures or voice commands are converted into control signals and transmitted wirelessly to a microcontroller, which activates relays to operate household devices in real time.

The design integrates hardware components such as cameras, microphones, microcontrollers, and relay modules with software for gesture recognition, speech processing, and communication protocols. The system is particularly useful for elderly and physically challenged individuals and can be applied in smart homes, hospitals, offices, and energy management systems. Key advantages include touchless operation, improved hygiene, intuitive interaction, and reduced reliance on physical switches, while limitations include sensitivity to lighting conditions and gesture similarity. Future enhancements include multimodal interaction, advanced sensors, and edge AI for faster response and improved privacy.

Conclusion

The AI-based gesture-controlled home automation system presents an innovative and practical approach to modern home automation. By combining artificial intelligence, computer vision, and IoT technologies, the system provides a seamless, contactless, and user-friendly method for controlling household appliances. While certain challenges such as lighting dependency and privacy concerns exist, continuous advancements in AI and sensor technologies are expected to overcome these limitations. Overall, the proposed system demonstrates significant potential to enhance smart living environments and improve the quality of life.

References

[1] R. C. Gonzalez and R. E. Woods, Digital Image Processing, 4th ed. Pearson Education, 2018. [2] S. Mitra and T. Acharya, “Gesture Recognition: A Survey,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 37, no. 3, pp. 311–324, May 2007. [3] B. I. Alabdullah, H. Ansar, N. A. Mudawi, and A. Jalal, “Smart Home Automation-Based Hand Gesture Recognition Using Feature Fusion and Neural Networks,” Sensors, vol. 23, no. 17, p. 7523, 2023. [4] P. Molchanov, S. Gupta, K. Kim, and J. Kautz, “Hand Gesture Recognition with 3D Convolutional Neural Networks,” in Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 1–7. [5] A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet Classification with Deep Convolutional Neural Networks,” Advances in Neural Information Processing Systems, vol. 25, pp. 1097–1105, 2012. [6] F. Chollet, Deep Learning with Python. New York, NY, USA: Manning Publications, 2018. [7] Google, “Media Pipe Hands: Real-Time Hand Tracking and Gesture Recognition,” Google AI Documentation, 2022. [Online]. Available: https://developers.google.com/mediapipe [8] A. S. Bankar, A. D. Harale, and K. J. Karande, “Gesture Controlled Home Automation Using Deep Learning: A Review,” International Journal of Current Engineering and Technology, vol. 11, no. 6, pp. 617–621, 2021.

Copyright

Copyright © 2026 Mariya Sheikh, Trupti Gahane, Harshada Dewalkar, Sahil Nakkawar, Kahekasha Sheikh. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.