Autonomous Unified Robotic Assistant

Abstract

The Unified Robotic Assistant is a robot designed to help people by providing guidance and basic assistance in places like colleges, hospitals, and offices. In such environments, visitors and students often find it difficult to locate different departments, labs, or offices. Usually, they depend on help desks or staff members, which may not always be available immediately. To overcome this problem, an automated robotic assistant is proposed that can guide users without the need for constant human support. The system is built using a Raspberry Pi as the main controller along with a camera module for face detection. The robot can recognize certain individuals, such as faculty members, using stored facial data and greet them accordingly. It works in two modes: offline and online. In offline mode, the robot can perform face detection and basic interactions without requiring internet access. In online mode, it can answer user queries and provide information through voice-based interaction. The robot is also equipped with components such as DC motors, a motor driver, a speaker, a display module, and a lithium-ion battery, which help it move and communicate with users. Overall, the system offers a simple and cost-effective solution for aiding and improving interaction between humans and machines in institutional environments.

Introduction

The text describes the development of a Unified Robotic Assistant (AURA) designed to help users in environments like colleges, hospitals, and offices by providing automated guidance and interaction.

The system addresses the common problem of visitors struggling to find locations or staff, especially when human help desks are unavailable. It proposes a robotic solution using a Raspberry Pi-based platform with camera, microphone, sensors, and motor modules to enable face detection, voice interaction, and movement control. The robot can operate in both offline mode (basic face detection and interaction) and online mode (voice-based query handling and responses).

The proposed system improves over existing solutions like help desks, kiosks, and basic chatbots by offering real-time, intelligent, and personalized assistance, including face recognition and voice-based communication. It reduces dependency on human staff and enhances user convenience.

Technically, the system integrates:

• Computer vision (OpenCV) for face detection and recognition
• Speech recognition for voice commands
• Sensors (ultrasonic and IR) for navigation and obstacle avoidance
• Motor control via L298N driver for movement
• Python-based processing on Raspberry Pi

The architecture is modular, consisting of input acquisition, processing, decision-making, and action/output stages, allowing real-time interaction between users and the robot. The system is designed to be scalable and capable of future enhancements like advanced navigation and cloud integration.

Conclusion

The AURA (Autonomous Unified Robotic Assistant) project focuses on the design and development of an intelligent robotic assistant capable of assisting people in campus environments through autonomous operation and natural human–robot interaction. The system integrates multiple technologies including robotics, artificial intelligence, embedded systems, and sensor-based navigation to create a practical and interactive robotic platform. The robot is built around a Raspberry Pi–based control architecture, which serves as the main processing unit responsible for coordinating different functional modules such as voice interaction, visual perception, and motion control. A camera module is integrated into the system to enable face detection and recognition, allowing the robot to identify human presence and improve the quality of interaction with users. In addition, voice commands captured through a microphone module allow users to communicate with the robot naturally, making the system more user-friendly and accessible. The system also incorporates various sensors, including ultrasonic sensors for obstacle detection and IR sensors for line or edge detection, which help the robot perceive its surroundings and navigate safely. Based on the processed sensor data and user commands, the control system generates appropriate responses such as movement, greetings, or information display through motor drivers, display modules, and audio feedback. The integration of these components enables the robot to sense, process, and respond intelligently to real-world situations. A key feature of the AURA system is its dual-mode operation, where the robot can function in both online and offline environments. In the online AI mode, the robot can utilize cloud-based intelligence for more advanced interaction and processing, while the offline mode ensures that basic functionalities such as movement, greetings, and command recognition continue to operate even without internet connectivity. This design improves the reliability and flexibility of the robotic assistant in practical deployment scenarios.

References

[1] S. Kumar, R. Kumar, and A. Gupta, “Voice controlled robotic system using speech recognition,” International Journal of Engineering Research & Technology (IJERT), vol. 9, no. 5, 2020. [2] M. Sharma, A. Gupta, and R. Joshi, “Obstacle avoidance robot using ultrasonic and infrared sensors,” International Journal of Computer Applications, vol. 180, no. 32, 2018. [3] A. Rosebrock, “Face detection with Haar cascades using OpenCV,” PyImageSearch, 2017. [4] E. Upton and G. Halfacree, “Raspberry Pi User Guide,” Wiley Publishing, 2016. [5] R. Girshick, J. Donahue, T. Darrell, and J. Malik, “Rich feature hierarchies for accurate object detection and semantic segmentation,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014. [6] G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, et al., “Deep neural networks for acoustic modeling in speech recognition,” IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82–97, 2012. [7] S. Thrun, W. Burgard, and D. Fox, “Probabilistic Robotics,” MIT Press, 2005.

Copyright

Copyright © 2026 Alena Biju, Janani P, Akula Mahalakshmi, Kaviya A, Dr. J. Jebastine. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.