This project presents an AI-based real-time fitness assistance system that provides personalized workout guidance using computer vision techniques. The system uses a standard webcam to capture live exercise videos, eliminating the need for wearable sensors or specialized hardware. Human pose estimation is performed using MediaPipe Pose to accurately detect and track body landmarks in real time. A React-based web application is used to manage user interaction, workout selection, and live visualization of exercise performance. The detected landmarks are connected to form a skeletal representation of the human body, which enables detailed posture and movement analysis. Joint angles are calculated from the skeletal model to evaluate exercise correctness and body alignment. Each performed exercise is compared with predefined reference poses to assess posture accuracy. The system computes an accuracy score based on deviations between the user’s posture and the ideal pose. Real-time visual and textual feedback is provided to help users correct improper movements during workouts. The system continuously monitors workout duration and movement intensity throughout the session. Calorie expenditure is estimated using a metabolic equivalent–based model combined with motion analysis. Posture accuracy and movement quality are used to refine the calorie estimation for improved realism. User performance metrics are recorded at the end of each session. Historical workout data is stored to support long-term progress tracking and performance evaluation. Analytical visualizations are used to present trends in accuracy, duration, and calorie burn. All pose detection and analysis are performed on the client side within the web browser. This client-side approach ensures low latency and preserves user privacy by avoiding video data transmission. The system supports multiple workout types such as yoga, gym exercises, and dance-based fitness routines. The proposed solution is scalable and accessible across devices with a web camera. Overall, the system demonstrates an effective and intelligent approach to AI-driven home-based fitness training.
Introduction
The text discusses the development of an AI-powered real-time fitness assistance system designed to improve the safety, effectiveness, and accessibility of home-based workouts. Traditional fitness applications mainly rely on pre-recorded videos, wearable devices, or manual self-assessment, which lack real-time posture correction and personalized guidance. As a result, users may perform exercises incorrectly, reducing workout effectiveness and increasing the risk of injury.
To address these limitations, the proposed system uses artificial intelligence, computer vision, and human pose estimation techniques to analyze body movements through a standard camera. The system employs MediaPipe Pose and React-based web technologies to detect body landmarks and monitor posture in real time without requiring specialized sensors. It provides instant visual and voice-based corrective feedback, estimates calorie expenditure, and tracks workout performance while ensuring low latency and user privacy through client-side processing.
The system begins with user registration and profile creation, where details such as age, weight, fitness goals, and medical history are collected. Based on this information, personalized workout schedules and diet plans are generated. Users can select workout categories such as yoga, gym, or Zumba and choose different difficulty levels. During exercise sessions, the camera captures live video input, and machine learning models analyze body posture and movement accuracy by comparing detected joint angles with predefined reference poses. If incorrect posture is detected, corrective feedback is immediately provided.
The methodology uses MediaPipe Pose, which operates through a two-stage deep learning pipeline. The first stage detects the human body and generates a bounding box, while the second stage predicts 33 body landmarks including the head, shoulders, elbows, hips, knees, and ankles. These landmarks form a kinematic skeleton used for movement tracking, joint angle calculation, and posture evaluation. Exercise correctness is measured by comparing user joint angles with ideal reference angles, producing a posture accuracy score.
The frontend of the system is built using HTML, CSS, JavaScript, and React to provide an interactive and responsive user interface. Features include live camera feeds, skeletal overlays, workout instructions, timers, progress tracking, and navigation controls. The system also includes a voice-enabled medical assistance module that allows users to report pain or discomfort and receive preliminary guidance during workouts.
Conclusion
This research presented the design and development of an AI-powered real-time fitness trainer that integrates pose detection, adaptive workout strategies, personalized diet planning, health assistance, and performance tracking into a unified web-based platform. The system successfully utilizes computer vision and machine learning techniques to monitor user movements, analyze posture accuracy, and provide real-time corrective feedback. The implementation demonstrates that AI-based fitness training can significantly improve exercise effectiveness, reduce the risk of injury, and enhance user engagement through interactive guidance and performance analytics.
The experimental results confirm that the proposed system accurately detects body key-points, tracks workout sessions, estimates calorie expenditure, and generates personalized nutrition recommendations based on user preferences and fitness goals. The integration of progress tracking dashboards and health assistance features provides users with a comprehensive fitness monitoring experience. The web-based architecture ensures accessibility across multiple devices without requiring specialized hardware, making the system practical and cost-effective for everyday users.
Overall, the proposed solution demonstrates the potential of combining artificial intelligence, computer vision, and modern web technologies to create intelligent digital fitness platforms. The system offers a scalable and user- friendly approach to home-based fitness training and health management. Future enhancements can further improve system accuracy, expand exercise coverage, and incorporate wearable sensor integration to provide advanced fitness analytics and personalized healthcare support.
References
[1] G. Abhinand et al., “AI Fitness Trainer Using Human Pose Estimation,” International Journal of Advanced Research in Computer Science, 2023.
[2] S. S. Pawar et al., “Accurate Gym Exercise Form Detection Using MediaPipe,” International Journal of Computer Vision and Robotics, 2024.
[3] V. Suryawanshi et al., “Gym Tracker System Using AI- Driven Pose Estimation,” Journal of Artificial Intelligence and Data Science, 2025.
[4] V. Bazarevsky et al., “BlazePose: On-Device Real- Time Body Pose Tracking,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020, pp. 1–6.
[5] Y. Kwon and D. Kim, “Real-Time Workout Posture Correction Using MediaPipe,” IEEE Access, vol. 10, pp. 112345–112356, 2022.
[6] H. P. Chaudhari, “Virtual Fitness Trainer Using Artificial Intelligence,” International Journal of Computer Applications (IJCA), vol. 186, no. 12, pp. 45–50, 2024.
[7] C. Lugaresi et al., “MediaPipe: A Framework for Building Perception Pipelines,” Google Research, 2019.