Immersive AR-Based Learning for Computer Science

Abstract

Understanding complex and abstract concepts in Computer Science can be challenging through traditional learning methods that rely mainly on textbooks, static diagrams, and lectures. CodeAR is an innovative Augmented Reality (AR)-based educational tool designed to transform the way Computer Science and Engineering students perceive and interact with theoretical concepts. It bridges the gap between abstract knowledge and tangible understanding by transforming classroom topics into interactive 3D visualizations. By simply scanning a keyword, QR code, or image marker related to a computer science topic, the system dynamically generates and displays a 3D diagram or model in the user’s real-world environment. Each visualization is supported by synchronized voice narration and textual explanations, allowing students to both see and hear how different systems or algorithms function. This immersive, multi-sensory learning experience significantly enhances conceptual clarity, spatial awareness, and student engagement, making learning more enjoyable and effective. CodeAR supports a diverse range of computer science domains, including Data Structures, Operating Systems, Computer Networks, Compiler Design, and Database Systems Moreover, its cross-platform compatibility enables seamless use across Android, iOS, and WebAR environments, ensuring accessibility for students and institutions without requiring expensive hardware like AR headsets. Technologically, CodeAR is powered by frameworks such as ARCore and Unity, ensuring accurate motion tracking, stable rendering, and real-time responsiveness.

Introduction

The rapid advancement of educational technology has positioned Augmented Reality (AR) as a powerful tool for enhancing learning, particularly in Computer Science and Engineering. Traditional teaching methods—such as lectures, textbooks, and 2D diagrams—often fail to effectively convey abstract or complex concepts like data structures, algorithms, operating systems, networking, and compiler design. This gap inspired the development of CodeAR, an AR-based interactive learning platform designed to transform theoretical computer science topics into immersive 3D visualizations.

Overview of CodeAR

CodeAR allows learners to scan a marker, QR code, or keyword using a mobile device, triggering dynamic 3D models that appear in their physical environment. These models are supported by voice narration and textual explanations, creating a multisensory, interactive learning experience. Students can rotate, zoom, manipulate, and explore structures such as trees, stacks, CPU schedulers, network topologies, and database processes—making abstract systems tangible and easier to understand.

The platform is built using Unity, Vuforia, ARCore, and Blender, ensuring smooth performance on smartphones without requiring costly AR headsets. Its modular architecture enables educators to easily add new models and update content, making it scalable, adaptable, and accessible to institutions with limited resources.

Educational Benefits

CodeAR enhances:

• conceptual clarity through spatial visualization,

• engagement through interactive exploration,

• retention through multisensory learning,

• accessibility through mobile-based AR, and

• adaptability for self-learning, virtual labs, and remote education.

Objectives

The primary objective of CodeAR is to bridge the gap between theoretical learning and practical understanding by:

• visualizing internal operations of algorithms and systems,

• encouraging active, experiential learning,

• enabling self-paced, affordable, and scalable AR-based education, and

• making complex concepts intuitive for CSE students.

Literature Review

Key literature supports CodeAR’s approach:

• Foundational AR works (Billinghurst et al., Craig, Schmalstieg & Hollerer) explain AR concepts, technologies, and application potential.

• Milgram & Kishino introduce the Reality–Virtuality Continuum, a core AR framework.

• Unity-Vuforia development guides demonstrate practical AR implementation.

• Research studies highlight AR’s role in improving student motivation, engagement, and performance.

• Engineering education studies show AR’s effectiveness in bridging the gap between theoretical and practical understanding.

• The CodeAR internal report (2025) outlines the system’s design and educational value.

System Analysis

Existing systems rely on static, non-interactive teaching methods, lack immersive visualization, provide no real-time feedback, and often depend on costly hardware. This limits comprehension and causes students to rely on memorization rather than understanding.

Proposed System (CodeAR) introduces interactive AR-based 3D models, cross-platform functionality, cost-effectiveness, high scalability, and user-friendly interfaces that enhance learning outcomes and instructor flexibility.

Problem–Solution Fit

CodeAR directly addresses the conceptual challenges in understanding abstract CS concepts by providing real-time, manipulable 3D models. Its target users—students, educators, and academic institutions—benefit from its interactive design, accessible mobile interface, and alignment with modern digital learning demands.

References

[1] Billinghurst, M., Clark, A., & Lee, G. (2015). A Survey of Augmented Reality. Foundations and Trends® in Human–Computer Interaction. [2] Craig, A. B. (2013). Understanding Augmented Reality: Concepts and Applications. Morgan Kaufmann Publishers. [3] Schmalstieg, D., & Hollerer, T. (2016). Augmented Reality: Principles and Practice. Addison-Wesley Professional. [4] Milgram, P., & Kishino, F. (1994). A Taxonomy of Mixed Reality Visual Displays. IEICE Transactions on Information and Systems, E77-D(12), 1321–1329. [5] Unity Learn. Developing Augmented Reality Apps with Unity and Vuforia. Retrieved from https://learn.unity.com [6] Zhou, F., Duh, H. B. L., & Billinghurst, M. (2008). Trends in Augmented Reality Tracking, Interaction and Display: A Review of Ten Years of ISMAR. Proceedings of ISMAR 2008. [7] IEEE Xplore Digital Library. AR in Education and Learning Technologies. Retrieved from https://ieeexplore.ieee.org [8] ResearchGate. Applications of Augmented Reality in Engineering Education. Retrieved from https://www.researchgate.net [9] Make Cloude Team. CodeAR – AR-Based Learning System Documentation. Internal Project Report, 2025. [10] Chen, C.-M., & Tsai, Y.-N. (2020). Interactive augmented reality system for enhancing learning motivation and performance in science education. Educational Technology & Society, 23(1), 45–58.

Copyright

Copyright © 2025 Jeevan Kishore B, Karthikeyan M, Nithishkumar M, Mrs. D. M. Vijayalakshmi. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.