XRAI Lab
About XRAI Lab
The Extended Reality, Artificial Intelligence, and Robotics (XRAI) Lab aims to advance the seamless integration of Extended Reality (XR), Artificial Intelligence (AI), and Robotics to create intelligent, interactive, and adaptive systems. Our research focuses on next-generation technologies that seamlessly bridge the physical and virtual worlds, enabling intuitive human–machine interaction, augmenting human capabilities, and supporting collaborative autonomy.
Through interdisciplinary innovation, the XRAI Lab redefines how intelligent systems are designed, experienced, and deployed across real-world applications, including advanced manufacturing, engineering education, and human-centered automation.
Research Focus
Human-Centered XR & AI
Studying how people perceive and interact within XR environments to design intuitive, cognitively-aware, AI-enhanced interfaces.
- Human-Centered AR HRI with Cognition Awareness
- Vertical-Horizontal Illusion Across Screens and XR Headsets
- Real-Time Object Detection for MR on Meta Quest 3S
Immersive Learning & Workforce Training
Designing and evaluating XR-based systems that accelerate skill acquisition, knowledge transfer, and workforce readiness across education and professional domains.
- VR Learning System with LLM-Powered Conversational Avatar
- MR Training for First Responders in Hurricane Scenarios
- AR Educational App for Newton's Cradle Physics
XR-Mediated Human-Robot Collaboration
Developing XR interfaces that enable natural, safe, and efficient communication between humans and robotic systems in complex real-world environments.
- AR-Based Human-Robot Interaction System
- Tele-Robot System with Mixed-Reality Interaction
- Human-Centered AR HRI with Cognition Awareness
Digital Twin & Intelligent Manufacturing
Integrating digital twin and AR technologies to build data-driven manufacturing environments with intelligent visualization, monitoring, and maintenance workflows.
- AR-Assisted Maintenance and Repair System
- AR Smart Factory Management System
- Global Calibration for VST AR Misregistration
Adaptive & Intelligent XR Systems
Building AI-driven XR pipelines that sense user context, adapt in real time, and deliver personalized interaction across rehabilitation, training, and industrial settings.
- MOTION: AI-Driven Motion Capture for AR Rehabilitation
- VR Learning System with LLM-Powered Conversational Avatar
- Real-Time Object Detection for MR on Meta Quest 3S
Recent Research
An Immersive Virtual Reality Learning System with an LLM-Integrated Conversational Avatar for Real-Time Educational Assistance
This project develops an immersive VR learning system integrated with an LLM-powered conversational avatar for real-time educational assistance. The system enables in-environment question answering within a virtual classroom, addressing the lack of open-ended interaction in existing VR tools. A Unity-based prototype with a local LLM was evaluated through case studies and baseline comparison with a PC-based AI system.
Equipment
Collaborative Robot
Universal Robots UR10e
A 6-DOF collaborative robot arm with 12.5 kg payload and 1300 mm reach. Equipped with a Robotiq Wrist Camera, a Robotiq 2F gripper, a Robotiq AirPick vacuum gripper, and a Robotiq Screwdriving Solution for automated fastening and assembly. A conveyor system is integrated to enable continuous material flow and support experiments in automated production and logistics.
Collaborative Robot
UFactory Xarm 6
A lightweight 6-DOF collaborative robot with a 5 kg payload and 700 mm reach. The system is equipped with an xArm two-finger gripper for adaptable and precise object handling and an Orbbec Gemini 335 depth camera for object detection, depth sensing, and vision-guided manipulation. This platform supports research in human-centered robotics, perception-driven manipulation, and immersive human-robot interaction.
XR station
Virtualis Motion VR Station
An advanced balance assessment and rehabilitation platform that integrates a 360-degree dynamic force plate with immersive virtual reality. The system enables precise evaluation of human balance and postural control through Computerized Dynamic Posturography (CDP), including standardized tests such as Sensory Organization Test (SOT), Limits of Stability (LoS), and Adaptation Tests.
Mobile Manipulator
Clearpath Husky with Robot Arm
A rugged, all-terrain unmanned ground vehicle (UGV) designed for autonomous mobile robotics research. Integrated with a robotic arm, the platform enables mobile manipulation capabilities for tasks that combine navigation and object interaction in complex environments.
XR Headset
Varjo VR-3
High-fidelity VR headset designed for ultra-high-fidelity immersive experiences. Featuring human-eye resolution and precise integrated eye tracking, it enables highly realistic rendering and detailed user behavior analysis.
XR Headset
Meta Quest 3 & 3s
The Meta Quest 3 and Quest 3S are standalone mixed reality headsets that support both fully immersive VR and passthrough-based AR experiences. With inside-out tracking and wireless operation, they provide a flexible and accessible platform for developing and deploying interactive XR applications.