Research Videos
An Immersive Virtual Reality Learning System with an LLM-Integrated Conversational Avatar for Real-Time Educational Assistance
This project develops an immersive VR learning system integrated with an LLM-powered conversational avatar for real-time educational assistance. The system enables in-environment question answering within a virtual classroom, addressing the lack of open-ended interaction in existing VR tools. A Unity-based prototype with a local LLM was evaluated through case studies and baseline comparison with a PC-based AI system.
Real-Time Object Detection for Mixed Reality on Meta Quest 3S Using AI Building Blocks
This research project focuses on the development and deployment of a real-time object detection system for Mixed Reality (MR) and Virtual Reality (VR) environments using the Meta Quest 3S platform. Leveraging the newly released AI Building Blocks provided in Meta SDK v83+ and the Meta XR MR Utility Kit v83+.
Augmented reality assisted smart factory management system development
An AR headset-based prototyping system has been developed to offer a clear and intuitive digital visualization for the purpose of exploring the potential applications of smart factories. This project presents a case study of a maintenance application in a CNC machine shop for technicians.
Augmented reality assisted maintenance and repair system development
This project demonstrates the potential of utilizing digital twin technology with an Augmented Reality interface for improved maintenance procedures. By presenting a demo system of a repair process, this work aims to highlight the benefits of using AR for clear and intuitive visualization of the device being repaired, resulting in improved accuracy and ease of instruction for technicians.
System design of a human-centered AR HRI with cognition awareness
This work proposed a novel system, HAR2bot, for path planning tasks in complex environments. The proposed system effectively balances the communication between the operator and the robot to minimize the cognitive burden associated with the design loop, leading to improved task efficiency and accuracy.
Augmented reality-based human-robot interaction system
This project proposed and developed an intuitive and immersive AR-based interface for cobot (AUBO i5) programming, aiming to address the challenges in performing path planning tasks in complex environments.