ESC

Research

All keywords
Adaptive Interfaces
Augmented Reality
Calibration
Cognition Awareness
Cognitive Load Theory
Digital Twin
Embodied Interaction
Errors
Head-Mounted Displays
Human Computer Interaction
Human-Robot Interaction
Learning Science
Meta Quest 3S
Mixed Reality
Motion Capture
Object Detection
Robot Programming
Robotics
Robots
Smart Factory
Spatial Perception
Teleoperation
Unity
User Interface
All years
2026
2022
2021
2019

Real-Time Object Detection for Mixed Reality on Meta Quest 3S Using AI Building Blocks

Real-Time Object Detection for Mixed Reality on Meta Quest 3S Using AI Building Blocks

2026-3 – 2026-4

Augmented RealityMixed RealityObject DetectionUnityMeta Quest 3S

This research project focuses on the development and deployment of a real-time object detection system for Mixed Reality (MR) and Virtual Reality (VR) environments using the Meta Quest 3S platform. Leveraging the newly released AI Building Blocks provided in Meta SDK v83+ and the Meta XR MR Utility Kit v83+.

MOTION: AI-Driven Biomechanical Motion Capture for Augmented Reality Rehabilitation

MOTION: AI-Driven Biomechanical Motion Capture for Augmented Reality Rehabilitation

2026-2 – 2026-3

Mixed RealityMotion CaptureEmbodied InteractionAdaptive Interfaces

MOTION is an AI-powered AR rehabilitation system that uses real-time biomechanical motion capture and adaptive feedback to improve movement accuracy and engagement. By combining body tracking, gamified interaction, and remote clinician support, the platform enables accessible and personalized rehabilitation in XR environments.

Seeing Isn't Believing: The Vertical-Horizontal Illusion Across Screens and XR Headsets

Seeing Isn’t Believing: The Vertical-Horizontal Illusion Across Screens and XR Headsets

2026-2 – 2026-3

Mixed RealityHead-Mounted DisplaysHuman Computer InteractionSpatial Perception

The Vertical-Horizontal Illusion (VHI) biases perceived geometric proportions across visual displays. This study introduces the Square Recognition Test (SRT), a unified method to measure perceived squareness across devices. A within-subject study (N = 24) on PC, mobile, and AR HMDs shows a consistent bias toward slightly wider-than-tall rectangles (PSE ≈ 1.02-1.04), indicating device-invariant VHI effects.

A global calibration to solve the misregistration problems in VST AR system

A global calibration to solve the misregistration problems in VST AR system

2021-10 – 2023-2

Augmented RealityCalibrationErrorsRobots

The purpose of this study is to introduce a calibration method for the registration problem in a video seethrough Augmented Reality (AR) system. This study investigates error sources and presents an efficient calibration procedure to reduce the misalignment accuracy via HMD-to-Camera transformation.

A Tele-robot System with Mixed-Reality Interaction

A Tele-robot System with Mixed-Reality Interaction

2022-6 – 2022-9

Augmented RealityTeleoperationUser InterfaceRobotics

This study describes the development of a tele-robot control system that utilizes a Mixed Reality headset, (HoloLens 2), to remotely control Automated Guided Vehicles (Rover Pro). The system features a user-friendly interface that offers three control methods: motion control, physical button control, and virtual button control.

Augmented reality assisted smart factory management system development

Augmented reality assisted smart factory management system development

2021-12 – 2022-2

Augmented RealitySmart FactoryDigital Twin

An AR headset-based prototyping system has been developed to offer a clear and intuitive digital visualization for the purpose of exploring the potential applications of smart factories. This project presents a case study of a maintenance application in a CNC machine shop for technicians.

Augmented reality assisted maintenance and repair system development

Augmented reality assisted maintenance and repair system development

2021-12 – 2022-2

Augmented Reality

This project demonstrates the potential of utilizing digital twin technology with an Augmented Reality interface for improved maintenance procedures. By presenting a demo system of a repair process, this work aims to highlight the benefits of using AR for clear and intuitive visualization of the device being repaired, resulting in improved accuracy and ease of instruction for technicians.

An application of depth map completion and super-resolution in AR rendering

An application of depth map completion and super-resolution in AR rendering

2021-9 – 2021-11

Augmented Reality

This project presents an experiment on an AR-based human-robot interaction scenario, aimed at demonstrating the effectiveness of a proposed method for addressing occlusion problems in the rendering of virtual objects. The method involves the use of depth completion and super-resolution techniques to enhance the visual quality.

Visualization error analysis for augmented reality stereo VST system

Visualization error analysis for augmented reality stereo VST system

2021-5 – 2021-11

Augmented Reality

In this research study, the sources of registration errors were identified in stereo video see-through systems and a mathematical model was established to describe the propagation of these errors in the display process.

System design of a human-centered AR HRI with cognition awareness

System design of a human-centered AR HRI with cognition awareness

2019-11 – 2021-10

Human-Robot InteractionAugmented RealityCognition AwarenessCognitive Load TheoryLearning Science

This work proposed a novel system, HAR2bot, for path planning tasks in complex environments. The proposed system effectively balances the communication between the operator and the robot to minimize the cognitive burden associated with the design loop, leading to improved task efficiency and accuracy.

Augmented reality-based human-robot interaction system

Augmented reality-based human-robot interaction system

2019-08 – 2020-11

Human-Robot InteractionAugmented RealityRobot Programming

This project proposed and developed an intuitive and immersive AR-based interface for cobot (AUBO i5) programming, aiming to address the challenges in performing path planning tasks in complex environments.