Vision-Enabled SAR for Manual Assembly

Developing a computer vision-enabled Spatial Augmented Reality framework towards human-centric smart assembly.

Overview

This project develops a human-centric Spatial Augmented Reality (SAR) system that projects adaptive, light-guided assembly instructions directly onto the workspace and is controlled through AI-based hand gesture recognition. The system delivers real-time guidance and error feedback without requiring handheld or wearable devices. User studies show significant reductions in task time, error rates, and perceived workload compared to conventional instruction methods.

Motivation

This project addresses limitations of conventional assembly instructions that rely on static manuals or wearable devices. By projecting guidance directly onto the workspace, SAR reduces cognitive load and improves task flow.

System Architecture

The system integrates computer vision, gesture recognition, and spatial projection to deliver adaptive assembly instructions in real time.

Key Components

Evaluation

User studies compared SAR guidance with conventional instructions. Participants showed reduced completion time and fewer errors.

Key Findings

Faster task completion
Lower error rate
Reduced perceived workload

Naimul Hasan

PhD Student

My research interests include smart assembly system, Industry 5.0.

Louie Webb

PhD Student

My research interests include distributed robotics, mobile computing and programmable matter.

Malarvizhi Kaniappan Chinnathai

Lecturer in Modelling of Discrete Event Processes

My research interests include development and application of discrete event simulation for decision support in manufacturing scale-up, operations research, electric vehicle (EV) assembly, process planning, and intelligent logistics for manufacturing systems.

Bugra Alkan

Senior Lecturer in AI and Robotics