Search Results

Multimodal large language models have enabled a new generation of Conversational Agents (CA), leveraging language structure in human discourse to encode-decode multimedia formats (e.g., video-to-audio). These next-generation CAs can be useful in task ...

Instructive assistance systems are applied to assist users in performing a task by providing instructions. These systems are especially relevant for industrial workers and service technicians who must cope with the increasing task variety and complexity ...

It has been shown that the provision of a conversational user interface proves beneficial in many domains. But, there are still many challenges when applied in production areas, e.g. as part of a virtual assistant to support workers in knowledge-...

The use of Augmented Reality (AR) systems has been shown to be beneficial in guiding users through structured tasks when compared to traditional 2D instructions. In this work, we begin to examine the potential of such systems for home improvement tasks, ...

In this paper we describe and evaluate an assistive mixed reality system that aims to augment users in tasks by combining automated and unsupervised information collection with minimally invasive video guides. The result is a fully self-contained system ...

With increasing complexity of assembly tasks and an increasing number of product variants, instruction systems providing cognitive support at the workplace are becoming more important. Different instruction systems for the workplace provide instructions ...

Exciting developments in eye-wearable technology and its potential industrial applications warrant a thorough understanding of its advantages and drawbacks through empirical evidence. We conducted an experiment to investigate what characteristics of eye-...

The presented study is the starting point for a series of task guidance studies, which are dedicated to ease the working conditions for operators in the cleanroom of a semiconductor factory. We want to clarify the question how to best indicate the ...

We present a study that evaluates the effectiveness of augmenting on-screen instructions with micro-projection for manual task guidance unlike prior work, which replaced screen instructions with alternative modalities (e.g., head-mounted displays). In ...

Disorientation induced by G-forces during aerobatic flight generates difficulties for the pilots to perfectly align their aerobatic maneuver. This paper presents a modular wearable system for enhancing training of aerobatic pilots. A combination of ...

Solo is a cognitive assistive device which provides scheduling support and interactive task guidance. Solo includes user interfaces for the person with a disability and the caregiver, as well as a Cognition Manager which manages schedules and responds ...

This short paper outlines my position on a future direction for computational research on visual motion understanding. The direction combines motion perception, visual attention, action representation and computational vision. Due the breadth of ...

This paper describes a preliminary investigation of how the capabilities of wearable computers may be used to provide task guidance in mobile environments. Specifically, this study examined how the capabilities of wearable computers may be used to aid a ...