Selected Readings in Vision and Graphics
edited by Luc Van Gool, Gábor Székely, Markus Gross, Bernt Schiele

Volume 68

Benjamin Knörlein

Exploring Visuo-Haptic
Augmented Reality for Training

2011. XVI, 180 pages. EUR 64,00

ISBN 978-3-86628-403-6


Computer based training has been intensively studied in the last decades and its application in different domains became highly popular. Current systems, however, only provide a fully simulated environment in which the training takes place. Their application is therefore limited by the complexity of the simulated scene or by the capability of the underlying hardware.

A concept which can be used to alleviate these problems is augmented reality (AR). Here, a computer generated environment is combined with the real one. While the definition of AR includes augmentation of several modalities, the term still mainly refers to a mere visual augmentation. A visuo-haptic augmented reality therefore extends the basic concept by providing additional haptic sensations from the virtual environment to the user. This allows a user to not only see the virtual world, but in addition to touch it, making more natural interactions possible.

In this thesis we investigated visuo-haptic AR and its feasibility to be used in training frameworks. We focused on the fidelity of the AR illusion and the performed research can be divided into different branches: The visuo-haptic augmented reality system itself, the perception within the environment, and the application in different demonstrator systems.

Main contributions are the accurate calibration of the haptic interface, the development of a flexible distributed visuo-haptic AR framework, the improvement of visual depth perception by incorporating dynamic shadows and correct handling of occlusions, and an investigation of visuo-haptic perception of compliant objects in AR systems.

About the author:

Benjamin Knoerlein studied computational visualistics at the University of Koblenz-Landau, Koblenz, Germany, in 2005. From 2005-2010, he was research assistant and Ph.D. student at the Computer Vision Laboratory at ETH Zurich, with Prof. Dr. Gábor Székely. He received his Ph.D. in Computer Science (Dr. sc. ETH Zurich) from ETH Zurich for his work on visuo-haptic Augmented Reality for training.

Keywords: Augmented Reality, Visuo-Haptic Feedback, Haptic Interfaces, Calibration, Registration, Delays, Visual Perception, computer-based Training

Reihe " Selected Readings in Vision and Graphics " im Hartung-Gorre Verlag

Direkt bestellen bei / to order directly from:

Hartung-Gorre Verlag / D-78465 Konstanz / Germany

Telefon: +49 (0) 7533 97227 Telefax: +49 (0) 7533 97228