Tangible Holographic 3D Objects with Virtual Touch

This poster describes the design of a display and interaction device that allows a natural mid-air manipulation and feedback of floating, true 3D objects. This so called virtual touch will create a natural feeling of manipulating and touching of the virtual 3D object for the user. The 3D display system allows users to reach into the viewing volume to touch virtual objects, and even feel gradients of haptic feedback as the hands penetrate into virtual objects. True 3D objects are dynamically relit according to the real-world environment captured by cameras, which is reflected on shiny virtual surfaces to reach more realistic user experience. On the other hand, 3D virtual objects can cast real shadows on the real workspace. In case the virtual objects are defined as light-emitting, glows can also be projected onto the desk and the real objects. These techniques together form the basis of an ultra-realistic visualization and interaction system that will find its way into many technical and educational uses.