abstract

ChicMR: immersive mixed reality system using video-see-thru HMD and 3D LiDAR scanner

Authors:

Bum-Jae YouAuthors Info & Claims

SIGGRAPH '19: ACM SIGGRAPH 2019 Emerging Technologies

Article No.: 9, Pages 1 - 2

https://doi.org/10.1145/3305367.3327990

Published: 28 July 2019 Publication History

Get Access

Abstract

In this paper, we propose a mixed-reality system that provides an immersive interaction space for both real and virtual objects. Using a custom-made video-see-thru (VST) HMD, the system streams high-resolution stereo images of what the user is currently looking at. Also, the proposed system includes a rotating 2D LiDAR that configures a geometry of the user's surrounding space. Based on the triangle mesh approach, the proposed system creates an interaction space from the point cloud data. With the constructed interaction space, the user experiences various interactions using both real and virtual objects in the mixed-reality environment. We demonstrate the feasibility and effectiveness of our system with a real-time application.

Supplementary Material

MP4 File (a9-hwang.mp4)

Download
106.94 MB

MP4 File (expp_141.mp4)

Download
201.50 MB

References

[1]

ChangHyun Jim, Jihwan Youn, Jongmoo Choi, Gerard Medioni, and Nakju Lett Doh. 2015. Convex Cut: A realtime pseudo-structure extraction algorithm for 3D point cloud data. In 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 3922--3929.

Google Scholar

[2]

Hyukmin Kwon, Mincheol Kim, Juseong Lee, Jinbaek Kim, Nakju Lett Doh, and Bum-Jae You. 2018. Robust Plane Extraction using Supplementary Expansion for Low-Density Point Cloud Data. In 2018 15th International Conference on Ubiquitous Robots (UR). IEEE, 501--505.

Crossref

Google Scholar

[3]

Jorge J Moré. 1978. The Levenberg-Marquardt algorithm: implementation and theory. In Numerical analysis. Springer, 105--116.

Google Scholar

Cited By

View all

Li KSchmidt SBacher RLeemans WSteinicke F(2022)Mixed Reality Tunneling Effects for Stereoscopic Untethered Video-See-Through Head-Mounted Displays2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00018(44-53)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00018

Index Terms

ChicMR: immersive mixed reality system using video-see-thru HMD and 3D LiDAR scanner
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Garden is a Mixed Reality (MR) experience that combines both Virtual Reality (VR) and Augmented Reality (AR), and lets players transform their environment into a virtual garden they can play in. This is done by doing both stereoscopic rendering and 3D ...
Visualizing the keyboard in virtual reality for enhancing immersive experience
SIGGRAPH '17: ACM SIGGRAPH 2017 Posters

Recently, virtual reality (VR) becomes more and more popular and provides users an immersive experience with a head-mounted display (HMD). However, in some applications, users have to interact with physical objects while immersed in VR. With a non-see-...
Through Tinted Eyeglasses

EIC Roy Want introduces the special issue on cross-reality environments and discusses alternate realities including virtual reality, augmented reality, embodied virtuality, cross-reality, and mixed reality.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SIGGRAPH '19: ACM SIGGRAPH 2019 Emerging Technologies

July 2019

54 pages

ISBN:9781450363082

DOI:10.1145/3305367

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 July 2019

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

National Research Foundation of Korea

Conference

SIGGRAPH '19

Sponsor:

SIGGRAPH

SIGGRAPH '19: Special Interest Group on Computer Graphics and Interactive Techniques Conference

July 28, 2019

California, Los Angeles

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
274
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Li KSchmidt SBacher RLeemans WSteinicke F(2022)Mixed Reality Tunneling Effects for Stereoscopic Untethered Video-See-Through Head-Mounted Displays2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00018(44-53)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00018

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

Supplementary Material

References

Cited By

Index Terms

Recommendations

Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction

Visualizing the keyboard in virtual reality for enhancing immersive experience

Through Tinted Eyeglasses

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations