More Web Proxy on the site http://driver.im/

research-article

Free access

M-TEEVE: real-time 3D video interaction and broadcasting framework for mobile devices

Authors:

Klara Nahrstedt,

Roy H. CampbellAuthors Info & Claims

IMMERSCOM '09: Proceedings of the 2nd International Conference on Immersive Telecommunications

Article No.: 19, Pages 1 - 6

Published: 27 May 2009 Publication History

Abstract

3D video is an emerging technology that promises immersive experiences in a truly seamless environment. In this paper, we present a new proxy-based framework to extend the 3D video experience to mobile devices. The framework has two major features. First, it allows audience to use mobile devices to change rendering viewpoints and interact with 3D video, and it supports different interaction devices to collaborate with each other. Second, the proxy compresses the 3D video streams before broadcasting to mobile devices for display. A novel view-dependent real-time 3D video compression scheme is implemented to reduce the requirements of both transmission bandwidth and rendering computation on mobile devices. The system is implemented on different mobile platforms and our experiments indicate a promising future of 3D video on mobile devices.

References

[1]

Bumblebee 2 camera. http://www.ptgrey.com/products/bumblebee2/index.asp.

[2]

id software: Quake. http://www.idsoftware.com/games/quake/quake/.

[3]

Immersive display solutions. http://www.immersivedisplayinc.com.

[4]

Open computer vision library. http://sourceforge.net/projects/opencvlibrary/.

[5]

Apple. iphone application programming guide. http://developer.apple.com/iphone/.

[6]

C. Cruz-Neira, D. Sandin, T. DeFanti, R. Kenyon, and J. Hart. The cave: Audio visual experience automatic virtual environment. Communications of the ACM, 35(6):65--72, June 1992.

Digital Library

[7]

S.-U. Kum and K. Mayer-Patel. Real-time multidepth stream compression. ACM Trans. on Multimedia Computing, Communications and Applications (TOMCCAP), 1(2):128--150, 2005.

Digital Library

[8]

J. Lee. Head tracking for desktop vr displays using wii remote. http://www.cs.cmu.edu/~johnny/projects/wii/.

[9]

J.-M. Lien, G. Kurillo, and R. Bajcsy. Skeleton-based data compression for multi-camera tele-immersion system. In Proc. of Advances in Visual Computing, Third International Symposium (ISVC'07), pages 714--723, November 2007.

Digital Library

[10]

B. D. Lucas and T. Kanade. An iterative image registration technique with an application to stereo vision.

[11]

S. K. Penta and P. J. Narayanan. Compression of multiple depth maps for ibr. The Visual Computer, 21(8--10):611--618, 2005.

[12]

A. Redert and et al. Attest: Advanced three-dimensional television system technologies. In Proc. of 1st International Symposium on 3D Data Processing Visualization and Transmission (3DPVT'02), pages 313--319, June 2002.

[13]

S. Shi, K. Nahrstedt, and R. H. Campbell. View-dependent real-time 3d video compression for mobile devices. In Proc. of ACM International Conference on Multimedia (MM'08), Vancouver, BC, Canada, 2008.

Digital Library

[14]

M. Tamai, W. Wu, K. Nahrstedt, and K. Yasumoto. A view control interface for 3d tele-immersive environments. In Proc. of IEEE International Conference on Multimedia & Expo (ICME'08), Hannover, Germany, 2008.

[15]

Z. Yang and et al. Teeve: The next generation architecture for tele-immersive environments. In Proceedings of the 7th IEEE International Symposium on Multimedia (ISM'05), Irvine, CA, 2005.

Digital Library

[16]

Z. Yang and et al. Real-time 3d video compression for tele-immersive environments. In Proc. of SPIE/ACM Multimedia Computing and Networking (MMCN'06), 2006.

Cited By

Raghuraman SPrabhakaran BZhao QThalmann DWu ELin MWang L(2015)Distortion score based pose selection for 3D tele-immersionProceedings of the 21st ACM Symposium on Virtual Reality Software and Technology10.1145/2821592.2821600(227-236)Online publication date: 13-Nov-2015
https://dl.acm.org/doi/10.1145/2821592.2821600
Raghuraman SVenkatraman KWang ZPrabhakaran BGuo XJaimes ASebe NBoujemaa NGatica-Perez DShamma DWorring MZimmermann R(2013)A 3D tele-immersion streaming approach using skeleton-based predictionProceedings of the 21st ACM international conference on Multimedia10.1145/2502081.2502188(721-724)Online publication date: 21-Oct-2013
https://dl.acm.org/doi/10.1145/2502081.2502188
Milani SCalvagno G(2011)A cognitive approach for effective coding and transmission of 3D videoACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)10.1145/2037676.20376807S:1(1-21)Online publication date: 4-Nov-2011
https://dl.acm.org/doi/10.1145/2037676.2037680
Show More Cited By

Index Terms

M-TEEVE: real-time 3D video interaction and broadcasting framework for mobile devices

Recommendations

TEEVE-Remote: A Novel User-Interaction Solution for 3D Tele-immersive System
ISM '12: Proceedings of the 2012 IEEE International Symposium on Multimedia

3D Tele-immersion (3DTI) system enables geographically distributed users to interact with each other in the virtual 3D space. Many 3DTI applications require users to have frequent physical movement in the application (e.g, 3D interactive exergaming, ...
Contemporary Issues in Handheld Computing Research

Mobile phones have become ubiquitous in today's society. However, mobile users are no longer satisfied with simple phones but instead expect ever more powerful functions to be available from their mobile devices. Advanced phones known as smartphones ...
A physically-based client-server rendering solution for mobile devices
MUM '07: Proceedings of the 6th international conference on Mobile and ubiquitous multimedia

Mobile devices, also known as small-form-factor (SFF) devices such as mobile phones, PDAs and ultra mobile PCs have continued to grow in popularity. Improvements in SFF hardware has enabled a range of suitable applications such as gaming, interactive ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

IMMERSCOM '09: Proceedings of the 2nd International Conference on Immersive Telecommunications

May 2009

141 pages

ISBN:9789639799394

General Chairs:
Ruzena Bajcsy
University of California, Berkeley
,
Chuck House
Stanford University

Sponsors

ICST

Publisher

ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)

Brussels, Belgium

Publication History

Published: 27 May 2009

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
149
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)4

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Raghuraman SPrabhakaran BZhao QThalmann DWu ELin MWang L(2015)Distortion score based pose selection for 3D tele-immersionProceedings of the 21st ACM Symposium on Virtual Reality Software and Technology10.1145/2821592.2821600(227-236)Online publication date: 13-Nov-2015
https://dl.acm.org/doi/10.1145/2821592.2821600
Raghuraman SVenkatraman KWang ZPrabhakaran BGuo XJaimes ASebe NBoujemaa NGatica-Perez DShamma DWorring MZimmermann R(2013)A 3D tele-immersion streaming approach using skeleton-based predictionProceedings of the 21st ACM international conference on Multimedia10.1145/2502081.2502188(721-724)Online publication date: 21-Oct-2013
https://dl.acm.org/doi/10.1145/2502081.2502188
Milani SCalvagno G(2011)A cognitive approach for effective coding and transmission of 3D videoACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)10.1145/2037676.20376807S:1(1-21)Online publication date: 4-Nov-2011
https://dl.acm.org/doi/10.1145/2037676.2037680
Milani SCalvagno Gdel Bimbo AChang SSmeulders A(2010)A cognitive approach for effective coding and transmission of 3D videoProceedings of the 18th ACM international conference on Multimedia10.1145/1873951.1874009(581-590)Online publication date: 25-Oct-2010
https://dl.acm.org/doi/10.1145/1873951.1874009

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents