More Web Proxy on the site http://driver.im/

research-article

Be your own cameraman: real-time support for zooming and panning into stored and live panoramic video

Authors:

Vamsidhar Reddy Gaddam,

Ragnar Langseth,

Håkon Kvale Stensland,

Pierre Gurdjos,

Vincent Charvillat,

Carsten Griwodz,

Pål HalvorsenAuthors Info & Claims

MMSys '14: Proceedings of the 5th ACM Multimedia Systems Conference

Pages 168 - 171

https://doi.org/10.1145/2557642.2579370

Published: 19 March 2014 Publication History

Abstract

High-resolution panoramic video with a wide field-of-view is popular in many contexts. However, in many examples, like surveillance and sports, it is often desirable to zoom and pan into the generated video. A challenge in this respect is real-time support, but in this demo, we present an end-to-end real-time panorama system with interactive zoom and panning. Our system installed at Alfheim stadium, a Norwegian premier league soccer team, generates a cylindrical panorama from five 2K cameras live where the perspective is corrected in real-time when presented to the client. This gives a better and more natural zoom compared to existing systems using perspective panoramas and zoom operations using plain crop. Our experimental results indicate that virtual views can be generated far below the frame-rate threshold, i.e., on a GPU, the processing requirement per frame is about 10 milliseconds.

The proposed demo lets participants interactively zoom and pan into stored panorama videos generated at Alfheim stadium and from a live 2-camera array on-site.

References

[1]

Azure-0814m5m. http://www.azurephotonicsus.com/products/azure-0814M5M.html.

[2]

Basler aca2000-50gc. http://www.basierweb.com/products/ace.html?model=173.

[3]

SmoothHD. http://www.smoothhd.com, 2009.

[4]

Sports & Entertainment - Cisco Connected Stadium, 2013. http://www.cisco.com/web/strategy/sports/index.html.

[5]

Y. Ariki, S. Kubota, and M. Kumano. Automatic production system of soccer sports video by digital camera work based on situation recognition. In Proc. of ISM, pages 851--860, 2006.

Digital Library

[6]

P. Carr and R. Hartley. Portable multi-megapixel camera with real-time recording and playback. In Proc. of DICTA, pages 74--80, 2009.

Digital Library

[7]

P. Carr, M. Mistry, and I. Matthews. Hybrid robotic/virtual pan-tilt-zom cameras for autonomous event recording. In Proc. of ACM MM, pages 193--202, 2013.

Digital Library

[8]

V. R. Gaddam, R. Langseth, S. Ljødal, P. Gurdjos, V. Charvillat, C. Griwodz, and P. Halvorsen. Interactive zoom and panning from live panoramic video. In Proc. of ACM NOSSDAV, Mar. 2014.

Digital Library

[9]

R. Guntur and W. T. Ooi. On tile assignment for region-of-interest video streaming in a wireless Ian. In Proc. of NOSSDAV, pages 59--64, 2012.

Digital Library

[10]

P. Halvorsen, S. Sasgrov, A. Mortensen, D. K. Kristensen, A. Eichhorn, M. Stenhaug, S. Dahl, H. K. Stensland, V. R. Gaddam, C. Griwodz, and D. Johansen. Bagadus: An integrated system for arena sports analytics -- a soccer case study. In Proc. of ACM MMSys, pages 48--59, Mar. 2013.

Digital Library

[11]

A. Mavlankar and B. Girod. Video streaming with interactive pan/tilt/zoom. In M. Mrak, M. Grgic, and M. Kunt, editors, High-Quality Visual Experience, Signals and Communication Technology, pages 431--455. Springer Berlin Heidelberg, 2010.

[12]

S. A. Pettersen, D. Johansen, H. Johansen, V. Berg-Johansen, V. R. Gaddam, A. Mortensen, R. Langseth, C. Griwodz, H. K. Stensland, and P. Halvorsen. Soccer video and player position dataset. In Proc. of ACM MMSYS, Mar. 2014.

Digital Library

[13]

R. Pantos (ed). HTTP Live Streaming. http://www.ietf.org/internet-drafts/draft-pantos-http-live-streaming-10.txt, 2013.

[14]

H. K. Stensland, V. R. Gaddam, M. Tennøe, E. Helgedagsrud, M. Næss, H. K. Alstad, A. Mortensen, R. Langseth, S. Ljødal, O. Landsverk, C. Griwodz, P. Halvorsen, M. Stenhaug, and D. Johansen. Bagadus: An integrated real-time system for soccer analytics. ACM Trans. Multimedia Comput. Commun. Appl. (TOMCCAP), 10(1s):14:1--14:21, Jan. 2014.

Digital Library

[15]

X. Sun, J. Foote, D. Kimber, and B. Manjunath. Region of interest extraction and virtual camera control based on panoramic video capturing. IEEE Transactions on Multimedia, 7(5):981--990, 2005.

Digital Library

[16]

M. Tennøe, E. Helgedagsrud, M. Næss, H. K. Alstad, H. K. Stensland, V. R. Gaddam, D. Johansen, C. Griwodz, and P. Halvorsen. Efficient implementation and processing of a real-time panorama video pipeline. In Proc. of IEEE ISM, Dec. 2013.

Digital Library

[17]

J. Wang, C. Xu, E. Chng, K. Wah, and Q. Tian. Automatic replay generation for soccer video broadcasting. In Proc. of ACM MM, pages 32--39, 2004.

Digital Library

[18]

M. Wieland, R. Steinmetz, and P. Sander. Remote camera control in a distributed multimedia system. In B. Wolfinger, editor, Innovationen bei Rechen- und Kommunikationssystemen, Informatik aktuell, pages 174--181. Springer Berlin Heidelberg, 1994.

Cited By

Sayed MCinca RCostanza EBrostow G(2022)LookOut! Interactive Camera Gimbal Controller for Filming Long TakesACM Transactions on Graphics10.1145/350669341:3(1-16)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.1145/3506693
Carrillo HQuiroga JZapata LMaldonado E(2022)Automatic football video production system with edge processingMachine Vision and Applications10.1007/s00138-022-01283-033:2Online publication date: 21-Feb-2022
https://doi.org/10.1007/s00138-022-01283-0
Chen JLu KTian SLittle J(2019)Learning Sports Camera Selection From Internet Videos2019 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV.2019.00184(1682-1691)Online publication date: Jan-2019
https://doi.org/10.1109/WACV.2019.00184
Show More Cited By

Index Terms

Be your own cameraman: real-time support for zooming and panning into stored and live panoramic video
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision

Recommendations

Interactive Zoom and Panning from Live Panoramic Video
NOSSDAV '14: Proceedings of Network and Operating System Support on Digital Audio and Video Workshop

Panorama video is becoming increasingly popular, and we present an end-to-end real-time system to interactively zoom and pan into high-resolution panoramic videos. Compared to existing systems using perspective panoramas with cropping, our approach ...
Automatic Real-Time Zooming and Panning on Salient Objects from a Panoramic Video
MM '14: Proceedings of the 22nd ACM international conference on Multimedia

The proposed demo shows how our system automatically zooms and pans into tracked objects in panorama videos. At the conference site, we will set up a two-camera version of the system, generating live panorama videos, where the system zooms and pans ...
Interactive Zoom and Panning from Live Panoramic Video
NOSSDAV '14: Proceedings of Network and Operating System Support on Digital Audio and Video Workshop

Panorama video is becoming increasingly popular, and we present an end-to-end real-time system to interactively zoom and pan into high-resolution panoramic videos. Compared to existing systems using perspective panoramas with cropping, our approach ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MMSys '14: Proceedings of the 5th ACM Multimedia Systems Conference

March 2014

323 pages

ISBN:9781450327053

DOI:10.1145/2557642

General Chair:
Roger Zimmermann
National University of Singapore, Singapore

Copyright © 2014 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 March 2014

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Norges Forskningsråd

Conference

MMSys '14

Sponsor:

MMSys '14: Multimedia Systems Conference 2014

March 19, 2014

Singapore, Singapore

Acceptance Rates

MMSys '14 Paper Acceptance Rate 15 of 57 submissions, 26%;

Overall Acceptance Rate 176 of 530 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
199
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sayed MCinca RCostanza EBrostow G(2022)LookOut! Interactive Camera Gimbal Controller for Filming Long TakesACM Transactions on Graphics10.1145/350669341:3(1-16)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.1145/3506693
Carrillo HQuiroga JZapata LMaldonado E(2022)Automatic football video production system with edge processingMachine Vision and Applications10.1007/s00138-022-01283-033:2Online publication date: 21-Feb-2022
https://doi.org/10.1007/s00138-022-01283-0
Chen JLu KTian SLittle J(2019)Learning Sports Camera Selection From Internet Videos2019 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV.2019.00184(1682-1691)Online publication date: Jan-2019
https://doi.org/10.1109/WACV.2019.00184
Zink MSitaraman RNahrstedt K(2019)Scalable 360° Video Stream Delivery: Challenges, Solutions, and OpportunitiesProceedings of the IEEE10.1109/JPROC.2019.2894817107:4(639-650)Online publication date: Apr-2019
https://doi.org/10.1109/JPROC.2019.2894817
Chen JMeng LLittle J(2018)Camera Selection for Broadcasting Soccer Games2018 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV.2018.00053(427-435)Online publication date: Mar-2018
https://doi.org/10.1109/WACV.2018.00053
Sánchez De La Fuente YSkupin RSchierl T(2017)Video processing for panoramic streaming using HEVC and its scalable extensionsMultimedia Tools and Applications10.1007/s11042-016-4097-476:4(5631-5659)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1007/s11042-016-4097-4
Passmore PGlancy MPhilpot ARoscoe AWood AFields BCruz-Neira CKiyokawa KReiners DIwai DSteinicke F(2016)Effects of viewing condition on user experience of panoramic videoProceedings of the 26th International Conference on Artificial Reality and Telexistence and the 21st Eurographics Symposium on Virtual Environments10.5555/3061323.3061326(9-16)Online publication date: 7-Oct-2016
https://dl.acm.org/doi/10.5555/3061323.3061326
TOUIL LKECHICHE LOUNI B(2016)Design of low power system on programmable chip for video zoom-in processingTURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES10.3906/elk-1408-8424(3405-3418)Online publication date: 2016
https://doi.org/10.3906/elk-1408-84
Matsumoto SYoshihisa TKawakami TIshi YTeranishi Y(2016)A Distributed Video Processing System for Internet Live Broadcasting Services2016 19th International Conference on Network-Based Information Systems (NBiS)10.1109/NBiS.2016.28(311-316)Online publication date: Sep-2016
https://doi.org/10.1109/NBiS.2016.28
Kawakami TIshi YMatsumoto SYoshihisa TTeranishi Y(2016)A Design of a Video Effect Process Allocation Scheme for Internet Live BroadcastingAdvances on P2P, Parallel, Grid, Cloud and Internet Computing10.1007/978-3-319-49109-7_59(619-628)Online publication date: 22-Oct-2016
https://doi.org/10.1007/978-3-319-49109-7_59
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents