[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2659021.2659058acmconferencesArticle/Chapter ViewAbstractPublication PagesicdscConference Proceedingsconference-collections
tutorial

A Real Time 3D Sensor for Smart Cameras

Published: 04 November 2014 Publication History

Abstract

Thank to the widespread diffusion of RGBD sensing devices based on active technologies, in recent years, many research and industrial applications have taken advantage of reliable cues computed from dense depth data. However, although these sensors can be very effective in many circumstances, they are not always well suited for outdoor environments and can also interfere with each other when sensing the same area. On the other hand, traditional systems based on passive stereo vision technology, due to their computational/energy requirements, reliability, size, cost etc, have been, so far, mostly confined to research projects. Nevertheless, recent advances in computation architectures and algorithms enable to overcome most of these issues and, in this paper, we describe the architecture and the processing pipeline of an effective RGBD sensor based on stereo vision suited for real time applications. This sensor allows us to infer, in indoor and outdoor environments, dense and accurate depth maps computed according to state-of-art algorithms and with minimal energy requirements that fit with typical constraints of smart camera systems.

References

[1]
C. Banz, S. Hesselbarth, H. Flatt, H. Blume, and P. Pirsch. Real-time stereo vision system using semi-global matching disparity estimation: Architecture and fpga-implementation. In ICSAMOS, pages 93--101, 2010.
[2]
H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool. Speeded-up robust features (surf). Comput. Vis. Image Underst., 110(3):346--359, June 2008.
[3]
N. Y.-C. Chang, T.-H. Tsai, P.-H. Hsu, Y.-C. Chen, and T.-S. Chang. Algorithm and architecture of disparity estimation with mini-census adaptive support weight. IEEE Trans. Circuits Syst. Video Techn., 20(6):792--805, 2010.
[4]
J. Ding, J. Liu, W. Zhou, H. Yu, Y. Wang, and X. Gong. Real-time stereo vision system using adaptive weight cost aggregation approach. EURASIP J. Image and Video Processing, 2011, 2011.
[5]
S. K. Gehrig, F. Eberli, and T. Meyer. A real-time low-power stereo vision engine using semi-global matching. In ICVS, pages 134--143, 2009.
[6]
HardKernel. Odroid-u3. http://hardkernel.com/main/main.php.
[7]
M. Harville. Stereo person tracking with adaptive plan-view templates of height and occupancy statistics. Image Vision Comput., 22(2):127--142, 2004.
[8]
H. Hirschmüller. Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell., 30(2):328--341, 2008.
[9]
H. Hirschmüller and D. Scharstein. Evaluation of stereo matching costs on images with radiometric differences. IEEE Trans. Pattern Anal. Mach. Intell., 31(9):1582--1599, 2009.
[10]
S. Jin, J. Cho, X. D. Pham, K. M. Lee, S.-K. Park, M. Kim, and J. W. Jeon. Fpga design and implementation of a real-time stereo vision system. IEEE Trans. Cir. and Sys. for Video Technol., 20(1):15--26, Jan. 2010.
[11]
R. Labayrade and D. Aubert. Real time obstacle detection in stereovision on non flat road geometry through v-disparity representation. In Intelligent Vehicle Symposium, IEEE, volume 2, pages 646 -- 651, 2002.
[12]
S. Mattoccia. Stereo vision algorithms for fpgas. In The 9th IEEE Embedded Vision Workshop, CVPR 2013 Workshop, 2013.
[13]
C. Pane, M. Gasparini, A. Prati, G. Gualdi, and R. Cucchiara. A people counting system for business analytics. In AVSS, pages 135--140, 2013.
[14]
D. Scharstein and R. Szeliski. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. Journal Computer Vision, 47(1/2/3):7--42, 2002.
[15]
B. Tippetts, D. J. Lee, K. Lillywhite, and J. Archibald. Review of stereo vision algorithms and their suitability for resource-limited systems. Journal of Real-Time Image Processing, 2013.
[16]
C. Ttofis and T. Theocharides. Towards accurate hardware stereo correspondence: A real-time fpga implementation of a segmentation-based adaptive support weight algorithm. In DATE, pages 703--708, 2012.
[17]
K. Yoon and I. Kweon. Adaptive support-weight approach for correspondence search. IEEE Trans. PAMI, 28(4):650--656, 2006.
[18]
R. Zabih and J. Woodfill. Non-parametric local transforms for computing visual correspondence. In ECCV 1994, pages 151--158. Springer-Verlag, 1994.
[19]
P. Zicari, S. Perri, P. Corsonello, and G. Cocorullo. Low-cost fpga stereo vision system for real time disparity maps calculation. Microprocess. Microsyst., 36(4):281--288, June 2012.

Cited By

View all
  • (2017)Low complexity depth map extraction and all-in-focus rendering for close-to-the-pixel embedded platformsProceedings of the 11th International Conference on Distributed Smart Cameras10.1145/3131885.3131926(29-34)Online publication date: 5-Sep-2017
  • (2016)Towards a smart camera for monocular SLAMProceedings of the 10th International Conference on Distributed Smart Camera10.1145/2967413.2967441(128-135)Online publication date: 12-Sep-2016
  • (2016)3D Cameras Benchmark for Human Tracking in Hybrid Distributed Smart Camera NetworksProceedings of the 10th International Conference on Distributed Smart Camera10.1145/2967413.2967431(76-83)Online publication date: 12-Sep-2016

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
ICDSC '14: Proceedings of the International Conference on Distributed Smart Cameras
November 2014
286 pages
ISBN:9781450329255
DOI:10.1145/2659021
  • General Chair:
  • Andrea Prati,
  • Publications Chair:
  • Niki Martinel
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D
  2. FPGA
  3. depth sensing
  4. smart camera
  5. stereo vision

Qualifiers

  • Tutorial
  • Research
  • Refereed limited

Conference

ICDSC '14
Sponsor:

Acceptance Rates

ICDSC '14 Paper Acceptance Rate 49 of 69 submissions, 71%;
Overall Acceptance Rate 92 of 117 submissions, 79%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 10 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2017)Low complexity depth map extraction and all-in-focus rendering for close-to-the-pixel embedded platformsProceedings of the 11th International Conference on Distributed Smart Cameras10.1145/3131885.3131926(29-34)Online publication date: 5-Sep-2017
  • (2016)Towards a smart camera for monocular SLAMProceedings of the 10th International Conference on Distributed Smart Camera10.1145/2967413.2967441(128-135)Online publication date: 12-Sep-2016
  • (2016)3D Cameras Benchmark for Human Tracking in Hybrid Distributed Smart Camera NetworksProceedings of the 10th International Conference on Distributed Smart Camera10.1145/2967413.2967431(76-83)Online publication date: 12-Sep-2016

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media