research-article

Analytic fusion of visual cues in model-based camera tracking

Authors:

Hanhoon Park,

Hideki Mitsumine,

Masato Fujii,

Jong-Il ParkAuthors Info & Claims

VRCAI '09: Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry

Pages 215 - 220

https://doi.org/10.1145/1670252.1670298

Published: 14 December 2009 Publication History

Get Access

Abstract

Model-based camera tracking is a technology that estimates a camera pose by tracking visual cues, i.e. points and edges on a known 3D scene model, in camera images. In model-based camera tracking, it has been a main challenge how to use the visual cues effectively for better performance. In this paper, we carefully analyze the dependency of the visual cues on tracking conditions (or environments) and propose a formula for integrating the visual cues cooperatively into a single framework based on the analysis. Then, we demonstrate that the analytic integration outperforms separate use of either cue and expedient integration of visual cues in arbitrary environments through experiments with synthetic camera images for which ground truth camera poses are given.

References

[1]

Bay, H., Tuytelaars, T., and Gool, L. V. 2006. Surf: Speeded up robust features. In Proc. of ECCV, 404--417.

Digital Library

Google Scholar

[2]

Canny, J. 1986. A computational approach to edge detection. IEEE Trans. on PAMI 8, 679--714.

Digital Library

Google Scholar

[3]

Dornaika, F., and Garcia, C. 1999. Pose estimation using point and line correspondences. Real-Time Imaging 5, 215--230.

Digital Library

Google Scholar

[4]

Gouet, B. L. V. 2004. Sap: A robust approach to track objects in video streams with snakes and points. In Proc. of BMVC, 737--746.

Crossref

Google Scholar

[5]

Hartley, R., and Zisserman, A. 2003. Multiple View Geometry. Cambridge University Press.

Digital Library

Google Scholar

[6]

Kato, H., and Billinghurst, M. 1999. Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In Proc. of IWAR, 85--94.

Digital Library

Google Scholar

[7]

Marziliano, P., Dufaux, F., Winkler, S., and Ebrahimi, T. 2002. A no-reference perceptual blur metric. In Proc. of ICIP, vol. 3, 57--60.

Google Scholar

[8]

Park, H., Oh, J., Seo, B.-K., and Park, J.-I. 2008. Object-adaptive tracking for ar guidance system. In Proc. of VRCAI.

Digital Library

Google Scholar

[9]

Pressigout, M., and Marchand, E. 2006. Real-time 3d model-based tracking: Combining edge and texture information. In Proc. of ICRA, 2726--2731.

Google Scholar

[10]

Rosten, E., and Drummond, T. 2005. Fusing points and lines for high performance tracking. In Proc. of ICCV, 1508--1511.

Digital Library

Google Scholar

[11]

Terriberry, T. B., French, L. M., and Helmsen, J. 2008. Gpu accelerating speeded-up robust features. In Proc. of 3DPVT, 355--362.

Google Scholar

[12]

Vacchetti, L., Lepetit, V., and Fua, P. 2004. Combining edge and texture information for real-time accurate 3d camera tracking. In Proc. of ISMAR, 48--57.

Digital Library

Google Scholar

Cited By

View all

PARK HMITSUMINE HFUJII M(2011)Automatic Adjustment of the Distance Ratio Threshold in Nearest Neighbor Distance Ratio Matching for Robust Camera TrackingIEICE Transactions on Information and Systems10.1587/transinf.E94.D.938E94-D:4(938-940)Online publication date: 2011
https://doi.org/10.1587/transinf.E94.D.938
Park HMitsumine HFujii M(2010)Jitter suppression in model-based camera tracking2010 16th International Conference on Virtual Systems and Multimedia10.1109/VSMM.2010.5665984(204-211)Online publication date: Oct-2010
https://doi.org/10.1109/VSMM.2010.5665984

Index Terms

Analytic fusion of visual cues in model-based camera tracking
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Tracking
      2. Computer vision tasks
        Scene understanding
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

Automatic confidence adjustment of visual cues in model-based camera tracking
VRCAI 08

Model-based camera tracking is a technology that estimates a precise camera pose based on visual cues (e.g., feature points, edges) extracted from camera images given a 3D scene model and a rough camera pose. This paper proposes an automatic method for ...
Hand-Eye Camera Calibration with an Optical Tracking System
ICDSC '18: Proceedings of the 12th International Conference on Distributed Smart Cameras

This paper presents a method for hand-eye camera calibration via an optical tracking system (OTS) faciltating robotic applications. The camera pose cannot be directly tracked via the OTS. Because of this, a transformation matrix between a marker-plate ...
Real-time camera pose estimation via line tracking

Real-time camera calibration has been intensively studied in augmented reality. However, for texture-less and texture-repeated scenes as well as poorly illuminated scenes, obtaining a stable calibration is still an open problem. In the paper, we propose ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

VRCAI '09: Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry

December 2009

374 pages

ISBN:9781605589121

DOI:10.1145/1670252

Editor:
Stephen N. Spencer
University of Washington
,
General Chairs:
Masayuki Nakajima
Tokyo Institute of Technology, Japan
,
Enhua Wu
University of Macau & Academia Sinica, China
,
Program Chairs:
Kazunori Miyata
JAIST, Japan
,
Daniel Thalmann
Ecole Polytechnique Federale de Lausanne, Switzerland
,
Zhiyong Huang
Institute for Infocomm Research, Singapore

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 December 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VRCAI '09

Sponsor:

SIGGRAPH

VRCAI '09: Virtual Reality Continuum and its Applications in Industry

December 14 - 15, 2009

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
135
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

PARK HMITSUMINE HFUJII M(2011)Automatic Adjustment of the Distance Ratio Threshold in Nearest Neighbor Distance Ratio Matching for Robust Camera TrackingIEICE Transactions on Information and Systems10.1587/transinf.E94.D.938E94-D:4(938-940)Online publication date: 2011
https://doi.org/10.1587/transinf.E94.D.938
Park HMitsumine HFujii M(2010)Jitter suppression in model-based camera tracking2010 16th International Conference on Virtual Systems and Multimedia10.1109/VSMM.2010.5665984(204-211)Online publication date: Oct-2010
https://doi.org/10.1109/VSMM.2010.5665984

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Automatic confidence adjustment of visual cues in model-based camera tracking

Hand-Eye Camera Calibration with an Optical Tracking System

Real-time camera pose estimation via line tracking