Abstract
This paper describes a method for tracking moving image features by combining spatial and temporal edge information with model-based feature information. The algorithm updates the two-dimensional position of object features by correlating predicted model features with current image data. The results of the correlation process are used to compute an updated model. The algorithm makes use of a high temporal sampling rate with respect to spatial changes of the image features and operates in a real-time multi-processing environment. Preliminary results demonstrate successful tracking for image feature velocities between 1.1 and 4.5 pixels every image frame.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
AdelsonE.H. and BergenJ.R., 1985, Spatio-temporal energy models for the perception of motion, J. Optical Soc. Amer. A 2, 284–299.
Albus, James S. and Tsai-Hong Hong, 1990, Motion, depth, and image flow, IEEE Robotics and Conference, Cincinnati, OH. May 13–18.
Albus, J.S., McCain, H.G. and Lumia, R., 1987, NASA/NBS standard reference model for telerobot control system architecture (NASREM), NIST Technical Note 1235, Gaithersburg, MD.
Allen, Peter K., 1989, Real-time motion tracking using spatio-temporal filters, Proc. DARPA Image Understanding Workshop, Palo Alto, TX, May 23–26.
Aspex, Inc., 1987, PIPE — An introduction to the PIPE system, New York.
BollesRobert C., BakerH. Harlyn and MarimontDavid H., 1987, Epipolar-plane image anlaysis: An approach to determining structure from motion, Internat. J. Computer Vision 1, 7–55.
Chaconas, K. and Nashman, M., 1989, Visual perception processing in a hierarchical control system, NIST Technical Note 1260, Gaithersburg, MD.
Chaconas, K., 1990, Range from triangulation using an inverse perspective method to determine relative camera pose, NIST Internal Report 4385, Gaithersburg, MD.
Crowley, James L., Stelmaszyk Patrick and Discours Christopher, 1988, Measuring image flow by tracking edge-lines, Proc. 2nd Internat. Conference on Computer Vision, pp 658–664.
Fiala, J., 1988, Manipulator servo level task decomposition, NIST Technical Note 1255, Gaithersburg, MD.
Fiala, J., 1989, Note on NASREM implementation, NIST Internal Report 89-4215, Gaithersburg, MD, December.
Gennery, Donald B., 1982, Tracking known three-dimensional objects, Proc. National Conference on Artificial Intelligence, Pittsburg, PA, August 18–20, pp 13–17.
HornB.K.P. and SchunkB., 1983, Determining optical flow, Artificial Intelligence 17, 185–203.
JenkinM. and TsotsosJ.K., 1986, Applying temporal constraints to the dynamic stereo problem, CVGIP 33, 16–32.
KelmarL., 1989, Manipulator servo level world modelling, NIST Technical Note 1258, NIST, Gaithersburg, MD.
Lumia, R., Fiala, J. and Wavering, A., The NASREM robot control system and testbed, 2nd Internat. Symp. Robotics & Automated Manufacturing, Albuquerque, NM.
MontgomeryD.C., JohnsonL.A. and GardinerJ.S., 1990, Forecasting and Time Series Analysis, 2nd edn, McGraw-Hill, New York.
Spetsakis, Minas E. and Aloimonos, John, 1987, Closed form solution to the structure from motion problem from line correspondences, Proc. National Conference on Artificial Intelligence, pp 738–743.
ThompsonD.W. and MundyJ.L., 1988, Model-based motion analysis-motion from motion, Robotics Research: The Fourth International Symposium (eds. R.C.Bolles and B.Roth), MIT Press, Cambridge, Mass, pp 229–235.
VergheseGilbert and DyerCharles R., 1988, Real-time model-based tracking of three-dimensional object, Computer Sciences Technical Report #806, University of Wisconsin-Madison.
WaveringA., 1988, Manipulator primitive level task decomposition, NIST Technical Note 1256, NIST, Gaithersburg, MD.
Waxman, Allen M. and Wohn Kwangyoen, 1986, Image flow theory: A framework for 3-D inference from time-varying imagery, LSR-TR-1, Boston University.
Waxman, Allen M., Wu, Jian and Bergholm, F., 1988, Convected activation profiles: receptive fields for real-time measurement of short-range visual motion, Internat. Conference on Computer Vision.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Roberts, K., Nashman, M. Real-time model-based tracking combining spatial and temporal features. Journal of Intelligent and Robotic Systems 5, 25–38 (1992). https://doi.org/10.1007/BF00357128
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00357128