Article

Free access

Visual tracking for multimodal human computer interaction

Authors:

Jie Yang,

Rainer Stiefelhagen,

Uwe Meier,

Alex WaibelAuthors Info & Claims

CHI '98: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 140 - 147

https://doi.org/10.1145/274644.274666

Published: 01 January 1998 Publication History

PDF eReader

References

[1]

Brunelli, R., and Poggio, T. (1993), "Face recognition: features versus templates," IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 15, No. 10, pp. 1042- 1052.

Digital Library

Google Scholar

[2]

Bub, U., Hunke, M., and Waibel, A. (1995), "'Knowing who to listen to in speech recognition: visually guided beamforming;' Proceedings of ICASSP'95.

Google Scholar

[3]

Chang, T.C., Huang, T.S., and Novak, C. (1994), "Facial feature extraction from color images," Proe. the 12th IAPR International Conference on Pattern Recognition, Vol. 2, pp. 39-43.

Crossref

Google Scholar

[4]

DeMenthon, Daniel. E and Davis, Larry S. (1992), "Model based object pose in 25 lines of code", Proceedings of Second European Conference on Computer Vision, Santa Margherita Ligure, pp. 335 - 343.

Digital Library

Google Scholar

[5]

Forsyth, D. (1990), "'A novel algorithm for color constaney," International Journal of Computer Vision. Voh 5, No. 1, pp.5-36.

Digital Library

Google Scholar

[6]

i-iunke, M., and Waibel, A. (1994), "'Face locating and tracking for human-computer interaction," Proe. Twenty-Eight Asilomar Conference on Signals, Systems & Computers, Monterey, CA, USA.

Google Scholar

[7]

Klinker, G.L, Shafer, S.A., and Kanade, T. (1987), "Using a color reflection model to separate highlights from object color," Proe. ICCV, pp. 145-150.

Google Scholar

[8]

Meier U., I-I~st W., and Duchnowski P. (1996), "Adaptive Bimoflal Sensor Fusion for Automatic Speechreading" Proe. Intern. Conference on Acoustics, Speech and Signal Ih'oeessing, ICASSP 1996

Digital Library

Google Scholar

[9]

Meier U., Stiefelhagen R., Yang L (1997), "'Preprocessing of Visual Speech under Real World Conditions" European Tutorial & Research Workshop on Audio-Visual Speech Processing: Computational & Cognitive Science Approaches (AVSP 97)

Google Scholar

[10]

Ohta, Y., Kanade, T., and Sakai, T. (1980), "Color information for region segmentation," Computer Graphics and Image Processing, Vol. 13, No. 3, pp.222-241.

Crossref

Google Scholar

[11]

Oliver, N., Penfland, A., and Bemrd, E (1997), "LAFI~R: lips and face realtime tracker," Proceedings of CVPR'97, pp. 123-129.

Digital Library

Google Scholar

[12]

Penfland, A., Moghaddam, B., and Starner, T. (I994), "'View-based and modular eigenspace for face recognidon," Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 84-91, Seattle, WA, USA.

Google Scholar

[13]

Rowley, H.A., Baluja, S., and Kanade, T. (1995), "Human face detection in visual scenes," Technical Report CMU-CS-95-158, CS department, CMU, 1995.

Google Scholar

[14]

Shafer, S.A. (1984), "Optical phenomena in computer vision," Proc. Canadian Soe. Computational Studies of Intelligence, pp. 572-577.

Google Scholar

[15]

Sinha, P. (1994), "Object recognition via image invariants: a case study. Investigative ophthalmology and visual science," ~ol. 35, pp. 1735-1740.

Google Scholar

[16]

Stiefelhagen, R., Yang, J., and Waibel, A., (1996) "A model-based gaze tracking system," Proceedings of Joint Symposia on Intelligence and Systems (Washington DC).

Digital Library

Google Scholar

[17]

Stiefelhagen, R. and Yang, J. (1997), "Gaze tracking for multimodal human-computer interaction," Proceedings of 1997 ICASSP (Munich, Germany).

Digital Library

Google Scholar

[18]

Sung, K., and Poggio, T. (1994), "Example-based learning for view-based human face detection," Technical Report 1521, MIT AI Lab.

Crossref

Google Scholar

[19]

Swain, M.L, and Ballard, D.H. (1991), "Color indexing," International Journal of Computer Vision. Vol. 7, No.l, pp. 11-32.

Digital Library

Google Scholar

[20]

Turk, M.A., and Penfland, A. (1991), "Face recognition using eigenfaces," Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 586-591, Maui, HI, USA.

Crossref

Google Scholar

[21]

Wyszecki, G., and Styles, W.S. (1982), "Color Science: Concepts and Methods, Quantitative Data and Formulae," Second Edition, John Wiley & Sons, New York.

Google Scholar

[22]

Yang, J., and Waibel, A. (1995), "A real-time face tracker," Proceedings of the Third IEEE Workshop on Applications of Computer Vision (Sarasota, Florida, 1996), pp. 142-147 (Technical Report CMU-CS-95-210, CS department, CMU, 1995).

Digital Library

Google Scholar

[23]

Yang, J., Wu, L., and Waibel, A. (1996), "Focus of attention: towards low bitrate video tele-conferencing," Proceedings of 1996 IEEE International Conference on Image Processing (Lausanne, Switzerland), Voh 2, pp. 97-100.

Google Scholar

[24]

Yang, J., Lu, W., and Waibel, A. (1997), "Skin-color modeling and adaptation," Proceedings of ACCV'98 (Technical Report CMU-CS-97-146, CS department, CMU, 1997).

Crossref

Google Scholar

[25]

Yuille, A., Hallinan, P., and Cohen, D. (1992), "Feature extraction from faces using deformable templates," Int. J. Computer Vision, Vol. 8, No. 2, pp. 99-111.

Digital Library

Google Scholar

Cited By

View all

Kwok TKiefer PRaubal M(2023)Unobtrusive interaction: a systematic literature review and expert surveyHuman–Computer Interaction10.1080/07370024.2022.216240439:5-6(380-416)Online publication date: Feb-2023
https://doi.org/10.1080/07370024.2022.2162404
Ono TKondo YSun LKurita TMoriuchi Y(2022)Degree-of-linear-polarization-based Color Constancy2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.01912(19708-19717)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.01912
Qi YZhang SQin LHuang QYao HLim JYang M(2019)Hedging Deep Features for Visual TrackingIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2018.282881741:5(1116-1130)Online publication date: 1-May-2019
https://doi.org/10.1109/TPAMI.2018.2828817
Show More Cited By

Index Terms

Visual tracking for multimodal human computer interaction

Recommendations

A non-invasive computer vision system for reliable eye tracking
CHI EA '00: CHI '00 Extended Abstracts on Human Factors in Computing Systems

Knowing what the user is attending to and what they are looking at is essential for creating attentive user interfaces. Towards this end, we are building a reliable, real-time, non-invasive eye tracker using computer vision. Our system can robustly ...
Avatar-mediated face tracking and lip reading for human computer interaction
MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia

Advanced human computer interaction requires automatic reading of human face in order to make the computer interact with human in the same way as human-to-human communication. We developed an automatic face tracking and lip reading system through a 3D ...
Multimodal human computer interaction: a survey
ICCV'05: Proceedings of the 2005 international conference on Computer Vision in Human-Computer Interaction

In this paper we review the major approaches to multimodal human computer interaction from a computer vision perspective. In particular, we focus on body, gesture, gaze, and affective interaction (facial expression recognition, and emotion in audio). We ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI '98: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

January 1998

650 pages

ISBN:0201309874

Chairman:
Michael E. Atwood
Bell Atlantic Science and Technology
,
Editors:
Clare-Marie Karat
IBM T.J. Watson Research Center, NY
,
Arnold Lund
US West Advanced Technologies
,
Joëlle Coutaz
CLIPS-IMAG
,
John Karat
IBM T.J. Watson Research Center, NY

Publisher

ACM Press/Addison-Wesley Publishing Co.

United States

Publication History

Published: 01 January 1998

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI98

Sponsor:

SIGCHI

CHI98: ACM Conference on Human Factors and Computing Systems

April 18 - 23, 1998

California, Los Angeles, USA

Acceptance Rates

CHI '98 Paper Acceptance Rate 81 of 351 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
1,329
Total Downloads

Downloads (Last 12 months)116
Downloads (Last 6 weeks)14

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kwok TKiefer PRaubal M(2023)Unobtrusive interaction: a systematic literature review and expert surveyHuman–Computer Interaction10.1080/07370024.2022.216240439:5-6(380-416)Online publication date: Feb-2023
https://doi.org/10.1080/07370024.2022.2162404
Ono TKondo YSun LKurita TMoriuchi Y(2022)Degree-of-linear-polarization-based Color Constancy2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.01912(19708-19717)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.01912
Qi YZhang SQin LHuang QYao HLim JYang M(2019)Hedging Deep Features for Visual TrackingIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2018.282881741:5(1116-1130)Online publication date: 1-May-2019
https://doi.org/10.1109/TPAMI.2018.2828817
Zhang XYue SGong RLi Q(2019)Illumination estimation based on a weighted color distributionOptik10.1016/j.ijleo.2019.04.001185(965-971)Online publication date: May-2019
https://doi.org/10.1016/j.ijleo.2019.04.001
Morikawa CLyons M(2018)Design and Evaluation of Vision-Based Head and Face Tracking Interfaces for Assistive InputSmart Technologies10.4018/978-1-5225-2589-9.ch004(67-96)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-2589-9.ch004
Mutimbu LRobles-Kelly A(2016)Multiple Illuminant Color Estimation via Statistical Inference on Factor GraphsIEEE Transactions on Image Processing10.1109/TIP.2016.260500325:11(5383-5396)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1109/TIP.2016.2605003
Mutimbu LRobles-Kelly A(2015)Factor graphs for pixelwise illuminant estimation2015 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN.2015.7280811(1-8)Online publication date: Jul-2015
https://doi.org/10.1109/IJCNN.2015.7280811
Cepeda-Negrete JSanchez-Yanez R(2015)Automatic selection of color constancy algorithms for dark image enhancement by fuzzy rule-based reasoningApplied Soft Computing10.1016/j.asoc.2014.11.03428:C(1-10)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1016/j.asoc.2014.11.034
Morikawa CLyons M(2014)Design and Evaluation of Vision-Based Head and Face Tracking Interfaces for Assistive InputAssistive Technologies and Computer Access for Motor Disabilities10.4018/978-1-4666-4438-0.ch007(180-205)Online publication date: 2014
https://doi.org/10.4018/978-1-4666-4438-0.ch007
Cepeda-Negrete JSanchez-Yanez R(2014)Gray-World Assumption on Perceptual Color SpacesImage and Video Technology10.1007/978-3-642-53842-1_42(493-504)Online publication date: 2014
https://doi.org/10.1007/978-3-642-53842-1_42
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A non-invasive computer vision system for reliable eye tracking

Avatar-mediated face tracking and lip reading for human computer interaction

Multimodal human computer interaction: a survey