More Web Proxy on the site http://driver.im/

research-article

Color anomaly detection and suggestion for wilderness search and rescue

Authors:

Bryan S. Morse,

Daniel Thornton,

Michael A. GoodrichAuthors Info & Claims

HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

Pages 455 - 462

https://doi.org/10.1145/2157689.2157837

Published: 05 March 2012 Publication History

Abstract

In wilderness search and rescue, objects not native or typical to a scene may provide clues that indicate the recent presence of the missing person. This paper presents the results of augmenting an aerial wilderness search-and-rescue system with an automated spectral anomaly detector for identifying unusually colored objects. The detector dynamically builds a model of the natural coloring in the scene and identifies outlier pixels, which are then filtered both spatially and temporally to find unusually colored objects. These objects are then highlighted in the search video as suggestions for the user, thus shifting a portion of the user's task from scanning the video to verifying the suggestions. This paper empirically evaluates multiple potential detectors then incorporates the best-performing detector into a suggestion system. User study results demonstrate that even with an imperfect detector users' detection increased significantly. Results further indicate that users' false positive rates did not increase, though performance in a secondary task did decrease. Furthermore, users subjectively reported that the use of detector-based suggestions made the overall task easier. These results suggest that such suggestion-based systems for search can increase overall searcher performance but that additional external tasks should be limited.

References

[1]

E. Ashton. Detection of subpixel anomalies in multispectral infrared imagery using an adaptive Bayesian classifier. IEEE Trans. Geoscience and Remote Sensing, 36(2):506--517, Mar 1998.

[2]

N. Billor, A. S. Hadi, and P. F. Velleman. BACON: blocked adaptive computationally efficient outlier nominators. Computational Statistics & Data Analysis, 34(3):279--298, 2000.

Digital Library

[3]

M. Carlotto. A cluster-based approach for detecting man-made objects and changes in imagery. IEEE Trans. Geoscience and Remote Sensing, 43(2):374--387, 2005.

[4]

Y. Caron, P. Makris, and N. Vincent. A method for detecting artificial objects in natural environments. In 16th International Conference on Pattern Recognition, volume 1, pages 600--603, 2002.

Digital Library

[5]

V. Chandola, A. Banerjee, and V. Kumar. Anomaly detection: A survey. ACM Comput. Surv., 41(3):1--58, 2009.

Digital Library

[6]

C.-I. Chang and S.-S. Chiang. Anomaly detection and classification for hyperspectral imagery. IEEE Trans. Geosci. and Remote Sensing, 40(6):1314--1325, 2002.

[7]

J. Y. C. Chen. Individual differences in human-robot interaction in a military multitasking environment. Journal of Cognitive Engineering and Decision Making, 5(1):83--105, 2011.

[8]

E. de Visser and R. Parasuraman. Adaptive aiding of human-robot teaming: Effects of imperfect automation on performance, trust, and workload. Journal of Cognitive Engineering and Decision Making, 5(2):209--231, 2011.

[9]

E. J. de Visser and R. Parasuraman. Effects of imperfect automation and task load on human supervision of multiple uninhabited vehicles. Human Factors and Ergonomics Society Annual Meeting Proceedings, 51(18):1081--1085, 2007.

[10]

A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39(1):1--38, 1977.

[11]

S. R. Dixon and C. D. Wickens. Automation reliability in unmanned aerial vehicle control: A reliance-compliance model of automation dependence in high workload. Human Factors, 48(3):474--486, 2006.

[12]

S. R. Dixon, C. D. Wickens, and D. Chang. Unmanned aerial vehicle flight control: False alarms versus misses. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting, 2004.

[13]

R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification (2nd Edition). Wiley-Interscience, 2000.

Digital Library

[14]

L. M. Fletcher-Heath, L. O. Hall, D. B. Goldgof, and F. R. Murtagh. Automatic segmentation of non-enhancing brain tumors in magnetic resonance images. In Artificial Intelligence in Medicine, pages 43--63, 2001.

Digital Library

[15]

M. A. Goodrich, B. S. Morse, D. Gerhardt, J. L. Cooper, M. Quigley, J. A. Adams, and C. Humphrey. Supporting wilderness search and rescue using a camera-equipped mini UAV. Journal of Field Robotics, 25(1-2):89--110, 2008.

Digital Library

[16]

R. C. Johnson, K. N. Saboe, M. S. Prewett, M. D. Coovert, and L. R. Elliott. Autonomy and automation reliability in human-robot interaction: A qualitative review. Human Factors and Ergonomics Society Annual Meeting Proceedings, 53(18):1398--1402, 2009.

[17]

A. Mecocci, M. Pannozzo, and A. Fumarola. Automatic detection of anomalous behavioural events for advanced real-time video surveillance. In International Symposium on Computational Intelligence for Measurement Systems and Applications, pages 187--192, Jul 2003.

[18]

A. Mittal and D. Huttenlocher. Scene modeling for wide area surveillance and image synthesis. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 160--167, 2000.

[19]

B. Morse, D. Gerhardt, C. Engh, M. Goodrich, N. Rasmussen, D. Thornton, and D. Eggett. Application and evaluation of spatiotemporal enhancement of live aerial video using temporally local mosaics. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1--8, Jun 2008.

[20]

H. Nanda and L. Davis. Probabilistic template based pedestrian detection in infrared videos. In IEEE Intelligent Vehicle Symposium, pages 15--20, 2002.

[21]

C. Papageorgiou, M. Oren, and T. Poggio. A general framework for object detection. In International Conference on Computer Vision, pages 555--562, 1998.

Digital Library

[22]

R. Parasuraman and D. H. Manzey. Complacency and bias in human use of automation: An attentional integration. Human Factors, 52(3):381--410, 2010.

[23]

R. Parasuraman and V. Riley. Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39(2):230--253, 1997.

[24]

N. Rasmussen, D. Thornton, and B. Morse. Enhancement of unusual color in aerial video sequences for assisting wilderness search and rescue. In 15th IEEE International Conference on Image Processing, pages 1356--1359, Oct 2008.

[25]

I. Reed and X. Yu. Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution. IEEE Trans. Acoustics, Speech and Signal Processing, 38(10):1760--1770, Oct 1990.

[26]

T. Smetek and K. Bauer. Finding hyperspectral anomalies using multivariate outlier detection. In IEEE Aerospace Conference, pages 1--24, Mar 2007.

[27]

J. Solka, D. Marchette, B. Wallet, V. Irwin, and G. Rogers. Identification of man-made regions in unmanned aerial vehicle imagery and videos. IEEE Trans. PAMI, 20(8):852--857, Aug 1998.

Digital Library

[28]

C. Stauffer and W. Grimson. Adaptive background mixture models for real-time tracking. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999.

[29]

C. A. Sugar and G. M. James. Finding the number of clusters in a dataset: An information-theoretic approach. Journal of the American Statistical Association, 98:750--763, January 2003.

[30]

D. Thornton. Unusual-object detection in color video for wilderness search and rescue. Master's thesis, Brigham Young University, December 2010.

[31]

L. Zhao and C. Thorpe. Stereo- and neural network-based pedestrian detection. IEEE Trans. Intelligent Transportation Sys., 1(3):148--154, 2000.

Digital Library

Cited By

Manzini TMurphy R(2023)Open Problems in Computer Vision for Wilderness SAR and The Search for Patricia Wu-Murad2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)10.1109/ICCVW60793.2023.00409(3786-3791)Online publication date: 2-Oct-2023
https://doi.org/10.1109/ICCVW60793.2023.00409
Amala Arokia Nathan RKurmi ISchedl DBimber O(2022)Through-Foliage Tracking with Airborne Optical SectioningJournal of Remote Sensing10.34133/2022/98127652022Online publication date: Jan-2022
https://doi.org/10.34133/2022/9812765
Seits FKurmi IBimber O(2022)Evaluation of Color Anomaly Detection in Multispectral Images for Synthetic Aperture SensingEng10.3390/eng30400383:4(541-553)Online publication date: 29-Nov-2022
https://doi.org/10.3390/eng3040038
Show More Cited By

Index Terms

Color anomaly detection and suggestion for wilderness search and rescue
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
      1. External interfaces for robotics
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks

Recommendations

UAV video coverage quality maps and prioritized indexing for wilderness search and rescue
HRI '10: Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction

Video-equipped mini unmanned aerial vehicles (mini-UAVs) are becoming increasingly popular for surveillance, remote sensing, law enforcement, and search and rescue operations, all of which rely on thorough coverage of a target observation area. However, ...
Deep learning for anomaly detection in multivariate time series: Approaches, applications, and challenges
Abstract
Anomaly detection has recently been applied to various areas, and several techniques based on deep learning have been proposed for the analysis of multivariate time series. In this study, we classify the anomalies into three types, ...
Highlights
- The methods for anomaly detection on multivariate time series are reviewed.
- The ...
Anomaly Detection of Aerospace Facilities Using Ganomaly
ICMSSP '20: Proceedings of the 2020 5th International Conference on Multimedia Systems and Signal Processing

In the field of aerospace, the abnormal detection of data is of great significance. The rapid and effective detection of abnormal parameters is key to find potential failures of spacecraft. Traditional methods of anomaly detection need much manual ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

March 2012

518 pages

ISBN:9781450310635

DOI:10.1145/2157689

General Chairs:
Holly Yanco
University of Massachusetts Lowell, USA
,
Aaron Steinfeld
Carnegie Mellon University, USA
,
Program Chairs:
Vanessa Evers
University of Amsterdam, The Netherlands
,
Odest Chadwicke Jenkins
Brown University, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

IEEE-RAS: Robotics and Automation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HRI'12

Sponsor:

HRI'12: International Conference on Human-Robot Interaction

March 5 - 8, 2012

Massachusetts, Boston, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
244
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Manzini TMurphy R(2023)Open Problems in Computer Vision for Wilderness SAR and The Search for Patricia Wu-Murad2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)10.1109/ICCVW60793.2023.00409(3786-3791)Online publication date: 2-Oct-2023
https://doi.org/10.1109/ICCVW60793.2023.00409
Amala Arokia Nathan RKurmi ISchedl DBimber O(2022)Through-Foliage Tracking with Airborne Optical SectioningJournal of Remote Sensing10.34133/2022/98127652022Online publication date: Jan-2022
https://doi.org/10.34133/2022/9812765
Seits FKurmi IBimber O(2022)Evaluation of Color Anomaly Detection in Multispectral Images for Synthetic Aperture SensingEng10.3390/eng30400383:4(541-553)Online publication date: 29-Nov-2022
https://doi.org/10.3390/eng3040038
Jin PMou LXia GZhu X(2022)Anomaly Detection in Aerial Videos With TransformersIEEE Transactions on Geoscience and Remote Sensing10.1109/TGRS.2022.319813060(1-13)Online publication date: 2022
https://doi.org/10.1109/TGRS.2022.3198130
Lee HCheon ELim CFischer K(2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889496
Ciccone FBacciaglia ACeruti A(2022)Methodology for Image Analysis in Airborne Search and Rescue OperationsAdvances on Mechanics, Design Engineering and Manufacturing IV10.1007/978-3-031-15928-2_71(815-826)Online publication date: 25-Sep-2022
https://doi.org/10.1007/978-3-031-15928-2_71
Weldon WHupy J(2020)Investigating Methods for Integrating Unmanned Aerial Systems in Search and Rescue OperationsDrones10.3390/drones40300384:3(38)Online publication date: 24-Jul-2020
https://doi.org/10.3390/drones4030038
Zheng YDu YLing HSheng WChen S(2020)Evolutionary Collaborative Human-UAV Search for Escaped CriminalsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2019.292517524:2(217-231)Online publication date: Apr-2020
https://doi.org/10.1109/TEVC.2019.2925175
Jurecka MMiziński BNiedzielski T(2019)Impact of boosting saturation on automatic human detection in imagery acquired by unmanned aerial vehiclesJournal of Applied Remote Sensing10.1117/1.JRS.13.04452513:04(1)Online publication date: 1-Oct-2019
https://doi.org/10.1117/1.JRS.13.044525
Agcayazi MCawi EJurgenson AGhassemi PCook G(2016)ResQuad: Toward a semi-autonomous wilderness search and rescue unmanned aerial system2016 International Conference on Unmanned Aircraft Systems (ICUAS)10.1109/ICUAS.2016.7502618(898-904)Online publication date: Jun-2016
https://doi.org/10.1109/ICUAS.2016.7502618
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents