[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/1660877.1660881acmotherconferencesArticle/Chapter ViewAbstractPublication PagespermisConference Proceedingsconference-collections
research-article

How DoD's TRA process could be applied to intelligent systems development

Published: 28 August 2007 Publication History

Abstract

Over the past several years, the Department of Defense (DoD) has instituted a Technology Readiness Assessment (TRA) process based on NASA's Technology Readiness Levels (TRLs). The motivation was to ensure that technology development was complete and that performance was understood before entering into the System Development and Demonstration (SDD) phase of a program. Such a disciplined approach may aid in Intelligent Systems development. However, NASA's TRLs were derived in a context of hardware systems, and the hardware TRLs needed modification to treat software and software-intensive systems. This paper will examine under what conditions additional modifications might be necessary to treat Intelligent Systems.
Technology development can only be "complete" in the context of a specific program with known performance requirements. Thus, the TRA's focus on critical technology elements (CTEs)---those technologies used in a new or novel way that are essential to system performance. These CTEs are assessed for their performance in a relevant environment, as determined from a consideration of the system's requirements. For Intelligent Systems, this focus on CTE's and relevant environment may provide a disciplined approach to ensuring technology maturity before system development.
The algorithms that make decisions will often be the distinctive CTEs, unlike the CTEs of hardware systems. However, the major differences between Intelligent and hardware systems are likely to be in the "relevant environment". Intelligent Systems that develop and execute a course of action will, by their nature, present challenges in the definition of the "relevant environment". We will explore the effect of various degrees of "intelligence" on CTEs and the relevant environment in this paper.

References

[1]
GAO/NSIAD-00-137, Defense Acquisition: Employing Best Practices Can Shape Better Weapon System Decisions, April 26, 2000. Available online: http://www.gao.gov.new.items/ns00137t.pdf
[2]
Department of Defense, Technology Readiness Assessment (TRA) Desk-book, May 2005. Available on-line: http://www.defenselink.mil/ddre/doc/tra_deskbook_2005.pdf
[3]
GAO-07-336, Major Construction Projects Need a Consistent Approach for Assessing Technology Readiness To Help Avoid Cost Increases and Delays, March 2007. Available on-line: http://www.gao.gov/new.items/d07336.pdf
[4]
Dr. Alex Zelinsky, "Building Autonomous Systems of High Performance Reliability and Integrity," Invited talk, PerMIS 2007.
[5]
S. Schipani and E. Messina, "Maze Hypothesis Development in Assessing Robot Performance During Teleoperation," Tue-PM2 PerMIS 2007, and N. Dagalakis, Y. Kim, D. Sawyer, and C. Shakarji, "Development of Tools for Measuring the Performance of Computer Assisted Orthopaedic Hip Surgery Systems," Wed PM1 PerMIS 2007.

Cited By

View all
  • (2012)Quantitative Horizon Scanning for Mitigating Technological Surprise: Detecting the Potential for Collaboration at the InterfaceStatistical Analysis and Data Mining10.1002/sam.111435:3(178-186)Online publication date: 1-Jun-2012

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
PerMIS '07: Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems
August 2007
293 pages
ISBN:9781595938541
DOI:10.1145/1660877
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • NIST: National Institute of Standards and Technology

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 August 2007

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Conference

PerMIS07
Sponsor:
  • NIST

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 28 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2012)Quantitative Horizon Scanning for Mitigating Technological Surprise: Detecting the Potential for Collaboration at the InterfaceStatistical Analysis and Data Mining10.1002/sam.111435:3(178-186)Online publication date: 1-Jun-2012

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media