220.127.116.11 Schedule IOT&E to Include System Interfaces with Other Systems
18.104.22.168 Schedule IOT&E to Include System Interfaces with
Whenever possible, the IOT&E/FOT&E (Follow-on
Operational Test and Evaluation) of a weapon system should be planned to
include other systems that must have a technical interface with the new
system. For example, missiles should be tested on most of the platforms for
which they are programmed.
A Preplanned Product Improvements (P3I) or increment
strategy is a variant of the evolutionary development process in which PMs and
other acquisition managers recognize the high-risk technologies/subsystems and
put them on parallel development tracks. The testing strategy should
anticipate the requirements to evaluate P3I item technology
maturity and then test the system during the integration of the additional
Advanced Technology Demonstrations (ATD) or Advanced Concept
Technology Demonstrations (ACTD) may provide early insights into available
technologies for incorporation into developmental or mature, post-prototype
systems. Using proven, mature technology provides a lower-risk strategy and
may significantly reduce the development testing workload. To assess and
manage risk, PMs and other acquisition managers should use a variety of
techniques, including technology demonstrations, prototyping, and T&E. The
process for verifying contract performance and item specifications, T&E of
threshold performance requirements in the Operational Requirements Document
(ORD), exit criteria, or the Acquisition Program Baseline (APB) performance
should be addressed in the DT&E strategy. The DT&E is an iterative
process starting at configuration item/software module levels and continuing
throughout the component integration into subassemblies and, finally,
system-level performance evaluations. OT&E is interwoven into early
DT&E for maximizing the efficient use of test articles and test schedules.
However, OT&E must remain a distinct thread of activity that does not lose
its identity in the tapestry of test events. Planning for test resources is
driven by the sequence and intensity of Development Test (DT) and Operational
Test (OT) events. Resource coordination is an equally arduous task, which
frequently has lead times equal to major program development activities.
Included in the program T&E strategy should be an overshadowing evaluation
plan, outlining methodologies, models, simulations, and test data required at
periodic decision points.
The TEMP should: (a) address critical human issues to provide
data to validate the results of human factors engineering analyses; and (b)
require identification of mission critical operational and maintenance
A reliability growth (Test, Analyze, Fix, and Test (TAFT))
program should be developed to satisfy the reliability levels required at Full
Rate Production (FRP). Reliability tests and demonstrations will be based on
actual or simulated operational conditions.4
Maintainability will be verified with a maintainability
demonstration before FRP.5
As early as practicable, developers and test agencies will
assess survivability and validate critical survivability characteristics at as
high a system level as possible. The TEMP will identify the means by which the
survivability objective will be validated.
Field engineering test facilities and testing in the intended
operational environments are required to: (1) verify electric or electronic
systems’ predicted performance; (2) establish confidence in electromagnetic
compatibility design based on standards and specifications; and (3) validate
electromagnetic compatibility analysis methodology.
The TEMP will address health hazard and safety critical issues
to provide data to validate the results of system safety analyses.
The TEMP strategy should directly support the development of
more detailed planning and resource documents needed to execute the actual
test events and subsequent evaluations.
The TEMP shall provide a roadmap for integrated simulation,
test, and evaluation plans, schedules, and resource requirements necessary to
accomplish the T&E program. T&E planning should address Measures of
Effectiveness/Suitability (MOEs/MOSs) with appropriate quantitative criteria,
test event or scenario description, resource requirements, and test
limitations. Test planning, at a minimum, must address all system components
that are critical to the achievement and demonstration of contract technical
performance specifications and threshold values specified in the Capability
Production Document (CPD).
4 DoD 3235.1-H, Test and Evaluation of System Reliability, Availability and
Maintainability – A Primer, March 1982.