APPENDIX B TO
INTEROPERABILITY TESTING AND TEST CERTIFICATION
1. General. All NSS and ITS, regardless of ACAT, must be
tested and testing results certified by DISA (JITC). Testing may be performed in
conjunction with other testing (i.e., DT&E, OT&E, early user tests)
whenever possible to conserve resources.
a. DISA (JITC) must be involved during the planning and execution of
interoperability test certification at each program fielding milestone and
recertification. DISA (JITC), in coordination with the C/S/As, will ensure that
the required data elements for interoperability system test certification are
collected and validated.
b. Tests will be conducted using operational facilities and the Services’ or
DISA test beds during developmental testing and operational testing (DT/OT)
(1) Based on such testing, DISA (JITC) will conduct an independent analysis of
the data and certify that interoperability KPP have been met and the system
meets criteria for joint, combined, or coalition use.
(2) This certification will include an assessment of individual IERs and overall
system interoperability performance.
b. The intent is to ensure that no new system or system under modification will
enter production and gain IOC without certification, and that interoperability
deficiencies are detected sufficiently early in the milestone approval process
to ensure interoperability standards are met by IOC.
c. For commercial-off-the-shelf (COTS) systems and software not requiring formal
acquisition review, Service-sponsored interoperability testing and DISA (JITC)
certification will be conducted prior to IOC.
d. The MCEB IPTP resolves issues concerning joint testing and interoperability
system test certification.
e. Intelligence interoperability issues will be referred to the MIB.
f. The MCEB IPTP may grant a temporary waiver from interoperability system test
certification – an IATO – in special situations based on justifiable
circumstances and impacts.
2. Interoperability Test Certification Process.
Interoperability test certification begins during requirements development, and
continues until a system is no longer in the inventory. Figure D-B-1 depicts the
role of various elements of the interoperability test certification process.
DISA (JITC) can also tailor the test programs of nontraditional acquisitions to
meet interoperability test certification requirements.
a. System Tracking Program. Information from the J-6
interoperability requirements certification is used as an input to the DISA
(JITC) System Tracking Program (STP). The STP is used to schedule and track
tests and resources required for interoperability system test certification.
Program managers and organizations with a requirement for interoperability
system test certification or test support should contact the DISA (JITC) for
assistance. Initial STP entries should be made as early in the acquisition
process as possible. The STP program uses milestones to trigger notification to
appropriate parties of upcoming certification activities or missed events.
b. Interoperability Test Certification.
Interoperability test certification ensures a system meets user interoperability
(1) DISA (JITC) works with the system proponent and develops an interoperability
certification evaluation plan (ICEP) that makes the most efficient use of
resources. This ICEP uses existing data and other testing results to provide the
requisite information. The ICEP outlines how the system will be tested against
the requirements in the ORD, C4ISP, and TEMP. The testing is conducted during
DT&E, OT&E, and various joint exercises and deployments. Whenever
possible, testing is conducted in Service or DISA facilities during DT or OT
(2) DISA (JITC) evaluates interoperability in the most operational realistic
(3) When DISA (JITC) is not the interoperability testing organization, interoperability test plans, analysis, and reports will be coordinated with, and approved by, DISA (JITC) to ensure sufficient information is available to allow a certification decision.
(3) Developmental Testing (DT). DISA (JITC) will work with
the program management office through the C/S/A to determine if the system conforms to applicable standards. Standards
conformance testing of a system to a profile is performed under the direction of
the PM, usually by one of their contractors or the DISA (JITC).
(2) Operational Testing (OT). DISA (JITC) works with the
program management office through the C/S/A to ensure joint interoperability
testing requirements are met and that the data collected is adequate for
evaluating interoperability issues. The ICEP is normally completed during OT.
DISA (JITC) reports any interoperability problems in the use or deployment of
the system under test.
c. Production and Fielding Decision.
(1) DISA (JITC) provides the program manager, user command, DOT&E, and J-6
an interoperability test certification memorandum that can be used as input into
the production and fielding decision. Interoperability for each system will be
based on testing the interoperability KPP.
(2) The interoperability KPP is derived from the set of top-level external joint
and combined IERs that characterize the information exchanges to be performed by
the proposed system.
(3) All ORD threshold interoperability KPPs will be used to develop the TEMP
measures of effectiveness.
(4) DISA (JITC) interoperability test certification will include an evaluation
as to whether the system is ready for joint, combined, and coalition use.
d. Life-cycle Support
(1) DISA (JITC) assesses systems during exercises and operational use to
determine if changes to joint NSS and ITS architecture, standards, operational
concepts, or procedures have affected interoperability.
(2) In addition, DISA (JITC) documents the employment of NSS and ITS systems
that deviate from the MNS, CRDs, and ORDs.
(3) Identified deviations, deficiencies, and uncertified (never certified or
expired certification) systems are tracked and reported to the Joint Staff J-6
for appropriate action.
3. Summary. Interoperability test certification of joint,
combined, and coalition interoperability is a complex process requiring the full
cooperation of the requirements and acquisition community. The goal is to ensure
interoperability in the intended operational environment. This includes
established interoperability characteristics, as well as the risks relating to
the use of untested configurations. The interoperability test certification
process ensures the warfighter has an effective and integrated array of systems
and networks that will meet all mission needs.