A Test Readiness Review (TRR) is conducted to determine if the system under review is ready to proceed into formal testing by deciding whether the test procedures are complete and verifying their compliance with test plans and descriptions. A TRR is normally conducted before each major test configuration item, including hardware and software, and assures management that a system has undergone a thorough test process and is ready for turnover to the next test phase. A Test Readiness Review is done for the events listed in the Test and Evaluation Master Plan (TEMP). The Flight Readiness Review (FRR) is a subset test of the TRR.
Definition: A Test Readiness Review (TRR) provides the formal approval showing that a system is ready to enter the testing phase.
Test Readiness Review (TRR) Purpose
The TRR assesses test objectives, test methods and procedures, the scope of tests, and safety and confirms that required test resources have been properly identified and coordinated to support planned tests. The TRR verifies the traceability of planned tests to program requirements and user needs. The TRR also assesses the system under review for development maturity, cost/ schedule effectiveness, and risk to determine readiness to proceed to formal testing.
Test Readiness Review (TRR) Documentation
The TRR is specified in the Test and Evaluation Master Plan (TEMP). The TEMP is a document that describes the overall structure and objectives of the T&E program and articulates the necessary resources to accomplish each phase. It will lay out the details of the TRR and its entrance and exit criteria, and it will be conducted for events identified in the TEMP.
Test Readiness Review (TRR) Responsibility
The test manager and the program manager are in charge of running the TRR. However, the program manager, Chief systems engineer, and other subject matter experts will decide if a system is ready for the TRR.
Test Readiness Review (TRR) Checklist
Checklist: DoD Test Readiness Review (TRR) Risk Assessment
Test Readiness Review (TRR) Questions
The TRR should answer the following questions:
- Why are we testing?
- What is the purpose of the planned test?
- Does the planned test verify a requirement that is directly traceable back to a system specification or other program requirement?
- What are we testing (subsystem, system, a system of systems, other)?
- Is the configuration of the system under test sufficiently mature, defined, and representative to accomplish planned test objectives and or support defined program objectives?
- Are we ready to begin testing?
- Have all planned preliminary, informal, functional, unit level, subsystem, system, and qualification tests been conducted, and are the results satisfactory?
- What is the expected result and how can/do the test evaluation results affect the program?
- Is the planned test properly resourced (people, test articles or articles, facilities, data systems, support equipment, logistics, etc.)?
- What are the risks associated with the tests and how are they being mitigated?
- What are the hazards and ESOH risks associated with the specific testing?
- Have the necessary “Safety Releases” from the Program Manager (PM) been provided to developmental and operational testers prior to any test using personnel?
- What is the fall-back plan should a technical issue or potential showstopper arise during testing?
Test Readiness Review (TRR) Risk
The scope of the TRR is directly related to the risk level associated with performing the planned tests and the importance of the test evaluation results to overall program success. The level of specific risk and associated risk level will vary as a system proceeds from the component level, to the system level, to systems of systems-level testing. Early component-level tests may not require the same level of review as the final system-level tests. Sound judgment should dictate the scope of a specific test or series of tests.
AcqNotes Tutorial
Test Readiness Review (TRR) Criteria
Typical TRR success criteria include the following:
- Completed and approved test plans for the system under test,
- Completed identification and coordination of required test resources,
- The judgment that previous component, subsystem, and system test results form a satisfactory basis for proceeding into planned tests, and
- Identified risk level acceptable to the program leadership.
Test Readiness Review (TRR) Evaluators
Below is a list of the common subject matter experts and leaders participating in a TRR. It’s not a complete list, but it should give you an idea of who should participate.
- Program Manager
- Chief Developmental Tester
- Chief Systems Engineer
- Logistician
- Safety
- Lead DT&E Organization representative
- User Community
- Other SMEs
Operational Test Readiness Review (OTRR)
The Operational Test Readiness Review (OTRR) assesses if a system should proceed into Initial Operational Test and Evaluation (IOT&E). The review addresses and verifies system reliability, maintainability, and supportability performance and determines if the hazards and Environmental, Safety, Occupational, and Health (ESOH) residual risks are manageable within the planned testing operations. This assessment determines if changes are required in planning, resources, or testing necessary to proceed with IOT&E. Of critical importance to this review is the understanding of available system performance to meet the Capability Production Document (CPD) performance threshold values.
AcqLinks and References:
- Defense Acquisition Guidebook (DAG) – Chapter 4
- DoD TRR Risk Assessment Checklist
- TRR Standards and Guidelines
- Test and Management Guidebook
- NAVAIR Instruction 4355.19D “Systems Engineering Technical Review”
Updated: 3/179/2024
Rank: G3