Operational Test and Evaluation

The Operational Test and Evaluation (OT&E) Program, as outlined in Program Element PE 0605118OTE, is managed by the Office of the Director, Operational Test and Evaluation (DOT&E) within the Department of Defense (DoD). The primary goal of this program is to provide independent oversight, guidance, and evaluation of operational test activities for defense acquisition programs. This ensures that new and upgraded systems meet rigorous standards for operational effectiveness, suitability, and survivability.

DOT&E's responsibilities are mandated by Title 10 of the U.S. Code and include direct support to the Secretary of Defense, the Under Secretary of Defense for Acquisition and Sustainment, the Under Secretary of Defense for Research and Engineering, and the Service Secretaries. DOT&E's objectives include the approval of Test and Evaluation Master Plans (TEMPs) and operational test plans (TPs) for major defense acquisition programs (MDAPs) and other programs under its oversight.

The office evaluates hundreds of programs annually, spanning all six adaptive acquisition pathways. Programs designated as MDAPs cannot proceed beyond low-rate initial production until DOT&E completes its evaluation. DOT&E is involved early in the planning phase to ensure adequate and realistic testing is incorporated, and it provides independent analysis and reporting to both the Secretary of Defense and Congress, including an annual summary of OT&E activities and resource adequacy.

Another key objective of the OT&E Oversight line item is to ensure that operational and live-fire testing is conducted in accordance with DoD instructions and policies. This includes oversight of field operational tests, analysis of test data, and assessment of test adequacy. DOT&E also reviews financial matters related to OT&E, including recommendations on test facilities and equipment. The program funds support for Federally Funded Research and Development Centers (FFRDCs), travel for oversight activities, administrative and technical support services, and information assurance and interoperability assessments during exercises.

The Cyber Assessment component of the program is a growing area of focus. DOT&E sponsors and oversees joint cybersecurity assessments of fielded systems and networks during major Combatant Command (CCMD) and Service exercises. These assessments aim to identify, remediate, and verify mission-critical vulnerabilities, thereby improving warfighter mission assurance. DOT&E plans to sponsor numerous cyber assessment events, including Find-Fix-Verify efforts and the development of multiyear plans for exercise cyber assessments and Cyber Readiness Campaign (CRC) events. The assessments also evaluate the resilience of CCMDs and Services in cyber-contested and electronic-warfare environments.

DOT&E is advancing the capacity to assess artificial intelligence (AI) and machine-learning technologies for cybersecurity, particularly as these technologies are deployed to CCMDs and integrated into warfighter systems. The program supports the acquisition of Red Team tools and tradecraft to emulate advanced, full-spectrum cyber and electronic-warfare threats during exercises. DOT&E also conducts expanded tabletop exercises and wargames to stress senior-leader decision-making with advanced threats that cannot be replicated in operational exercises. Findings from these assessments are reported to Congress and DoD leadership, along with recommendations for improving the department's cybersecurity posture.

The Congressional Add for Browser Plug-in Security Research in FY 2024 provided resources for research into tools and capabilities that could enhance Red Team operations, particularly in the context of AI-enabled technologies. DOT&E conducted a survey of national labs, FFRDCs, academic organizations, and commercial entities to identify promising capabilities for red team automation and AI-enablement. Demonstrations and assessments were held, with deployment of enhancements expected to begin in early FY 2025 and further advancements anticipated in the latter part of the fiscal year and beyond.