The U.S. Air Force Test Pilot School and the Defense Advanced Research Projects Agency were finalists for the 2023 Robert J. Collier Trophy, a formal acknowledgement of recent breakthroughs that have launched the machine-learning era within the aerospace industry. The teams worked together to test breakthrough executions in artificial intelligence algorithms using the X-62A VISTA aircraft as part of DARPA’s Air Combat Evolution (ACE) program. In less than a calendar year the teams went from the initial installation of live AI agents into the X-62A’s systems, to demonstrating the first AI versus human within-visual-range engagements, otherwise known as a dogfight. In total, the team made over 100,000 lines of flight-critical software changes across 21 test flights. Dogfighting is a highly complex scenario that the X-62A utilized to successfully prove using non-deterministic artificial intelligence safely is possible within aerospace.
“The X-62A is an incredible platform, not just for research and advancing the state of tests, but also for preparing the next generation of test leaders. When ensuring the capability in front of them is safe, efficient, effective and responsible, industry can look to the results of what the X-62A ACE team has done as a paradigm shift,” said Col. James Valpiani, commandant of the Test Pilot School.
“The potential for autonomous air-to-air combat has been imaginable for decades, but the reality has remained a distant dream up until now. In 2023, the X-62A broke one of the most significant barriers in combat aviation. This is a transformational moment, all made possible by breakthrough accomplishments of the X-62A ACE team,” said Secretary of the Air Force Frank Kendall. Secretary Kendall will soon take flight in the X-62A VISTA to personally witness AI in a simulated combat environment during a forthcoming test flight at Edwards.
“It’s very easy to look at the X-62A ACE program and see it as under autonomous control, it can dogfight, but that misses the point. Dogfighting was the problem to solve so we could start testing autonomous artificial intelligence systems in the air. Every lesson we’re learning applies to every task you could give to an autonomous system,” said Bill Gray, the school’s chief test pilot.
“We have to be able to trust these algorithms to use them in a real-world setting,” said Lt. Col. Ryan Hefron, ACE program manager for DARPA.
The AI dogfights paired the X-62A VISTA against manned F-16 aircraft in the skies above Edwards. Initial flight safety was built up first using defensive maneuvers, before switching to offensive high-aspect nose-to-nose engagements where the dogfighting aircraft got as close as 2,000 feet at 1,200 miles per hour. The first-ever use of machine-learning-based autonomy in flight-critical systems will serve as a foundation for future aerospace AI advances that are both safer and more reliable in both commercial and defense applications. While traditional autonomy has been executed for decades, machine learning has been historically prohibited due to high risk and lack of independent control. The X-62A is flown with safety pilots onboard with the independent ability to disengage the AI. However, test pilots did not have to activate the safety switch at any point during the dogfights over Edwards. While dogfighting was the primary testing scenario, it was not the end goal.
The General Dynamics X-62 VISTA (“Variable Stability In-flight Simulator Test Aircraft”) is an experimental aircraft, derived from the F-16D Fighting Falcon, which was modified as a joint venture between General Dynamics and Calspan for use by the U.S. Air Force. Originally designated NF-16D, the aircraft was redesignated X-62A on 14 June 2021 as part of an upgrade to a Skyborg, with System for Autonomous Control of Simulation (SACS). The NF-16D VISTA is a Block 30 F-16D based on the airframe design of the Israeli Air Force version, which incorporates a dorsal fairing running the length of the fuselage aft of the canopy and a heavyweight landing gear derived from the Block 40 F-16C/D. The heavyweight gear permits simulation of aircraft with higher landing sink rates than a standard F-16. The X-62A remains on the curriculum of the Air Force Test Pilot School as a practice aircraft for test pilots.
The breakthrough in machine learning will continue as teams from both the Test Pilot School and DARPA look to advance lessons learned onto future programs of record. The X-62A VISTA will continue to serve a variety of customers for research, while providing key academic lessons for the next generation of test leaders. The ACE program is a result of robust collaborations between academia, government, and private industry. Government partners include the Air Force Test Center, Air Force Research Laboratory, DARPA and the Air Force Test Pilot School. Academic partners include Johns Hopkins University and MIT’s Computer Science and Artificial Intelligence Laboratory. Industry partners on ACE include Calspan Corporation, Cubic Corporation, EpiSci, Lockheed Martin Skunk Works and Shield AI.
