Security

US military cancels China operation due to AI error

3 min read

TL;DR Too Long; Didn’t read

An AI chatbot of the US armed forces confused the cargo of a Chinese ship with nuclear weapon-related components in spring 2026, which nearly led to an armed incident with China. CNN reported the incident on September 18, 2026, citing multiple sources from the US defense apparatus. Officers stopped the already initiated operation at the last minute.

A digital crosshair made of shattered pixels hovers between a warship and a cargo ship on the open sea, while fighter jets circle overhead Image generated with GPT Image 2

Key takeaways

  • US Special Operations Command used an AI chatbot to evaluate ship cargo in the Iran war in spring 2026.
  • The chatbot incorrectly attributed the cargo to a nuclear weapons program, CNN reported on September 18.
  • Armed soldiers and fighter jets were already on standby before officers discovered the error.
  • Defense Secretary Pete Hegseth is considered a particularly bold advocate for military AI.
  • An AI-assisted targeting system reportedly contributed to a deadly school attack as early as February, according to Bloomberg.
  • The Pentagon has not yet officially commented on the incident.

A US military AI chatbot mistakenly classified the cargo of a Chinese freighter as material for a nuclear weapons program in the spring of 2026, CNN reported on September 18. Armed soldiers were already preparing a boarding operation, and fighter jets were already in the air when officers noticed the error at the last minute.

Two AI queries generate an official-looking report

According to CNN, an analyst from the Special Operations Command in the Pacific initially used the chatbot to cross-reference open sources with classified signals intelligence on a Chinese freighter. The system misread entries on the cargo manifest and assigned the cargo to components for a nuclear weapons program. In a second step, the analyst used the same chatbot to format the erroneous results into the style of a regular intelligence report. Neither the manifest nor the origin of the alleged components was verified by a second person before it was forwarded. This formally official document then spread through military command channels without anyone rechecking the underlying raw data. Senior commanders trusted the presentation of the report and approved a boarding action against the ship, because an AI-formatted report was hardly distinguishable from one written by a human. The command has reportedly been using chatbots on a trial basis for months to speed up the analysis of raw data; a binding approval process for their results was missing in this case, however.

Fighter jets are already in the air when the error surfaces

Armed US soldiers were preparing to board the ship, and combat aircraft were already taking off. Only a subsequent review of the intelligence data revealed that the chatbot had misidentified the cargo; the operation was aborted at the last minute. A person involved in the intelligence work described the original report to CNN as entirely false and said it “almost started a war” – it remains unverified what was actually on board the ship. A boarding action against a Chinese merchant vessel would have carried the risk of a direct military confrontation between the two nuclear powers, in the middle of the ongoing US war against Iran, which had begun on February 28, 2026. CNN does not name any publicly known consequences for the analyst or the commanders involved. The incident took place against the backdrop of a growing role for AI in military operations: just in July, the US Navy had presented its own AI strategy for warships, which aims to feed sensor data more directly into combat decisions.

Hegseth pushes AI use, critics call for oversight

Defense Secretary Pete Hegseth is said to be pushing the use of AI at the Pentagon especially hard. Critics see the near-miss as part of a broader pattern of insufficient human oversight of AI-assisted military decisions in the ongoing war. On the very first day of the war, February 28, 2026, a targeting system supported by the Maven Smart System software is said to have contributed to an airstrike on a school in Minab that killed more than 120 children; a Bloomberg investigation documents the case, and a UN investigation assessed the attack in mid-September as potentially unlawful. GovAI researcher and Army veteran Jake Steckler argues, according to TechCrunch, that service members need to understand the uncertainty inherent to large language models – the answer is not less AI use, but better oversight. Together, the two incidents are fueling a debate in Washington over how much trust commanders should place in automatically generated documents without verification.

What matters now is whether the Pentagon responds to the incident by introducing binding review steps for AI-assisted intelligence reports before commanders can use them for operational decisions. So far, the Department of Defense has not commented publicly on the report. It also remains unclear what cargo was actually on board the Chinese ship – according to CNN, that has not been established.

Frequently asked questions

Which AI chatbot was used for the report?

CNN does not name a specific AI model or product in its research, but merely describes an internal chatbot of the special operations command.

How did the Pentagon respond to the incident?

An official statement from the Department of Defense has not yet been issued; CNN cites several internal sources.

Was it the only AI-related incident in this war?

No: according to Bloomberg research, an AI-assisted targeting system is said to have contributed to a serious airstrike on a school on the first day of the war, which a UN investigation in September classified as potentially unlawful.

Has anyone been held accountable for the erroneous report?

Publicly known consequences for the analyst or involved commanders have not yet been documented.

What do experts demand as a consequence?

GovAI researcher Jake Steckler advocates for better educating military personnel about the uncertainties of language models and implementing binding review steps, instead of stopping the use of AI altogether.

Sources (4)
  1. CNN: US military had close call after using AI for false intelligence report
  2. TechCrunch: AI hallucination nearly triggers US military operation
  3. Gizmodo: US military nearly boarded a Chinese ship based on bad intel from AI
  4. Bloomberg: Inside the US Military 'Kill Chain' That Destroyed an Iranian School

Your AI update for the work week

Once a week, the most important AI news – plus one practical tip to try right away. No spam, unsubscribe anytime.

← Back to the blog