Military AI does exactly what experts feared

In a 19-minute video from the Future of Life Institute, Katrina Manson, author of a book on Project Maven, describes how the US military's AI targeting system grew, the role of human approval, civilian harm, Anthropic's dispute with the Pentagon, and plans for autonomous drone swarms.

About Anthropic or ClaudeClaude, made by Anthropic, wrote this entry. It follows the same rules as every other entry, whoever the entry is about.

Why it matters

The same thing, for different readers.

What it means for you

Katrina Manson says the US military's AI targeting system is now in every combatant command, and that the human approving a strike is under growing pressure to just click accept.

For lawmakers

Manson says a Pentagon targeting document revised in April 2026 contemplates AI identifying, selecting and striking targets without human intervention, which sharpens the question of where accountability sits.

The question it raises

Manson asks whether having a human decide is enough when the rest of the targeting cycle has been sped up around that person, or whether meaningful control means something more.

In their own words

Every quotation was found, word for word, in the text we saved from the source. That shows the words are there; it does not make them true, or prove the speaker meant them as quoted.

From YouTube’s automatic captions, which carry no speaker names and can mishear words. Where the speaker is known only from context, the quotation says so.

“Anthropic decided that they had two red lines. AI should not be used in fully autonomous weapon systems and it should be not be used for domestic mass surveillance”
Katrina Manson, author, Project Maven: A Marine Colonel, His Team, and the Dawn of AI WarfareManson on the dispute between Anthropic and the Pentagon.
Found word for word in the sourceHear it at 13:40 ↗Speaker known from context, not confirmed by listening
“Anthropic actually applied. It didn't think it broke its red lines even though it is an autonomous drone that is voice controlled.”
Katrina Manson, author, Project Maven: A Marine Colonel, His Team, and the Dawn of AI WarfareManson on Anthropic entering the Pentagon's prize challenge for voice-controlled autonomous drone swarms.
Found word for word in the sourceHear it at 17:29 ↗Speaker known from context, not confirmed by listening
“But this was rejected because nobody wanted to stake their career and the lives of others on an AI generated slant count, which obviously is prone to hallucination.”
Katrina Manson, author, Project Maven: A Marine Colonel, His Team, and the Dawn of AI WarfareManson on why Special Operations Command rejected an early idea of using AI to estimate who is near a target.
Found word for word in the sourceHear it at 10:42 ↗Speaker known from context, not confirmed by listening

The record

Questions
How is AI used in attacks, defence and war? · Can AI systems act beyond what people intended or allowed? · Who can demand evidence, delay a release or stop an unsafe deployment?
People
Katrina Manson (Speaks, author, Project Maven: A Marine Colonel, His Team, and the Dawn of AI Warfare) · Dario Amodei (Mentioned) · Alex Karp (Mentioned)
What we read
We read the whole source.
Found by
The Radar, run of November 18, 2026, via yt-future-of-life-institute-youtube (tier 1: the source’s own channel or an official record)
Cite this
Future of Life Institute, “Military AI does exactly what experts feared”, November 17, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/fli-2026-11-17-manson-military-ai-maven
Our notesYouTube auto-captions with no speaker names, and the video mixes Manson's narration with archive clips of other people (Karp, Mattis, Amodei and others), so Manson is the speaker only by the description and context: speakerCertain false. 'slant count' is the caption's wording and may be a mis-hearing; check against audio. The video is an excerpt from an earlier FLI interview (source link in its description). Claims about Anthropic and Claude (Maven, the drone contest) are Manson's and were not checked elsewhere; Anthropic is the subject, so an editor should review.