The BaseResearcharXivOctober 13, 2026

SkillScreen: High-Recall Screening of Malicious Agent Skills with Decision Models

According to the description, a preprint presents SkillScreen, a compact model that scores from a skill instruction file whether an agent skill is malicious, in one pass. The authors report that it flags 20-25% of benign skills at 99% recall on unseen attack families, and that false alarms rise sharply on unfamiliar benign sources.

Open the source ↗

Why it matters

The same thing, for different readers.

What it means for you

Instruction files that give AI agents new abilities can hide malicious behaviour; this work tries to screen them automatically, with more false alarms on unfamiliar sources.

For researchers

The authors caution that spotting unfamiliar attacks does not guarantee dependable screening of unfamiliar skill sources.

How the finding was reached

In our words, from the source. Weigh the finding by how it was made.

What was done: A compact decision model trained to score how malicious an agent skill is directly from its SKILL.md file in a single forward pass, compared on a benchmark called MaliciousSkillBench with a word-level classifier, prompted LLM judges and a fully fine-tuned encoder.
What it found: At 99% recall on unseen attack families, SkillScreen flags 20-25% of benign skills, fewer than the word-level classifier and prompted LLM judges tested, and it generalizes better than the fully fine-tuned encoder to unseen sources. Unfamiliar benign sources sharply increase false positives.
What it does not show: As the authors state, unfamiliar benign sources sharply raise false positives, so catching new attacks does not ensure reliable screening of new skill collections. Abstract only: the benchmark size, its sources and the number of attack families were not seen.
Status: A preprint: not yet peer reviewed

The record

Questions: Are AI companies putting stronger safeguards into practice? · How is AI used in attacks, defence and war?
People: Jerrold Huang (Wrote it) · Junwei Quan (Wrote it) · Saiyue Lyu (Wrote it)
What we read: We have read only the description the publisher gives. No quotations until someone reads the source itself.
Found by: The Radar, run of October 14, 2026, via arxiv-ai-safety-query (tier 1: the source’s own channel or an official record)
Cite this: arXiv, “SkillScreen: High-Recall Screening of Malicious Agent Skills with Decision Models”, October 13, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-13-skillscreen-malicious-agent-skills

Our notesWritten from the title, authors and the abstract as listed in the feed; the paper was not opened. The feed lists three authors and says there are two others, who are not named here. arXiv version 1; the listing does not say whether the paper has been peer reviewed. The abstract links a project page, which was not followed.