The BaseResearcharXiv
Jev-Guard: Fast Routing and Auditing Agent Actions over Editable Policy Trees
According to the description, a preprint presents Jev-Guard, a model that picks the applicable audit policy from an editable policy tree and then classifies an agent action for safety. The authors report 93.72% safety accuracy and 58ms mean latency on 7,033 cases, and that a permission gate cut mean review time per task from 4.80s to 1.33s.
Why it matters
The same thing, for different readers.
For researchers
Addresses the latency of LLM-based guardrails on agent actions, with policies users can edit; the figures come from the authors, on 7,033 evaluation cases.
How the finding was reached
In our words, from the source. Weigh the finding by how it was made.
- What was done
- A unified guardrail model, Jev-Guard, that first navigates an editable policy tree (covering content moderation, cybersecurity, privacy and legal compliance) to choose the audit policy that applies to the audit context of the caller, then classifies safety conditioned on that policy. It was evaluated on 7,033 cases and integrated into the Hermes harness framework, where a separate permission gate was compared with an SFT-LLM judge across agent trajectories.
- What it found
- 93.72% safety accuracy, 58ms mean latency and 93.10% hierarchical routing accuracy; the full routing-and-classification pipeline averages 240ms. In the harness, the permission gate cut mean review time per task from 4.80s for an SFT-LLM judge to 1.33s. The sentence about policy violations is cut off in the listing.
- What it does not show
- The abstract is cut off mid-sentence, so the statement on policy violations and any limits the authors state were not seen. The abstract does not say how the 7,033 evaluation cases were built or whether they are independent of the training data.
- Status
- A preprint: not yet peer reviewed
The record
- Questions
- Are AI companies putting stronger safeguards into practice?
- People
- Wenbin Hu (Wrote it) · Huihao Jing (Wrote it) · Haochen Shi (Wrote it)
- What we read
- We have read only the description the publisher gives. No quotations until someone reads the source itself.
- Found by
- The Radar, run of October 14, 2026, via
arxiv-ai-safety-query(tier 1: the source’s own channel or an official record) - Cite this
- arXiv, “Jev-Guard: Fast Routing and Auditing Agent Actions over Editable Policy Trees”, October 13, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-13-jev-guard-agent-policy-routing
Our notesWritten from the title, authors and the abstract as listed in the feed; the paper was not opened. The feed lists three authors and says there are nine others, who are not named here. The abstract is cut off mid-sentence. arXiv version 1; the listing does not say whether the paper has been peer reviewed.