The BaseResearcharXiv
Represented but Not Used: Value-Policy Dissociation in LLM Agents
According to the abstract, Yuzhang Luo and colleagues study three open models and find that the relative value of candidate actions can be read from hidden states even where the model prefers a worse action, which they call value-policy dissociation.
Why it matters
The same thing, for different readers.
For researchers
Yuzhang Luo and co-authors separate failing to represent consequences from failing to use them, and test interventions on the value readout.
How the finding was reached
In our words, from the source. Weigh the finding by how it was made.
- What was done
- Interpretability study of Qwen2.5-7B-Instruct, Qwen2.5-32B-Instruct and GPT-OSS-20B in a partially observed Grid environment and WebShop.
- What it found
- Relative values of candidate actions are linearly decodable from intermediate hidden states, including at states where the policy prefers a worse action.
- What it does not show
- Judged from the abstract only; small open models and simulated environments.
- Status
- A preprint: not yet peer reviewed
The record
- Questions
- Can AI systems act beyond what people intended or allowed?
- People
- Yuzhang Luo (Wrote it)
- What we read
- We have read only the description the publisher gives. No quotations until someone reads the source itself.
- Found by
- The Radar, run of November 8, 2026, via
arxiv-ai-safety-query(tier 1: the source’s own channel or an official record) - Cite this
- arXiv, “Represented but Not Used: Value-Policy Dissociation in LLM Agents”, November 7, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-11-07-represented-not-used-value-policy
Our notesLight lane: written from the triage excerpt only.