The BaseResearcharXiv

Cross-Model In-Context Neurofeedback Reveals (Limited) Activation Control in LLMs

A preprint tests whether language models can control their own activations when shown a score derived from them, which would undermine probe-based misbehaviour detection. Across ten open-weight models, some move their scores but no more than a comparable writer model does.

Open the source ↗

Why it matters

The same thing, for different readers.

For researchers

Bears on whether activation probes can be evaded by models; the design separates task competence from access to own activations.

The question it raises

Asks whether a model has special access to its own internal states.

How the finding was reached

In our words, from the source. Weigh the finding by how it was made.

What was done
In-context neurofeedback sessions with ten open-weight models from five families, 9B to 32B, scores derived from the subject model's activations.
What it found
Some models move their own scores considerably, but no more than a writer of comparable competence moves them.
What it does not show
Open-weight models of 9B to 32B only; the abstract leaves open whether control occurs while processing sentences.
Status
A preprint: not yet peer reviewed

The record

Questions
Can AI systems act beyond what people intended or allowed? · Are AI companies putting stronger safeguards into practice?
People
Davide Baldelli (Wrote it) · Robyn Kozierok (Wrote it) · Mirko Bronzi (Wrote it) · Damiano Fornasiere (Wrote it)
What we read
We have read only the description the publisher gives. No quotations until someone reads the source itself.
Found by
The Radar, run of October 15, 2026, via arxiv-ai-safety-query (tier 1: the source’s own channel or an official record)
Cite this
arXiv, “Cross-Model In-Context Neurofeedback Reveals (Limited) Activation Control in LLMs”, October 14, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-14-in-context-neurofeedback-activation-control
Our notesLight lane: written from title, author and abstract excerpt only; not fetched. Authors listed are those named in triage.