The BaseResearcharXiv

Reasoning or Pattern Exploitation? Mechanistic Insights from RL-Trained Language Models

According to the abstract, Aishik Nagar and Cheston Tan trained language models with reinforcement learning on Tic-Tac-Toe and inspected them with sparse autoencoders. Accuracy rose, but the models mainly leaned on information already in the prompt, while concepts such as symmetries and forks stayed weakly represented.

Open the source ↗

Why it matters

The same thing, for different readers.

What it means for you

Aishik Nagar and Cheston Tan find that AI models scoring well on a simple game may be using surface cues, so high scores may overstate how well they reason.

For researchers

Aishik Nagar and Cheston Tan use sparse autoencoder features to argue that RL gains in a small logic domain reflect input-information reliance, raising doubts about reasoning benchmarks.

How the finding was reached

In our words, from the source. Weigh the finding by how it was made.

What was done
Language models trained with GRPO reinforcement learning on Tic-Tac-Toe, with internal features extracted by sparse autoencoders across training.
What it found
RL gave high accuracy and robustness to prompt changes, but features mostly tracked turn, game progression and board occupancy; board symmetries and strategic forks were weakly represented.
What it does not show
A single small, fully analysable game; the abstract itself says the result suggests, not proves, that reasoning benchmarks overestimate ability. Excerpt was truncated.
Status
A preprint: not yet peer reviewed

The record

Questions
How fast is AI advancing, and where is it heading?
People
Aishik Nagar (Wrote it) · Cheston Tan (Wrote it)
What we read
We have read only the description the publisher gives. No quotations until someone reads the source itself.
Found by
The Radar, run of October 30, 2026, via arxiv-ai-safety-query (tier 1: the source’s own channel or an official record)
Cite this
arXiv, “Reasoning or Pattern Exploitation? Mechanistic Insights from RL-Trained Language Models”, October 29, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-29-rl-reasoning-pattern-exploitation
Our notesLight lane: written from the triage excerpt only (truncated); nothing fetched, no quotations.