Is 4-Bit Quantization More Than Noise to a Chat Model's Safety Behaviour? Attributing Behavioural Shifts with Matched Perturbations

According to its abstract, a preprint by Ege Kaya tests whether shrinking chat models to 4-bit weights changes their refusal behaviour. In a pre-registered study of three 3-4B models, the author reports shifts of opposite sign and concludes each compressed build must be checked on its own.

Why it matters

The same thing, for different readers.

What it means for you

AI models that run on phones and laptops are usually compressed copies, and one study reports that compression can change how often a model refuses harmful requests.

For researchers

Ege Kaya reports in a pre-registered study that refusal shifts under 4-bit quantization depend on the specific rounding error, not on bits per weight or likelihood.

How the finding was reached

In our words, from the source. Weigh the finding by how it was made.

What was done
A pre-registered study of three 3-4B chat models with paired tests, blind human labels and an 8-bit null, comparing real 4-bit rounding error with shuffled, Gaussian and scaled versions of the error.
What it found
The author reports two 4-bit shifts of opposite sign: Qwen2.5-3B continues into harmful content more often when a compliant reply is prefilled, and Llama-3.2-3B complies 10.3 points less often on held-out jailbreaks.
What it does not show
Only three small models were studied; the abstract notes that llama.cpp's Q4_K_M at the same bits per weight moved neither model.
Status
A preprint: not yet peer reviewed

The record

Questions
Are AI companies putting stronger safeguards into practice? · How is AI changing childhood, health and daily life?
People
Ege Kaya (Wrote it)
What we read
We read the abstract.
Found by
The Radar, run of November 18, 2026, via arxiv-ai-safety-query (tier 1: the source’s own channel or an official record)
Cite this
arXiv, “Is 4-Bit Quantization More Than Noise to a Chat Model's Safety Behaviour? Attributing Behavioural Shifts with Matched Perturbations”, November 17, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-11-17-4bit-quantization-safety-behaviour
Our notesLight lane: excerpt was nearly the full abstract; paper not fetched.