The BaseResearcharXiv
Is 4-Bit Quantization More Than Noise to a Chat Model's Safety Behaviour? Attributing Behavioural Shifts with Matched Perturbations
According to its abstract, a preprint by Ege Kaya tests whether shrinking chat models to 4-bit weights changes their refusal behaviour. In a pre-registered study of three 3-4B models, the author reports shifts of opposite sign and concludes each compressed build must be checked on its own.
Why it matters
The same thing, for different readers.
What it means for you
AI models that run on phones and laptops are usually compressed copies, and one study reports that compression can change how often a model refuses harmful requests.
For researchers
Ege Kaya reports in a pre-registered study that refusal shifts under 4-bit quantization depend on the specific rounding error, not on bits per weight or likelihood.
How the finding was reached
In our words, from the source. Weigh the finding by how it was made.
- What was done
- A pre-registered study of three 3-4B chat models with paired tests, blind human labels and an 8-bit null, comparing real 4-bit rounding error with shuffled, Gaussian and scaled versions of the error.
- What it found
- The author reports two 4-bit shifts of opposite sign: Qwen2.5-3B continues into harmful content more often when a compliant reply is prefilled, and Llama-3.2-3B complies 10.3 points less often on held-out jailbreaks.
- What it does not show
- Only three small models were studied; the abstract notes that llama.cpp's Q4_K_M at the same bits per weight moved neither model.
- Status
- A preprint: not yet peer reviewed
The record
- Questions
- Are AI companies putting stronger safeguards into practice? · How is AI changing childhood, health and daily life?
- People
- Ege Kaya (Wrote it)
- What we read
- We read the abstract.
- Found by
- The Radar, run of November 18, 2026, via
arxiv-ai-safety-query(tier 1: the source’s own channel or an official record) - Cite this
- arXiv, “Is 4-Bit Quantization More Than Noise to a Chat Model's Safety Behaviour? Attributing Behavioural Shifts with Matched Perturbations”, November 17, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-11-17-4bit-quantization-safety-behaviour
Our notesLight lane: excerpt was nearly the full abstract; paper not fetched.