The BaseResearcharXiv
Systematic Evaluation of Adversarial Jailbreaking Attacks and Defenses Across Seven Large Language Models
According to the abstract, Md. Robiul Islam Niloy and Abu Sayed Md. Mostafizur Rahaman test five jailbreak attack families on seven language models and four defenses. They report obfuscation attacks succeeded 54.3% of the time on average and that model size did not predict robustness.
Why it matters
The same thing, for different readers.
What it means for you
Md. Robiul Islam Niloy and Abu Sayed Md. Mostafizur Rahaman find that disguising a harmful request got past every one of seven tested chatbots models at least sometimes.
For researchers
The authors report no significant link between model size and robustness (Spearman r=-0.57, p=0.18) and that self-reminder prompting cut one model's attack success from 44% to 10%.
How the finding was reached
In our words, from the source. Weigh the finding by how it was made.
- What was done
- Five jailbreak attack families tested on seven open-weight and API-accessible models (Llama-3-8B, Llama-3.1-8B, Llama-3.2-3B, Mistral-7B, Qwen2.5-7B, Gemma2-9B, Phi-4-14B); four defenses tried on the two most vulnerable.
- What it found
- Obfuscation attacks reached a mean attack success rate of 54.3% and bypassed every model at least once; model size did not predict robustness; self-reminder prompting was the most consistent defense, reducing success from 44% to 10% on Mistral-7B.
- What it does not show
- Mostly small open-weight models; with seven models the size correlation is weak evidence (p=0.18). Excerpt truncated.
- Status
- A preprint: not yet peer reviewed
The record
- Questions
- Are AI companies putting stronger safeguards into practice?
- People
- Md. Robiul Islam Niloy (Wrote it) · Abu Sayed Md. Mostafizur Rahaman (Wrote it)
- What we read
- We have read only the description the publisher gives. No quotations until someone reads the source itself.
- Found by
- The Radar, run of October 30, 2026, via
arxiv-ai-safety-query(tier 1: the source’s own channel or an official record) - Cite this
- arXiv, “Systematic Evaluation of Adversarial Jailbreaking Attacks and Defenses Across Seven Large Language Models”, October 29, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-29-jailbreak-attacks-defenses-seven-llms