The BaseResearcharXiv
TLRS-DPO: Token-Level Risk Scoring for Better Direct Preference Optimization
According to the abstract, Suxin Ji and Hungtao Wan propose TLRS-DPO, which adds token-level risk scores to DPO training so only high-risk tokens in rejected responses are penalised, and report better alignment and safety with minimal cost to helpfulness.
Why it matters
The same thing, for different readers.
For researchers
Suxin Ji and Hungtao Wan aim to locate unsafe patterns inside otherwise acceptable responses; the claimed gains come from the authors' own experiments.
The record
- Questions
- Are AI companies putting stronger safeguards into practice?
- People
- Suxin Ji (Wrote it)
- What we read
- We have read only the description the publisher gives. No quotations until someone reads the source itself.
- Found by
- The Radar, run of November 8, 2026, via
arxiv-ai-safety-query(tier 1: the source’s own channel or an official record) - Cite this
- arXiv, “TLRS-DPO: Token-Level Risk Scoring for Better Direct Preference Optimization”, November 8, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-11-08-tlrs-dpo-token-level-risk
Our notesLight lane: written from the triage excerpt only.