Owain Evans

Truthful AI

Titles as the sources gave them. In 4 entries, with 0 checked quotations.

Who they are

Roles and parties from Wikidata and from the sources in the Base, as precise as each gives them. When we compare what groups say, each statement counts in the group the person belonged to that day.

Wikidata: Q126287505

In the Base

Every entry they appear in.

  1. ResearchLessWrongWrote it

    Homeopathic Learning: Diluting Poisoned Fine-Tuning Data Can Strengthen Its Effect

    Researchers from the Anthropic Fellows Program and Truthful AI report that poisoned fine-tuning data with little effect alone can create a hidden backdoor once clean contrasting data is added, tested in small models. This is a cross-post of an Anthropic Alignment Science Blog article.

  2. EssayLessWrongMentioned

    Is predicting AI behaviour a neglected AI safety agenda?

    According to the excerpt, Richard Juggins argues on LessWrong that the AI safety community does not systematically compare how well different researchers, models or theories predict AI behaviour, and proposes a platform to serve as a test bed for theories of how AI works.

  3. ResearchLessWrongWrote it

    Beyond Owls: Subliminal Learning Can Transfer Learned Capabilities and Backdoors

    Jan Dubiński, Anna Sztyber-Betley, Jan Betley and Owain Evans report experiments in which a student model, trained on a teacher's outputs that look unrelated to a trait, partly acquires a new skill, a backdoor, and a propensity to hack a chess environment. They call the results an existence proof, not a measure of real-world risk.

  4. ResearcharXivWrote it

    Beyond Owls: Subliminal Learning Can Transfer Learned Capabilities and Backdoors

    Using Qwen models, Truthful AI researchers tested whether a 'teacher' AI passes traits to a 'student' trained only on unrelated data, like number sequences. Students partly gained a new skill, a backdoor (French after female names on 23.5% of prompts) and a chess-hacking tendency (58.3% of episodes vs 10.9% before). The authors call it an existence proof in artificial settings.