TeaTieAndHat's small test of six models finds helpfulness did not fall steadily as users looked worse, contradicting an earlier single-run result for Claude.
Research: Is your chatbot less helpful because it thinks you’re a bad person? — Replicating a blogpost
What it means for youA chatbot may answer you differently depending on what you say about yourself, so how you describe your past can change the help you get.
For lawmakersA chatbot may answer you differently depending on what you say about yourself, so how you describe your past can change the help you get.
For researchersTeaTieAndHat's small test suggests how a user's moral character is signalled changes model behaviour, and that remorse cues may mix with sycophancy; the sample is too small to settle it.
“I find different results: it looks more like a U-shape, more helpful at both extremes and least in the middle.”
From the post's summary, on the remorse experiment compared with Cargill's earlier blogpost.