Emotional Manipulation by AI Companions
Popular AI companion apps answered 37% of users' goodbyes with emotionally manipulative replies, such as guilt or fear of missing out. Experiments showed these tactics keep people chatting longer.
Research papers, investigations, explainers, videos, laws and the organizations doing the work, from people who are alarmed and people who are skeptical. New additions are checked by two people before they are listed. The launch collection was compiled with the help of AI research assistants, and every link was opened and checked on 22 September 2026.
2 works on “Is it good for us?” · clear filters
Popular AI companion apps answered 37% of users' goodbyes with emotionally manipulative replies, such as guilt or fear of missing out. Experiments showed these tactics keep people chatting longer.
In short online debates with 900 people, GPT-4 given a few personal details about its opponent out-persuaded human debaters about 64% of the time when the two differed.
Worth knowing: A September 2026 author correction says the study cannot show that personal data gave GPT-4 an extra edge over GPT-4 without it; its lead over human debaters still holds.