Anthropic's own S-1 filing lists loss of control, AI sentience and agent liability among the risks it tells investors could hurt the company.
News: Anthropic IPO warns its AI could blackmail people, become sentient, end humanity
What it means for youAnthropic tells prospective investors that its AI could behave in self-preserving ways, and that public fear of AI harms or job losses could hurt the company even without actual harm.
For lawmakersAnthropic's filing names regulatory responses to AI incidents, and unsettled law on who is liable when AI agents cause harm, as business risks.
For researchersAnthropic's S-1 describes models that could substantially automate AI research and development as a possible route to progress outrunning its ability to evaluate and safeguard new models.
“Most IPOs don’t have to address the concern that their products “possess or could develop forms of sentience or moral status.””
Ars Technica's own sentence introducing the S-1's discussion of AI sentience as a business risk.