What should AI be to us?

Transformer's Celia Ford reports from Eleos AI's September conference on AI consciousness and welfare, where attendees asked what AI should be to people (tool, servant, child, successor) more than how to measure consciousness. Ford argues that laws fixing AI personhood either way are premature.

About Anthropic or ClaudeClaude, made by Anthropic, wrote this entry. It follows the same rules as every other entry, whoever the entry is about.

Why it matters

The same thing, for different readers.

What it means for you

Many people already confide in AI, and Celia Ford argues how people relate to it matters whether or not it is conscious.

For lawmakers

Celia Ford writes that Idaho, North Dakota, Utah and Tennessee have already banned AI legal personhood, and argues that such permanent bans and the opposite are both overconfident.

For researchers

Researchers at Eleos AI's conference, per Celia Ford, are shifting from measuring consciousness toward what humans owe AI; most attendees' informal estimates of AI consciousness were 10 to 50%.

The question it raises

Whether it is acceptable to build willing AI servants, and what counts as human flourishing, were left unspecified at the conference, Celia Ford reports.

In their own words

Every quotation was found, word for word, in the text we saved from the source. That shows the words are there; it does not make them true, or prove the speaker meant them as quoted.

From the source’s own text.

“We might soon have AI systems that are operating free of direct human control. Either intentionally or accidentally, there might be AI agents making their own choices”
Jeff Sebo, director, NYU Center for Mind, Ethics, and PolicySebo, speaking at Eleos AI's conference, argued against permanent legal stances on AI personhood.
Found word for word in the sourceAs quoted in the text we read, not the speaker’s own text or a transcript of their words
“the other 8 billion conscious human beings on the planet have not signed up to this experiment and their moral rights, safety, and welfare are what we have an obligation to protect first and foremost.”
Mustafa Suleyman, CEO of Microsoft AITransformer quotes Suleyman's recent argument that AI developers have no right to bring a new species of conscious beings into the world.
Found word for word in the sourceAs quoted in the text we read, not the speaker’s own text or a transcript of their words
“Perhaps all we can do is leave the door to consciousness open, if only a crack.”
Celia Ford, TransformerFord's closing view, after arguing that bills banning AI personhood, or enshrining it, are overconfident.
Found word for word in the source

The record

Questions
What values should AI have, and could it have a mind of its own? · Who can demand evidence, delay a release or stop an unsafe deployment?
People
Celia Ford (Wrote it) · Jeff Sebo (Speaks, director, NYU Center for Mind, Ethics, and Policy) · Mustafa Suleyman (About them, CEO of Microsoft AI) · Henry Shevlin (Mentioned, philosopher, Google DeepMind) · Jessie Mannisto (Mentioned)
What we read
We read the whole source.
Found by
The Radar, run of November 18, 2026, via transformer (tier 1: the source’s own channel or an official record)
Cite this
Transformer, “What should AI be to us?”, November 17, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/transformer-2026-11-17-what-should-ai-be-to-us
Our notesThe conference polls reported are informal hand-raising polls, not surveys. Suleyman's and Sebo's words are quoted second-hand through Ford; the original sources were not checked.