Sunita Verma
CTO of Ironclad; former Google executive
Titles as the sources gave them. In 1 entry, with 4 checked quotations.
What they said
Newest first. Each quotation was found word for word in the source.
“The same technical limits preventing these machines from scaling to superintelligence make the risk of catastrophic outcomes very real.”
“Once it commits to an approach, it keeps refining step-by-step, with no built-in incentive to ask whether the whole direction has reached a dead end. If a hack is discovered, the machine is designed to exploit it, not explore an alternative approach.”
“Instead of debating the possibility of superintelligence or malicious intent, we need to focus our discussion on the immediate shape of oversight for these models, perhaps by leveraging existing frameworks.”
“For example, when a plane crashes, the National Transportation Safety Board, not the manufacturer or the airline, investigates, and its findings shape how every airline flies.”
In the Base
Every entry they appear in.
Today’s AI won’t achieve superintelligence. But catastrophic risk is real
In a Guardian opinion piece, Sunita Verma, chief technology officer of Ironclad and a former Google executive, argues that large language models will not scale to superintelligence but are still dangerous, because they keep pursuing an approach once chosen. Verma calls for independent investigation and oversight, modelled on air-crash investigation.