The danger of AI is not that it will become conscious and hate us, but that it will become competent and ignore us."
—Eliezer Yudkowsky
A Cambridge working paper co-authored by Geoffrey Hinton and Yoshua Bengio says AI systems could automate most AI research and development within a few years, potentially creating a feedback loop that compresses years of AI progress into months or less.
Anthropic is facing growing political scrutiny after AI researcher Jacob Coxon quit warning that AI companies are racing toward self-improving superintelligence.
Anthropic researcher Jacob Coxon has resigned over concerns that AI companies are racing toward self-improving superintelligence without adequate safeguards. Anthropic alignment lead Evan Hubinger backed Coxon’s warning that AI could kill all humans and said he personally puts the risk above 10% within the next decade.
Meta CEO Mark Zuckerberg says the company will offer free “personal superintelligence” agents to billions of users, with a dynamic auction setting prices for extra compute. He also wants frontier labs and cloud providers to build enough compute that several superintelligences arrive together and can check one another.
