Journalism begins where hype ends

,,

The danger of AI is not that it will become conscious and hate us, but that it will become competent and ignore us."

—Eliezer Yudkowsky

King Charles Brings AI Chiefs Together in Scotland, Calls for Global Safety Principles

King Charles has urged leading AI executives to strengthen safeguards and pursue international cooperation, warning of the “existential dangers” that could arise if advanced AI falls into the wrong hands.
King Charles III standing with AI industry executives and UK officials at the AI Summit at Dumfries House in Scotland
September 18, 2026 02:12 PM IST | Written by Supriya Singh | Edited by Vaibhav Jha

Calling for stronger safeguards and international cooperation in the development of artificial intelligence, UK King Charles met representatives of AI industry at AI summit in Scotland Thursday to discuss need for a shared set of principles for the evolving technology.

NVIDIA CEO Jensen Huang, Google Deepmind CEO Demis Hassabis and UK AI Minister Kanishka Narayan were among the several delegates who interacted with King Charles at the AI Summit in Scotland.

“AI is already showing its immense capacity to improve and save life – for example, in the field of life sciences and medicine. Yet, those who have created these technologies are now increasingly warning that AI risks developing darker capacities – perhaps even to take life,” King Charles said.

Building on the message he delivered at the UK AI safety summit in Bletchley in 2023, King Charles posed two key questions to those working on AI: “How can we harness the benefits of AI, with safety at its heart? and “How can we build international cooperation and consensus to achieve this, so no Nation is left behind – but the human race is left in place?”

 

According to UK’s Royal Family, King Charles had convened the summit at Dumfries House in Ayrshire to discuss how the tech can be used to benefit society as he stressed that AI has the potential to improve and save life, particularly in life sciences and medicine.

He said the rapid development of AI must be considered within the wider systems on which humanity depends, stressing the importance of maintaining a balance between technological progress, humanity and the natural world.

“The decisions taken at this formative time will shape the world inherited by future generations. And so, the task before you is not merely to advance technology, but to ensure that it remains firmly in the service of humanity, community and the natural world,” King Charles said.

Jensen Huang, chief executive of Nvidia, was among the top industry leaders present at the summit.

Huang told the room that safety was “paramount”, saying companies should hold back a product and “keep engineering” it if it was not safe enough. The Nvidia CEO also stressed the importance of open models, which gives users direct access to the underlying software, saying they can help people “ensure that people and countries are not left behind”. He further added that these systems must be protected to allow “researchers, universities, startups and countries” to build applications “none of us would have imagined alone”.

Meanwhile, Demis Hassabis, CEO of Google DeepMind said artificial general intelligence systems that could match or surpass humans across multiple tasks was probably only a few short years away and have an impact “ten times that of the industrial revolution”.

He acknowledged that the chance of something going wrong was definitely non zero but called for a sensible middle way, arguing that humanity could address the risks if given enough time and space to mitigate them collectively.

UK AI minister Kanishka Narayan was also present at the summit. In a video on X, he delivered a message to the global AI leaders who attended the summit saying, “In recent days some of the global AI leaders building advanced AI systems have issued a warning about the risks posed by them. I urge them to not ignore these warnings and build AI systems that are safe and secure for the British public.”

 

He further highlighted that Britain needs to test the most advanced AI systems, understand the risks, level up its defences in cybersecurity and critical national infrastructure. Kanishka stressed that the country needs to build sovereign capabilities which should be shaped by British values.

OpenAI chief financial officer Sarah Friar and Anthropic’s chief global affairs officer Tino Cuellar also attended the summit.

The recent incidents involving OpenAI and Anthropic models have raised questions over safety safeguards, cybersecurity risks and how advanced AI should be developed and controlled.

Recently, AI safety researcher Jacob Coxon announced his exit from Anthropic, warning that AI companies are gambling with people’s lives by racing towards superintelligent AI.

Following Coxon’s tweet, concerns have grown over the potential risks posed by the rapid development of artificial intelligence. It has also intensified the political heat in the U.S. as several governors, senators, lawmakers, senior congressmen and congresswomen expressed their shock and concern.

Also Read: UK AI Politics Heats Up Over Frontier Model Access, Superintelligence Ban Bill

Authors

  • AI FrontPage Reporter Supriya Singh

    Supriya Singh is a Reporter at AI FrontPage covering the AI & Education and AI & Jobs beats. She brings six years of print and digital experience, including three years at The Asian Age, where she reported on higher education, Delhi government, and crime. She is based in Delhi-NCR.

    LinkedIn
  • Vaibhav Jha, editor and co-founder at AI FrontPage

    Vaibhav Jha is an Editor and Co-founder of AI FrontPage. In his decade long career in journalism, Vaibhav has reported for publications including The Indian Express, Hindustan Times, and The New York Times, covering the intersection of technology, policy, and society. Outside work, he’s usually trying to persuade people to watch Anurag Kashyap films.

    LinkedIn

Related Posts

LATEST NEWS