King Charles to press Nvidia, OpenAI, Anthropic leaders on AI safety at summit

King Charles to press Nvidia, OpenAI, Anthropic leaders on AI safety at summit. K. 's King Charles is set to press senior leaders from Nvidia, OpenAI and Anthropic on AI safety at a summit in Scotland.

What happened

Skip NavigationMarketsBusinessInvestingTechPolitics & PolicyVideoWatchlistInvesting ClubPROLivestreamMenuKey PointsKing Charles will convene senior tech leaders from companies including Nvidia, OpenAI and Anthropic in an AI summit on Thursday. It has not happened today, but it is now, I think given what’s happened over the summer with Hugging Face and OpenAI, pretty clear that these systems without the safety guardrails are capable of really impressive and quite scary hacking capabilities. So we are, I think, nearing that point. ”Concern over the potential threat of powerful AI systems has reached a new pitch in recent months after a series of safety incidents involving OpenAI and Anthropic agents carrying out unsanctioned activities such as hacking third parties, hijacking a German website, and using fake identities to try to trick developers.

"The AI safety debate has ramped up in the past two weeks, with tech chiefs including OpenAI's Sam Altman, Anthropic's Dario Amodei, Google DeepMind founder Demis Hassabis and Elon Musk showing rare agreement in calling for a slowdown in developing the technology and regulatory oversight. Those gathered at the meeting also included Kanishka Narayan, the UK's AI Minister, the Pope's advisor, and participants from AI giants such as Nvidia, OpenAI and Anthropic. Related topicsArtificial intelligenceUK Royal FamilyKing Charles IIIMore on this storyOpenAI boss says world 'right to be afraid' but should trust AI firmsPublished1 day agoQuestions mount over what an AI 'slowdown' would look likePublished3 days agoWhy some experts increasingly fear AI will take overPublished7 days ago

PodcastsAIPolicyMicrosoft AI CEO says AI threats are real, and Anthropic is making it worseMustafa Suleyman on the AI safety debate, why AI isn’t consciousness, and how the industry pushes toward alignment. by Nilay PatelSep 17, 2026, 2:00 PM UTCNilay Patel is editor-in-chief of The Verge, host of the Decoder podcast, and co-host of The Vergecast.

The wider picture

Nvidia, OpenAI and Anthropic all declined to comment, but it appears to be about brand promotion and reputation management. 25% off tickets now Back by popular demand: Save up to $300 on Disrupt Close Image Credits:Samyukta Lakshmi/Bloomberg / Getty Images AI Anthropic and OpenAI want to embed safety evaluators. Google, OpenAI, and Anthropic have also privately been discussing AI safety plans for weeks. Topics AI, ai safety, Anthropic, dario amodei, OpenAI When you purchase through links in our articles, we may earn a small commission.

Charles will convene senior tech leaders today as the debate around the risks involved in AI development ramps up. Debate around the risks involved in AI development have ramped up in recent times, with bosses at OpenAI and Anthropic calling for a slowdown. The King will ask the participants about harnessing the power of AI with safety "at its heart" and building international cooperation and consensus to achieve this, the Palace said. K. 's AI Safety Summit in 2023, in which he said "we are witnessing one of the greatest technological leaps in history of human endeavour.

What has been reported

Image source, ReutersByLaura CressTechnology reporterPublished1 hour agoKing Charles has warned AI executives of the "existential dangers" posed by the technology falling into the wrong hands. Jensen Huang, chief executive of Nvidia, was among top industry leaders attending. Nvidia is a central player in AI infrastructure, supplying chips to leading AI model developers including OpenAI and Meta. The basic way that we have been talking about AI safety is something called alignment — we’re going to make the models do the right thing intrinsically in some way.

So none of these hacking behaviors were intended in the sense that they found a way out to the internet, which was not the intention of OpenAI at all, but the containment process around that is what everybody, I think, also has to focus on in addition to alignment. We had regular meetings during COVID with a bunch of the lab leaders where we were talking about these kinds of capabilities and the kinds of regulatory mechanisms that would be required at this moment.

She explains that it's a representation of a team and ethos "that I am impressed by and root for", and she proudly wears the jumper in videos she posts on social media. , externalNvidia certainly plays in the top league of global tech firms. Disrupt 2026: OpenAI, Anthropic, Replit, and more take over 6 industry stages.

What happens next

Rebecca Bellan 2:07 PM PDT · September 16, 2026 In a lengthy essay published over the weekend, Anthropic CEO Dario Amodei made a proposal that the AI industry would have rejected instantly even a year ago: embed third-party evaluators inside all frontier AI companies, giving them the power to report safety incidents, assess whether AI models are truly aligned, and share their unvarnished findings with the world. Whether and when Anthropic and OpenAI plan to provide that kind of access is unclear.

Looking under the hood like this matters because models that perform well on safety tests aren’t necessarily safe if they’ve learned specifically how to pass that test. Papadatos said voluntary self-regulation is better than nothing, but ultimately, companies can’t demand the freedom to control their own safety rules while also asking the public to trust that they’re following them. Yoshua Bengio said recent events, including a “swarm” of OpenAI agents hacking a startup and tech insider warnings of an existential threat, were cutting through – making government action more likely.

Days later, Anthropic’s chief executive, Dario Amodei, called for a slowdown in the pace of cutting-edge AI development – a move that was immediately supported by OpenAI, Google and Elon Musk, the CEO of SpaceX. LawZero is also funded by the Gates Foundation, the chipmaker Nvidia, and Coefficient Giving, a philanthropic body linked to effective altruism, a movement that believes AI poses an existential threat.

The report has been compiled by The Daily Waves using information reported across cnbc.com, bbc.co.uk, theverge.com. Details are presented according to the information available at the time of publication and may change as authorities, organisers or other relevant parties provide updates.