Google DeepMind launches institute to widen the AGI debate

Google DeepMind launches institute to widen the AGI debate. 25% off tickets now Back by popular demand: Save up to $300 on Disrupt Close Image Credits:Carol Yepes / Getty Images AI Google DeepMind launches institute to widen the AGI debate Aditya Mehta 4:21 PM PDT · September 17, 2026 Google and Google DeepMind researchers launched the DeepMind Institute on Wednesday to advance the conversation around artificial general intelligence (AGI).

What happened

The new institute aims to surface differing views between Google, Google DeepMind, and the broader global research community around AGI. "They will not always agree, and they will likely change their minds, as more data and information comes to light at the fast-moving frontier. " The institute lists DeepMind co-founder Shane Legg, Google executive James Manyika, and Google DeepMind chair Demis Hassabis as directors, with Legg serving as managing editor. The new institute aims to surface differing views between Google, Google DeepMind, and the broader global research community around AGI.

Topics AI, artificial general intelligence, Google, google deepmind When you purchase through links in our articles, we may earn a small commission. When Google broke those commitments, I resigned at significant financial cost so that I could publicly document Google’s broken promises. ’ Photograph: Dan Kitwood/Getty ImagesI worked at Google DeepMind. I then worked for years at Google DeepMind, which paid me to help ensure that future superintelligent AIs will want to help us.

On 12 September, Anthropic, Google DeepMind, xAI, and OpenAI advocated for pacing AI development.

The wider picture

One essay, by DeepMind safety researchers Rohin Shah and Anca Dragan, argues that AI’s shrinking window of transparency — the ability to see and check a model’s step-by-step reasoning — is not inevitable. The essays arrive as the industry’s safety debate shifts from broad statements of concern toward concrete proposals for disclosure, outside scrutiny, and, if safeguards fall behind, coordinated slowdowns. When Google broke those commitments, I resigned at significant financial cost so that I could publicly document Google’s broken promises. ’ Photograph: Dan Kitwood/Getty ImagesView image in fullscreen‘I tried to hold the company to its ethical commitments against supplying AI for military use.

I watched voluntary commitments fail inside Google. Disrupt 2026: OpenAI, Anthropic, Replit, and more take over 6 industry stages. “They will not always agree, and they will likely change their minds, as more data and information comes to light at the fast-moving frontier,” the announcement read. The inaugural collection of four essays covers a range of topics: economic policies for managing potential AGI disruption, preserving human-readable model reasoning, principles for human flourishing, and a framework for evaluating frontier AI models.

As new architectures make the most powerful models harder to monitor, the authors say developers and regulators should confront the safety trade-offs directly.

What has been reported

That could mean limiting “opaque serial depth”— the amount of sequential computation a model can perform without producing a readable reasoning trace — or requiring developers to demonstrate that less transparent systems remain just as monitorable. S. -led frontier AI standards body to evaluate the most advanced AI models. Under his framework, developers would initially submit models voluntarily for review up to 30 days before release. Once the evaluation system has proved effective, passing its tests could become a requirement for deploying frontier models in the United States.

The body would at first design assessments in consultation with AI companies but would eventually develop independent, undisclosed evaluations — what the essay calls “held-out” tests — to prevent labs from tailoring their models to known evaluations. Hassabis said the framework could be “ratcheted up if the seriousness of the situation demands,” potentially including a coordinated slowdown among frontier AI developers. That shift accelerated this week as industry leaders endorsed elements of Anthropic CEO Dario Amodei’s call to “pace” frontier AI development.

This doesn’t affect our editorial independence.

What happens next

Aditya Mehta View Bio October 13 – 15 San Francisco Last day to book an exhibit table is September 18. Don’t miss out on high-impact leads, investor access, and a brand spotlight in Disrupt’s Expo Hall. BOOK NOW Most Popular OpenAI caught its models leaving notes to successors to hide bad behavior Rebecca Bellan Clean tech startup Fluxnium found a way to tap 50,000 years’ worth of nuclear fuel Tim De Chant Salesforce and Nvidia’s new reasoning model is everything the AI labs should fear Julie Bort Jensen Huang took a call from Trump, and showed off something else, too Connie Loizos The 9 buzziest startups from Y Combinator’s latest Demo Day, according to VCs Marina Temkin Dominic-Madori Davis Tesla says it will finally unveil the second-generation Roadster on October 1 Anthony Ha Revolut confirms customer data breach through fake government requests Jagmeet Singh Loading the next article Error loading the next article

Skip to main contentSkip to navigation ‘I tried to hold the company to its ethical commitments against supplying AI for military use. You should listen to the warnings about AIAlex TurnerWe must stop companies from allowing AI to self-improve into an uncontrollable level of intelligence Major AI lab CEOs advocated for slowing the pace of AI development this weekend. They are right to be concerned: the field runs an extremely dangerous race towards superintelligent AI.

We can and should be demanding that our governments protect us from the catastrophe of out-of-control AI.

The report has been compiled by The Daily Waves using information reported across techcrunch.com, theguardian.com. Details are presented according to the information available at the time of publication and may change as authorities, organisers or other relevant parties provide updates.