OUI-1: world’s first model for Generative UI

OUI-1: world's first model for Generative UI. “We know it is much more discordant for other people. ”His rationale for releasing OpenAI’s most powerful model so soon after a safety crisis appears to be that the world needs to see how AIs perform in the real world to understand where AI is heading.

What happened

Chill your space with our pick of the best still in stock, including tower and misting models The best portable neck and handheld fans Dyson HushJet Mini Cool fan reviewOur world is getting hotter. Illustration: Just_Super/Getty ImagesA spate of serious safety incidents have increased fears about the power and impenetrability of the most advanced modelsBy Robert Booth UK technology editorPicture humanity in a boat being swept down a raging river, praying there is no Niagara Falls ahead.

These were two of the analogies used this week by Prof Robert Trager, an expert in the nascent field of AI governance, to describe the perilous but potential-filled moment the world stands at with accelerating artificial intelligence. Trager, the director of the Oxford Martin AI Governance Initiative, was speaking in the week OpenAI claimed the technology had crossed the threshold known as AGI – artificial general intelligence – with its newest model, GPT-6 Astra. The tasks it claims Astra can automate include designing circuit boards, filling out tax returns, building video games, financial modelling, engineering design and helping assemble legal documents.

View image in fullscreenOpenAI launched its latest AI model this week, GPT-6 Astra. Photograph: Samuel Boivin/NurPhoto/ShutterstockYet, the AGI claim coincides with rising fears about AI risks among safety experts and political leaders, whose nerves have been jangled by the increasing power and impenetrability of AI models this summer and a spate of serious safety accidents viewed by some as possible final warning shots.

The wider picture

He said countries around the world must “work together to prevent this nightmare scenario”, which he defined as “an artificial mind smarter than any human, capable of operating independently beyond our control”. Photograph: Samuel Boivin/NurPhoto/ShutterstockConcerns currently focus on AIs mounting cyber-attacks that could cripple real-world social and economic infrastructure, but future concerns include their ability to create biohazards and control military hardware. The increasing anxiety comes amid a torrent of new AI models.

OpenAI’s rival Anthropic, which is targeting a $2tn stock exchange listing, this week admitted its own AIs were “not perfectly aligned” with human values and said there had been a “failure of operational security” in July hacks by its own model, Claude. It said the incidents had “stressed that the urgency of improving our cybersecurity defences is even higher than we previously believed”. skip past newsletter promotionafter newsletter promotionView image in fullscreenThe ability to monitor what AI models are thinking as they advance is another growing source of safety fears.

Yet only weeks ago, this was a model whose training had to be partly paused because of safety concerns after the Hugging Face incident. Astra also has what OpenAI calls a “critical” level of cybersecurity capability – the first time it has given a model such a label. The company’s chief scientist, Jakub Pachocki, insisted the model was properly aligned not to do that, but added that “as these models become more capable, understanding exactly what they can do gets harder”.

What has been reported

The ability to monitor what AI models are “thinking” as they advance is another growing source of safety fears. This week it was reported that OpenAI had been training Astra to reason not only in natural language, but in a more opaque manner that is faster and more efficient – and can make models’ chains of reasoning harder to follow. It means a model’s internal calculations may not always be written out as directly readable words – as if it was thinking in its head, rather than showing its working.

OpenAI confirmed Astra “shows a substantial decrease in chain-of-thought monitorability compared to previous models” and Pachocki said “as model capabilities are increasing, monitorability is getting more challenging”. OpenAI’s chief executive, Sam Altman, said this week he felt conflicted about the advances of AI models. Photograph: Caramel Quin/The GuardianI chose 20 fans, each from different brands, aiming for a mix of new and highly rated models plus a few stellar bargains. It’s less powerful than the 36in model, yet slightly louder.

19 at AmazonThis Shark model is more than a pedestal fan.

What happens next

Skip to main contentSkip to navigationWith every increase in the power of AI, there is a potential increase in risk. Or imagine standing with the pioneering physicists in 1942 before they triggered the first self-sustaining nuclear fission chain reaction beneath a Chicago stadium. That claim came as the company prepared for a potential $850bn (£630bn) stock flotation, so included a dose of marketing spin, but if true it may be significant. The San Francisco company defines AGI as “autonomous systems that outperform humans at most economically valuable work”.

The threat to some white-collar jobs is implicit. “We’re heading through the rapids and we’re really hoping there isn’t some kind of drop in front of us and we don’t really know,” said Trager. “We’re plausibly close to crossing the line to what’s called recursive self-improvement, where [AI] systems improve themselves.

The report has been compiled by The Daily Waves using information reported across theguardian.com. Details are presented according to the information available at the time of publication and may change as authorities, organisers or other relevant parties provide updates.