Anthropic releases AI tool deemed too powerful for public

Anthropic has released Claude Fable 5, a version of its AI program Claude Mythos, which the company previously considered too powerful for public use. The tool was initially released privately in April for previewing and testing, raising concerns among technology, finance, and government leaders due to its potential to pose financial security risks. Anthropic said on Tuesday that Fable will be released with safeguards and user limitations in place, acknowledging that 'releasing a model this capable comes with risks.' 'Fable's capabilities exceed those of any model we've ever made generally available,' the company added.

When Mythos was first released to a small group of organizations, Anthropic cited concerns that the tool's intelligence could be used to exploit or hack computer systems. Canadian Finance Minister François-Philippe Champagne told the BBC in April that the attention on Mythos was warranted, in part, because 'it's the unknown, unknown.' Despite Anthropic's ongoing lawsuit against the US Department of Defense over its refusal to accept government use of its AI tools, US government agencies have been testing Mythos. The company is expected to become a public company soon, with a private valuation nearing $1tn.

Anthropic also said on Tuesday that the roughly 150 groups that had been given access to preview Mythos will now have access to Claude Mythos 5, which does not have limitations on cybersecurity or biology, depending on an organization's specific uses. To date, groups and companies using Mythos have reported finding more than 10,000 critical security flaws in their systems. Anthropic said the updated access was limited to a 'small group of cyberdefenders and infrastructure providers' but is expected to go beyond that soon.

'We intend to expand access to Mythos 5 through a broader trusted access program,' the company said. Both Fable and Mythos can work 'unattended' on human commands for longer periods than any previous Claude models. Anthropic co-founder Jack Clark last week told BBC Newsnight that the ability of AI tools was expanding rapidly, and the company thought there should be a way for the public to slow the technology's advancement.

'You want the option to be able to take your foot off the gas and put your foot on the brake,' Clark said. 'Right now, it's like the AI industry has a gas pedal, but it doesn't have a brake pedal.' Why this matters: The release of Claude Fable 5 has significant implications for the AI industry, as it highlights the delicate balance between innovation and safety. With Anthropic's valuation nearing $1tn, the company's ability to demonstrate the capabilities and potential risks of its AI tools will be crucial in shaping the future of the industry.