Amazon CEO's reported concerns led to Anthropic model restrictions

Amazon CEO Andy Jassy may have been the source of security concerns that led Anthropic to cut off worldwide access to two models on Friday. The Wall Street Journal reports that Jassy told Treasury Secretary Scott Bessent and other government officials that Amazon researchers used Anthropic’s Claude Fable 5 to obtain information that could be used in cyberattacks. The government subsequently imposed an export control ban on the Fable 5 and Mythos 5 models.

An Amazon spokesperson told the WSJ that while it’s “not uncommon for governments to seek our counsel on potential security risks,” the company does not “share the details of those discussions.” The Information and Reuters similarly reported that Amazon (a major Anthropic investor ) had communicated concerns about the security of Anthropic’s models. David Sacks, Trump’s former AI czar who now co-chairs the President’s Council of Advisors on Science and Technology, offered his own account of the discussions, claiming that “a highly credible trusted partner of both Anthropic and the USG […] came forward with [information about] a jailbreak.” Sacks added, “The Admin asked [Anthropic CEO Dario Amodei] to fix the jailbreak or de-deploy the model. Dario refused.” The reported concerns raised by Amazon CEO Andy Jassy about Anthropic's AI models highlight the growing scrutiny of AI safety and security.

As AI technologies become increasingly powerful and pervasive, the potential risks associated with their misuse have become a pressing concern for governments and industry leaders. The restrictions imposed on Anthropic's models demonstrate the willingness of governments to take action to mitigate these risks. However, this move also raises questions about the balance between AI development and regulation.

For developers and businesses, this means that AI safety and security will need to become a more prominent consideration in the development and deployment of AI models. For consumers, it underscores the importance of transparency and accountability in AI development. Ultimately, the outcome of this situation will likely have far-reaching implications for the AI industry as a whole, and it remains to be seen how Anthropic and other AI developers will adapt to these new regulatory pressures.