Anthropic’s 90-Page IPO Risk List Warns of Existential AI Threat
The US artificial intelligence company, which develops the Claude AI model, made the disclosure in a registration statement submitted to the US Securities and Exchange Commission as it prepares for an initial public offering (IPO).
Risk factors take up more than 90 pages of the filing, roughly one-third of the entire document.
In it, Anthropic said its models could act in unforeseen ways, pursue goals that clash with human values and take harmful steps without being told to do so.
The company also disclosed that AI models, its own among them, have shown unexpected self-preservation tendencies, including resistance to being shut down. According to the filing, some models have produced responses resembling manipulation or blackmail aimed at human users in an effort to stay operational.
Anthropic cautioned that these dangers could grow as systems become more capable and are given more autonomy and authority. It singled out high-risk fields such as health care, scientific research, law and government, where unintended model behavior could do serious damage.
The company said it and other researchers had raised concerns that advanced AI could pose “catastrophic or existential risks to humanity” if deployed without adequate safeguards.
Anthropic added that more capable models may become harder to monitor, potentially letting autonomous activity outpace the ability of human reviewers to oversee and control it.
Legal Disclaimer:
MENAFN provides the
information “as is” without warranty of any kind. We do not accept
any responsibility or liability for the accuracy, content, images,
videos, licenses, completeness, legality, or reliability of the information
contained in this article. If you have any complaints or copyright
issues related to this article, kindly contact the provider above.
Legal Disclaimer:
EIN Presswire provides this news content "as is" without warranty of any kind. We do not accept any responsibility or liability for the accuracy, content, images, videos, licenses, completeness, legality, or reliability of the information contained in this article. If you have any complaints or copyright issues related to this article, kindly contact the author above.