aisecurity

Axios reported that allies of Trump are attacking Dario Amodei, the CEO of the artificial intelligence company Anthropic, as a representative of the "doomsday" narrative surrounding artificial intelligence and one of the founders of the effective altruism movement. Sources say that during the midterm elections, allies may target Anthropic when countering his warnings about AI safety; due to his political stance and concerns about AI safety, he is seen as an easy target. This is concerning for investors as the company is preparing for an anticipated record-breaking initial public offering.The report states that a memo began circulating internally within the White House this week, attempting to portray effective altruism as a fringe, cult-like group detached from mainstream America, with Axios claiming to have obtained the document. The memo was written by a Trump political advisor not currently employed by the White House, stating that effective altruism "has established a doomsday pipeline for artificial intelligence," placing Amodei at the foundational position of the movement, while also mentioning his sister, Daniela Amodei, president of Anthropic, referring to these connections as "Anthropic nodes." A source close to the government said that Amodei embodies an ideology and globalist innovation path that contradicts the president's "America First" agenda.Anthropic has been distancing itself from effective altruism. Daniela Amodei stated in a 2025 Wired report that she does not agree with the term. Dario Amodei has insisted in interviews that he is not a member of the movement and has promoted the benefits of artificial intelligence.

According to media reports citing informed sources, Anthropic and OpenAI had considered signing a legally binding agreement to conduct stress tests on each other's large models. Earlier this year, the two companies and their legal teams discussed this plan, allowing competitors to deeply test each other's latest available models to identify potential risks or security vulnerabilities. Such tests would only apply to commercially available models, and both parties agreed not to retain each other's data. The report did not clarify whether the two parties ultimately reached such an agreement.Recently, the idea of implementing some form of peer review among top AI laboratories has gained attention. SpaceX CEO Elon Musk suggested last week that several leading large model companies in the United States, along with some Chinese AI companies, should allow competitors to conduct cross-testing. Musk stated: All AI companies have a set of testing tools, and having each company run their tests using another company's tools might be the best thing to ensure their own safety.Earlier this month, Anthropic researcher Jacob Coxon announced his resignation and warned leading artificial intelligence companies about accelerating development without proper safeguards. Subsequently, Anthropic CEO Dario Amodei called for the industry to slow down the pace of AI development and introduce third-party assessment mechanisms. Last Friday, Anthropic announced a partnership with Accenture, with Accenture serving as a third-party assessment agency to evaluate the safety compliance of its cutting-edge AI models.

Zuckerberg stated that every lab has the responsibility and incentive to train models safely at the required speed and has the capability to take action independently. People will not use agents that are not aligned with them or do not act as required, so labs have a strong natural incentive to enhance model alignment. Trust and alignment are rapidly becoming the most important capabilities that distinguish agents from models, and any lab that does not focus on alignment will fall behind.Zuckerberg indicated that labs will face significant liability if their models cause harm, thus there is a strong incentive to prevent this. Meta has postponed the release of Muse by several months to focus on safety and security, and has not asked other labs to follow suit, but rather considers it part of their daily work. Hiring independent evaluators and consultants is an industry best practice, and MSL has been doing this in multiple areas. Allocating most computing power to serve people rather than competing for recursive self-improvement is one of the best ways to ensure the safe development of this technology, and Meta has made this commitment.

Anthropic researcher Jacob Coxon announced his resignation and is preparing to leave the AI industry. He has conducted pre-training research at OpenAI and Anthropic over the past three years. He pointed out that neither company has responsibly advanced AI and are competing to create superintelligence that can continue to enhance its own capabilities, "betting our lives on it."He switched from OpenAI to Anthropic this year because the latter places more emphasis on model safety. Coxon acknowledged that Anthropic's safety work is serious, but believes that as long as companies are racing to be the first to create AGI (artificial general intelligence that surpasses humans in a wide range of tasks), safety compromises are unavoidable, and self-discipline from a single company cannot solve the problem. His assessment of the two companies is: many people inside OpenAI still do not truly realize how great this risk is; Anthropic knows the risks but believes others are unreliable, so they must create it themselves first.Coxon stated that some AI practitioners are much more pessimistic privately than they express publicly, and are even worried that AI could destroy humanity before the end of this decade. He personally judges that in the most radical scenario, AI could go out of control by the end of next year, so such decisions should not be made solely by the engineers of a few companies.