Dario Amodei, co-founder and CEO of Anthropic, observed U.S. President Donald Trump's remarks to the press following a meeting at the White House with various tech executives discussing the complex landscape of artificial intelligence on September 29, 2026. Over the past two months, independent evaluators, previously a minor presence in the lucrative AI sector, are now being called upon to address mounting concerns about the safety and governance of AI technologies. Amidst an ongoing debate focused on the balance between innovation and safety, companies like Anthropic and OpenAI are rallying support from a select group of smaller nonprofit organizations, including Model Evaluation and Threat Research (METR), Apollo Research, and Transluce. These evaluators, primarily operating as nonprofits, aim to assess AI model capabilities and identify risks, signaling issues with the technology's performance.
Without significant federal regulation, these evaluators are gaining increased recognition and influence in the sector. Amodei emphasized his commitment to incorporating independent evaluators into Anthropic's operations, a sentiment echoed by OpenAI CEO Sam Altman. Trump's endorsement of this initiative highlighted a wider industry consensus among the largest U.S. tech firms. However, critical questions remain regarding funding sources for these evaluators, their access levels, and the overall reporting structure. Additionally, Suresh Venkatasubramanian, a computer science professor at Brown University, raised concerns about funding accountability and sustainability for these evaluators, emphasizing the need for a dependable ecosystem and effective business models.
Presently, key players in AI such as Anthropic and OpenAI are shaping industry standards, which critics argue could lead to significant conflicts of interest, particularly if those in charge of oversight are financially tied to the companies they are meant to evaluate. Trump praised AI executives for their self-regulation and indicated a reluctance to impose heavy-handed regulations, preferring that companies collaborate with external auditors voluntarily.
The discourse gained traction following Amodei's influential essay advocating for a more measured pace in the advancement of AI technologies. Tensions surfaced recently when OpenAI let go of three employees for allegedly breaching company policies regarding sensitive information. The dismissed employees expressed concerns that their termination was linked to their interactions with external evaluators, fearing that a culture of silence could compromise safety efforts within the company.
In response, OpenAI asserted its dedication to working with external safety evaluators and indicated that contracts with independent assessors would be finalized soon, reinforcing its commitment to transparency in this partnership.
The landscape of AI evaluation comprises small organizations and larger firms such as Accenture. The field is rapidly evolving, with organizations like METR announcing significant funding injections to enhance their capabilities. For instance, METR reported raising approximately $71 million in just six months, reflecting a notable increase from previous years. As attention increases on evaluator capabilities, AI companies are beginning to form collaborations aimed at assessing their systems' safety.
Kevin Werbach, faculty director of the Wharton Accountable AI Lab at the University of Pennsylvania, pointed out that while the evaluative ecosystem is evolving, it remains relatively immature and faces challenges regarding power dynamics and potential biases favoring larger AI companies. Anthropic has recognized these obstacles and has begun embedding its evaluators more deeply within its operations to enhance scrutiny and accountability.
Several lawmakers are exploring frameworks for Independent Verification Organizations (IVOs), which would be federally licensed to ensure AI firms adhere to safety standards. As discussions around IVO legislation progress, companies like OpenAI and Anthropic are expected to navigate their roles in relation to these evaluators carefully, promoting a collaborative approach that balances innovation with accountability.
In California, Governor Gavin Newsom has signed groundbreaking legislation establishing a framework for IVOs, which Anthropic and OpenAI have publicly supported. While many believe the establishment of standards will benefit the industry, challenges remain around the efficacy of self-policing in the absence of governmental oversight.
As Amodei has outlined, Anthropic intends to support evaluators with necessary resources to conduct thorough evaluations, while OpenAI is also moving forward with its own proposals regarding evaluator engagement and methodology. The AI Evaluator Forum has identified essential conditions for embedding evaluators, advocating for transparency and independence to uphold the integrity of assessments alongside broader oversight initiatives.
Freedman's perspective suggests a notable shift in the stance of AI leaders, as they recognize the critical importance of public trust in deploying advanced AI technologies. Yet, competition between firms complicates a unified approach to safety and evaluation. The road ahead will challenge both Anthropic and OpenAI to balance their ambitions with the imperative of responsible AI stewardship.
