Anthropic announced that it has selected Accenture as its initial embedded evaluator to assist in decelerating artificial intelligence progress, following a recommendation made last week by CEO Dario Amodei.
Amodei released a three-part blueprint on Sept. 12 to temper AI advancement and establish critical safety buffers, citing dangers of potential catastrophic damage resulting from rapid, unmonitored growth.
OpenAI head Sam Altman and SpaceX leader Elon Musk offered favorable feedback regarding Amodei’s strategy, whereas Nvidia chief Jensen Huang expressed disapproval, claiming such oversight is unnecessary.
Nonetheless, Amodei stated within his proposal that “AI has been advancing drastically faster, driven primarily by AI’s growing ability to build the next generation of AI. This dynamic is called recursive self-improvement,” and “left unchecked, it could outrun our ability to understand and control these systems.”
Related: Anthropic chief urges slowdown in AI development to safer pace
Amodei explained that the initial phase of his plan involves utilizing independent reviewers equipped with staff-level permissions, an obligation Anthropic had previously pledged to undertake independently.
Anthropic revealed progress toward fulfilling this pledge on Friday by collaborating with Accenture alongside its AI division Faculty for “evaluating and red-teaming models, conducting alignment assessments and testing model safeguards.”
The organization noted that specific operational procedures are still being finalized because embedded evaluation represents a novel concept.
The official statement indicated that both Anthropic and Accenture anticipate investing a minimum of $1 billion each into the initiative throughout the upcoming five years.
Anthropic will fund work directly amid urgency
Anthropic pointed out that there are currently no established frameworks for financing independent evaluations, meaning long-term capital should originate from collective pools or state bodies, though due to the critical nature of the task, Anthropic will finance Accenture’s efforts directly.
This alliance is non-exclusive, and Anthropic anticipates naming additional evaluators to collaborate with in the coming weeks.
Accenture’s Faculty possesses specialized knowledge in testing and analyzing models for premier global AI laboratories, as well as constructing sophisticated artificial intelligence systems designed to be safe and ethical inherently, the firm stated on Friday.
“Embedded evaluation is an emerging area, and we look forward to partnering with Anthropic to help accelerate the development of embedded evaluators, which we see as an important part of the safety landscape going forward,” said Julie Sweet, chair and CEO of Accenture.
Magazine: Why are AI’s biggest companies suddenly asking to slow down?
Originally published at https://cointelegraph.com/news/anthropic-tabs-accenture-as-embedded-evaluator-to-help-with-ai-slowdown-proposal?utm_source=rss_feed&utm_medium=rss&utm_campaign=rss_partner_inbound.
