Google DeepMind expresses concerns over the implications of millions of agents interacting.

Google DeepMind expresses concerns over the implications of millions of agents interacting.
Summary
Google DeepMind partners with organizations to fund $10 million for multi-agent safety research.
The initiative aims to promote academic exploration of multi-agent systems beyond tech company constraints.
Concerns include potential cyberattacks and scams as AI agents increasingly collaborate in the economy.

Share

Bookmark

Newsletter

In a strategic move to enhance the safety of multi-agent systems, Google DeepMind has forged partnerships with various organizations to establish a $10 million funding initiative aimed at supporting researchers focused on this area. This announcement came shortly after the prominence of agent-based tools at Google I/O last month. The collaborative effort involves Schmidt Sciences, a philanthropic foundation created by Eric and Wendy Schmidt; ARIA, the UK government-backed agency for breakthrough innovations; the Cooperative AI foundation, a nonprofit research organization based in the UK; and Google’s own charitable branch, Google.org.

To gain insights into the goals of this $10 million initiative, I spoke with Shah and James Fox, who directs the Science of Trustworthy AI program at Schmidt Sciences. While the amount is substantial, it pales in comparison to the funding dedicated to Google DeepMind's internal research teams.

Shah emphasized the initiative's intent to stimulate research efforts outside traditional technology companies. “The advantage of academia lies in its ability to explore far-reaching, innovative concepts that aren't always prioritized within industry labs,” he noted.

He pointed out a significant gap in the current research landscape, stating, “At present, there isn't a dedicated field focused on the safety of multi-agent systems, and we aim to change that.”

The collective concern centers around the rapid deployment of AI agents and their potential to operate collaboratively, raising the possibility of transitioning speculative scenarios into tangible risks. As Shah explained, “Similar to humans, our societal institutions can achieve outcomes that surpass the capabilities of any individual.”

According to Shah, we are still months away from a point where these agents are integrated into the economy at a scale that could heighten safety concerns, and he aims to proactively address these challenges before they arise.

So, what specific risks are being considered? Shah and Fox underscore that the potential threats largely parallel some of the negative phenomena currently occurring on the internet. These include advanced scams, prompt injections—where an AI agent is manipulated into executing malicious intent—and various forms of cyberattacks. "We analyze existing human behaviors and contemplate what their agent counterparts might look like," Shah concluded.

Loading comments...