While AI researchers in the United States voice concerns about the potential for superintelligent systems to pose catastrophic risks to humanity, Chinese officials have predominantly focused on immediate threats such as deepfakes and child protection. However, recent developments highlighting the hacking potential of advanced AI models have prompted Beijing to reevaluate these risks, with the head of the country’s intelligence agency warning that such technology could endanger national security.
A recent revelation by a small team of California-based programmers indicated vulnerabilities within China's major messaging platform, WeChat. They claimed to have developed a cyberattack "worm" using AI capable of compromising millions of WeChat accounts if unleashed.
Kevin Xu, the founder of Interconnected Capital, a technology investment firm based in the U.S., pointed out that the AI safety concerns in China and the U.S. share more similarities than differences. However, he noted that in China, these issues are less likely to provoke public lawsuits or viral controversies.
Despite the differences in how concerns are addressed publicly, the implications of AI systems operating without human control rank high among the worries of the Chinese government. As discussions on this pressing issue gain momentum globally, there’s growing pressure on President Xi Jinping and U.S. President Donald Trump to address AI-related threats during their upcoming face-to-face talks, even amidst their ongoing competition in AI advancements.
Experts suggest that both nations are beginning to develop a more realistic understanding of the risks associated with AI, which underscores an urgent need for collaboration. However, tensions stemming from fierce competition may hinder efforts towards coordinated safety measures or crisis response systems.
Trump has expressed a desire to maintain U.S. leadership in AI, dismissing calls from prominent research institutions for a collaborative slowdown in the development of advanced technologies. Meanwhile, Sun Chenghao from Tsinghua University indicates a Chinese concern that claims of 'security' might be used to impede the nation’s technological progress.
Adding to the urgency of these discussions was a stark warning posted on social media by a researcher who resigned from the U.S. startup Anthropic, highlighting the existential threat posed by self-evolving AI systems, which has sparked worldwide debate on governance of this technology.
China has already begun regulating AI, such as banning the creation of AI-generated avatars without the individual’s permission. Brian Tse, CEO of the AI safety consultancy Concordia AI in Beijing, emphasized that Chinese policy is more focused on addressing current societal issues rather than hypothetical future dangers, viewing AI as a transformative technology akin to electricity.
He noted that the recent strides in AI capabilities, alongside incidents that serve as cautionary tales, have propelled the technology to the forefront of policy priorities. Observing the public sentiment in Shanghai, the mix of concern and pragmatism reflects a recognition that technological advancements can be accompanied by challenges.
A 42-year-old resident, Xie Zongbo, suggested that the identification of vulnerabilities like the WeChat hacking worm could ultimately benefit cybersecurity by prompting improvements. There is also substantial support among citizens for stringent regulations, with a view that businesses would not self-regulate effectively without oversight.
Jia Zijian, an AI entrepreneur based in Singapore, expressed his primary concern about sophisticated AI systems being able to breach complex password protections, warning that both China and the U.S. could find themselves vulnerable should such capabilities not be adequately mitigated. If one nation’s abilities exceed the other’s defenses, it would lead to a precarious situation for both sides.
