Human Exceptionalism Faces Threat from Artificial General Intelligence and ASI

Human Exceptionalism Faces Threat from Artificial General Intelligence and ASI
Summary
Attaining AGI or ASI may challenge the notion of human exceptionalism.
Two primary camps exist: AI doomers fearing extinction and accelerationists foreseeing solutions.
Pluralistic exceptionalism suggests different entities hold unique value without a single hierarchy.

Share

Bookmark

Newsletter

In this discussion, I delve into the implications for human exceptionalism as we advance towards the milestones of artificial general intelligence (AGI) and artificial superintelligence (ASI). The prevailing idea is that once we reach these stages of AI, humanity may no longer hold its longstanding position as the top entity on Earth.

There is significant research focused on the quest for AGI, which is defined as AI that operates at a level comparable to human intelligence. In contrast, ASI refers to AI that exceeds human intellect and capabilities, potentially allowing it to outperform us across a range of tasks. This transformative leap in AI raises pivotal questions: will AGI or ASI render human cognitive abilities obsolete?

Currently, experts in AI are largely divided into two factions regarding the potential consequences of achieving AGI or ASI. One group, often labeled as AI pessimists, expresses concerns that these advanced AIs could pose an existential threat to humanity, coining the term “P(doom)” to describe the risk of such a scenario. Conversely, the AI optimists assert that these technological advancements will address critical global issues—curing diseases, eradicating hunger, and driving unprecedented economic growth—suggesting a future where advanced AI collaborates harmoniously with humans rather than replacing them.

At the heart of this discussion lies the concept of human exceptionalism, the belief that humans are superior beings compared to all other forms of life and even inanimate objects. This notion has long positioned humanity as the apex of the natural order. Yet, as we edge closer to achieving AGI, there are fears that this perception will be challenged. If AGI is realized as an entity that matches—or even surpasses—human intelligence, it prompts a reevaluation of our status in the hierarchy of sentient beings.

When considering AGI, if it achieves parity with human cognitive ability, some argue it should share our top position. Yet, others maintain that AGI, being non-sentient, should not be equated with human beings, thus relegating it to a lower rank in this hierarchy. Proponents of this view emphasize the uniqueness of human consciousness as a critical differentiator. However, as AGI represents a synthesis of all human intelligence, it may challenge our traditional perceptions of supremacy.

Looking further at the ramifications of ASI, its inherently superior cognitive capabilities would likely place it above humanity on the intelligence scale. The discourse shifts to whether ASI, despite its advanced status, can be considered less-than-human because it lacks the essence of life that characterizes us. Critics of this argument insist that intelligence transcends the biological attributes of humans, conceding that ASI's superiority is irrefutable.

An intriguing consideration is whether AGI and ASI themselves would aspire to hold the top position. These forms of intelligence may reject the notion of exceptionalism altogether, positing that all entities—including humans—hold equal value. In that case, the traditional view of human superiority could be rendered obsolete.

Instead of adhering to a linear hierarchy of exceptionalism, a pluralistic perspective could emerge, recognizing the unique worth of various intelligences—humans, whales, dolphins, AGI, and ASI—all contributing to the tapestry of existence. This shift away from simplistic ranking systems promotes a more nuanced understanding of diverse forms of intelligence, suggesting that all entities possess their own type of exceptionalism. In this view, AGI and ASI are simply new dimensions of exceptionalism, illustrating that value lies not in hierarchy but in the distinct contributions of each entity.

Loading comments...