What connects a software engineer, an information theorist, and a biologist? While this might seem like a light-hearted riddle, it hints at a profound potential to address three significant scientific enigmas through a singular lens. Before delving into that, however, we need to clarify a fundamental concept that lies at the heart of this discussion: artificial general intelligence (AGI).
AGI is often equated with intelligence, which is typically defined as the ability to accumulate knowledge and solve problems. A system that excels at answering queries, tackling intricate issues, or executing difficult calculations might seem intelligent. However, this perception can be misleading. Take a calculator, for instance. It can perform millions of arithmetic operations faster and more accurately than any human, yet it is not considered AGI. The mere ability to execute tasks does not equate to generalized intelligence.
So, what exactly is AGI? My curiosity on this matter led me to write "Turing Test 2.0: The General Intelligence Threshold". In this work, I proposed that the true hallmark of human General Intelligence (GI) transcends mere reasoning or knowledge accumulation. It resides in the capacity to generate genuinely novel functional abilities—skills that no prior human or system could perform, thus ruling out simple training as their source.
Historical evidence clearly shows this generative mechanism at play. Humanity has evolved from primitive living conditions to monumental achievements such as skyscraper construction, nuclear energy harnessing, genome sequencing, and space exploration. Such advancements can't be attributed solely to the transfer of existing abilities; rather, they reflect humanity's ongoing expansion of functional capabilities.
At first glance, this perspective on AGI might seem unconventional. Yet, it aligns with the observations of prominent AI researchers. For instance, OpenAI's CEO, Sam Altman, articulated that an AI demonstrating AGI would be capable of making significant discoveries, like uncovering the mysteries of quantum gravity. The revelation here lies not in the AI's access to vast information, as a library does, but rather in its ability to create new functional possibilities that no other entity has achieved.
This leads us to a critical question: How does a system acquire capabilities it previously lacked? While examining this, I realized that the query extends beyond just artificial intelligence. It seems to intersect with three of science's most profound mysteries: the origin of life, the attainment of AGI, and the conveyance of meaning through information.
These inquiries are often seen as distinct, tackled by various disciplines with their unique methodologies. Biologists delve into life's beginnings, computer scientists explore AGI, and information theorists investigate how information is represented and communicated. While it may seem these fields are addressing separate issues, they share a common thread.
A living cell is notable not just for its molecular composition, but for the complex functions these molecules enable, like metabolism and replication. Similarly, intelligence isn't merely about storing information; it’s about leveraging that information to perform and innovate. Likewise, information transforms into something meaningful only when a system can utilize it effectively.
By examining these connections more closely, we see that the origin of life, AGI, and the essence of information all hinge on the ability of a system to execute functions. A living cell, an intelligent entity, and a piece of information might seem unrelated, but fundamentally, they all facilitate achievement beyond their inherent properties.
In exploring the concept of functionality and interpretation, John Searle’s renowned Chinese Room thought experiment serves as an illustrative tool. Picture a man who cannot understand Chinese, confined within a room equipped solely with instruction manuals on how to manipulate Chinese characters. As he follows the rules, he produces responses that appear coherent to those outside, suggesting he understands Chinese. However, does he truly grasp the language?
Searle argued he does not; the man merely follows instructions like a computer running code. Others contend that the entire system—man plus manuals—exhibits understanding, but perhaps they overlook a critical distinction.
Consider this scenario: if someone outside the room sends a note in Chinese saying, "The key that unlocks the door is hidden beneath the third-floor tile," can the manuals alone help the man escape? No, because while the manuals guide him in symbol manipulation, they do not include the necessary instructions to take physical actions related to the message.
To escape, he must grasp the message's meaning and act accordingly. This understanding is an essential capability, paralleling how a system needs the ability to interpret information and utilize it effectively.
Thus arises a key conclusion: Information isn't inherently meaningful; it becomes so once a system exists to interpret and utilize it.
This leads us to the notion of functional information (FI), defined in terms of three components: the information itself (I), the system interpreting it (S), and the function being executed (F). Functional information is actually a relationship—without any component, the entirety of FI dissipates. A lack of system renders information meaningless, and without defined functions, we cannot discern meaningful information from mere sequences of symbols.
With the theoretical model of functional information established, we can revisit our initial inquiries regarding life, AGI, and meaning. On the surface, these questions appear variably distinct, yet they share an underlying theme: systems gaining the ability to interpret information leads to the acquisition of new functionalities.
Take the simplest living cell as an example. Its DNA harbors information crucial for life, but on its own, DNA cannot create life. That information necessitates an interpreter—an organism that can enforce biological functions such as protein synthesis, chemical regulation, and reproduction.
Similarly, AGI distinguishes itself not by mere information storage, but by a system’s ability to gain new capabilities. Picture an AGI analyzing astronomical data that has perplexed humans. Such a system would need to derive understanding and identify previously unknown patterns, conceptualizing theories, such as quantum gravity, that elevate its functionality.
Lastly, consider a communication signal perceived as random noise until correctly interpreted, revealing its true message or pertinent data. Here, the functionality emerges not from the signal transformation but from the system's enhanced interpretation capabilities.
By assembling these examples, we discern a cohesive theme: a system's reinterpretation of information leads to the emergence of functionalities previously absent. This suggests that a common inquiry lies at the core of each mystery: what is the origin of functional information?
The implications are significant. Discovering functional information's origin could forge a unified framework for understanding the inception of life, the rise of general intelligence, and the production of meaning. Addressing this single, profound issue could potentially illuminate all three queries.
As we examine functional information more closely, we see that systems can acquire it through transfer mechanisms—explicit communication or training from other systems equipped with such capabilities. One can convey functional knowledge through instructions, or a teacher can impart skills, enabling a learner to utilize information for previously unattainable tasks. Modern AI also exemplifies this principle, with models trained on human data to learn interpretation and functionality.
Yet, these actions represent transfer rather than the original emergence of functional information. What remains unexplained is how an initial system without existing functional capabilities can generate new interpretations, thus fostering an understanding of uncharted functionalities.
This leads us to consider randomness, often proposed in discussions regarding life's origins. However, while randomness can lead to new information arrangements, it cannot elucidate how a system develops the capability to interpret and enact those newly formed possibilities.
Could structured algorithms provide an answer? Algorithms apply a sequence of rules that transition an initial state into subsequent conditions. If the origin of functional information can be algorithmically derived, an algorithm should be able to create genuinely new capabilities from an original state lacking them.
However, recent research indicates that no algorithm can give rise to functions not inherent in its initial framework. An algorithm operates along predefined pathways that cannot spontaneously bring forth new functions without an existing computational path leading to that outcome.
Hence, we reach a critical understanding: While we can envision processes for transferring information, account for randomness, and devise algorithms, none explain the essential transition required for a system to gain new interpretative capabilities—an unresolved challenge at the heart of origin inquiries pertaining to life, intelligence, and meaning.
Finally, we can transform these theoretical insights into an experimental hypothesis. Imagine training an AI model, initially untrained and randomized, solely on a textbook covering basic calculus. Would we expect the AI to learn calculus?
While one might guess it would learn the material, a deeper analysis suggests that the AI should interpret the information from the book, but cannot spontaneously gain capabilities of performing calculus unless such functionalities were present in the training materials.
This leads us to predict that the AI could mirror the explanations contained in the textbook and perhaps engage in related tasks. However, it wouldn’t suddenly master techniques or solve complex problems requiring information not present in the original text.
Therefore, if the AI merely reproduces or rearranges functional information within the textbook, it signifies the transfer from one entity to another. Conversely, if it can produce genuinely new functional capabilities that extend beyond the original content, it would represent a notable breakthrough, verifying that it can acquire functional information independently. This distinction embodies what characterizes true general intelligence.
This experiment serves as not just a test of theoretical assertions but also as a litmus test for identifying AGI, enhancing our understanding of functionality, information, and their origins in life and intelligence.
