During a recent episode of the Big Technology Podcast, Greg Brockman, co-founder of OpenAI, made a significant declaration regarding the capabilities of large language models (LLMs) and their potential to achieve artificial general intelligence (AGI). He stated that the question of whether LLMs can reach AGI has been definitively answered, asserting that the GPT architecture will indeed pave the way toward it.
Brockman expressed confidence that we now have a clear trajectory toward AGI, indicating a transformative shift in how we understand the capabilities of reasoning models based on the GPT framework. However, this assertion raises important discussions within the AI research community regarding the depth of understanding that text-based models can achieve compared to more complex, multimodal models like Sora.
OpenAI recently made the decision to discontinue the Sora app and model, choosing to focus their resources on smaller-scale world model research primarily for robotics, rather than on consumer-facing technologies. Brockman acknowledged Sora as an "incredible model" but indicated that it represents a different avenue in AI development compared to the GPT reasoning series. He emphasized that, given their finite computational resources, OpenAI needs to prioritize one route over the other, suggesting that timing and sequencing are crucial to achieving the ambitious applications they envision.
When prompted by podcast host Alex Kantrowitz about the potential oversight in avoiding Sora and similar models, Brockman conceded the possibility of missing a critical opportunity, stating that making choices is an inherent part of AI development.
The broader AI research community remains divided on the path to achieving general intelligence. Yann LeCun, a prominent AI researcher, has long contended that LLMs alone are insufficient for attaining human-like intelligence. He argues that these models struggle with logical reasoning, lack a true understanding of the physical world, and do not possess characteristics such as permanent memory or hierarchical planning. LeCun supports the notion that world models are necessary for developing a deeper comprehension of environments.
Similarly, Deepmind's founder, Demis Hassabis, shares the belief that merely scaling LLMs does not equate to advancements in intelligence; further innovations will be vital in this pursuit. In this context, Francois Chollet, another notable voice in AI, suggests that intelligence should be defined by a system's ability to efficiently acquire new skills and create its own abstractions.
In response to these discussions, recent research from Deepmind researchers Richard Sutton and David Silver advocates for a shift in approach—from training AI on human-curated knowledge to enabling it to learn from its own experiences. This paradigm aims to foster a more autonomous form of intelligence. Silver has even launched a new startup focused on simulative learning methods.
On the other hand, some researchers, like Adam Brown from Deepmind, have defended the existing LLM architecture, likening its token prediction capabilities to biological evolution. He believes that, with extensive scaling, these simple processes could give rise to complex behaviors that might be interpreted as understanding or even consciousness.
The debate around the capabilities and limitations of LLMs continues unabated, highlighting the evolving landscape of AI research and the varied perspectives that contribute to this critical discourse.