OpenAI has announced a major advancement in its hardware capabilities with the introduction of its new AI chip, named Jalapeño. According to a blog post shared on Tuesday, this chip is designed to complete tasks more efficiently and provide quicker responses compared to other AI systems. Richard Ho, OpenAI's vice president of hardware, emphasized that Jalapeño strikes a balance of reduced latency and increased throughput, overcoming the typical trade-off faced by AI technologies.
Initially unveiled in June, Jalapeño is an Application-Specific Integrated Circuit (ASIC), developed in collaboration with Broadcom. Its primary focus is on AI inference, which involves executing trained AI models to perform tasks or activate agents.
To evaluate Jalapeño's performance, OpenAI employed InferenceX, a benchmarking platform tailored for assessing how effectively AI systems conduct inference. The testing compared Jalapeño to leading competitors, specifically Nvidia's GB200 and GB300 superchips. The findings revealed that Jalapeño delivered between 1.5 to 1.9 times greater AI output per watt when tested with models such as GPT-OSS 120B, DeepSeek R1, and Kimi K2.5 1T. Additionally, it demonstrated an end-to-end latency that was 1.7 to 3.6 times lower than that of the competing systems. As Ho explained, these advancements allow for quicker responses, enhanced agent responsiveness, and more dependable performance to meet growing user demands.
Moreover, Jalapeño showcases an ability to handle higher workloads while consuming less energy, highlighting its efficiency.
OpenAI aims to roll out Jalapeño in limited quantities by the end of this year, with plans to increase production steadily through 2027. However, the company has yet to disclose specific deployment figures for the upcoming year.
Despite these enhancements, Ho noted that the new chip won't completely replace OpenAI's existing chip lineup, reinforcing that the company's overall computational strategy involves collaboration with established partners, such as Nvidia. OpenAI is committed to further developing subsequent generations of the Jalapeño chip as well.
