Wednesday, June 24th 2026

OpenAI Unveils Jalapeno LLM Inferencing Accelerator Built in Collaboration with Broadcom

OpenAI today unveiled Jalapeño, its in-house, purpose-built LLM inference accelerator chip, developed in collaboration with Broadcom. The chip has fixed-function and programmable compute hardware to accelerate inferencing of OpenAI LLM stack that powers ChatGPT, Codex, the OpenAI API, and the company's future agentic AI products. It is conceptually similar to Google's TPU, except designed for the OpenAI stack; and while TPU is used for both training and inferencing, Jalapeño appears to be limited to inferencing. The training is probably still done with GPUs.

The company said that in partnership with Broadcom, the chip was designed and reached manufacturing tape-out in just nine months, making it the fastest ASIC development cycle among advanced semiconductors. Jalapeño is part of a compute platform that will span multiple generations of these chips. The platform is being designed for initial deployment toward the end of 2026. There are no technical details about the chip itself, except that it's a contemporary multi-chip module with an interposer, a large and centrally-located logic tile, flanked by eight HBM3E stacks.
Sources: OpenAI, Steve Morin (Twitter)
Add your own comment

16 Comments on OpenAI Unveils Jalapeno LLM Inferencing Accelerator Built in Collaboration with Broadcom

#1
Aquinus
Resident Wat-man
btarunrflanked by eight HBM3E stacks
For context, that's 192 or 288GB depending if those are 8 or 12 hi stacks.
Posted on Reply
#2
TheLostSwede
News Editor
Did they run out of nerdy names?
Posted on Reply
#3
_JP_
@TheLostSwede I figure the name might align with it's thermal dissipation or how fast it will burn through OpenAI's FY27 OpEx before they can actually turn a profit with their sales model and gov. contracts, in the medium-term. :laugh:
Posted on Reply
#4
mb194dc
How many more billions are they burning on this ?
Posted on Reply
#5
John of Doe
mb194dcHow many more billions are they burning on this ?
ALL the billions, plus your water!
Posted on Reply
#6
Hecate91
flanked by eight HBM3E stacks.
So this is why the price of memory keeps going up, thanks Sam Altman.
John of DoeALL the billions, plus your water!
And we get to pay for their electricity!
Posted on Reply
#7
evernessince
mb194dcHow many more billions are they burning on this ?
The intent of this is likely to save billions. Nvidia chips are not remotely cheap.
Hecate91So this is why the price of memory keeps going up, thanks Sam Altman.
Yes, and these high stack HBM chips take up significantly more wafer per GB due to stacking defects.
Posted on Reply
#8
Red Hood
_JP_@TheLostSwede I figure the name might align with it's thermal dissipation or how fast it will burn through OpenAI's FY27 OpEx before they can actually turn a profit with their sales model and gov. contracts, in the medium-term. :laugh:
The rate they're burning money they should have called it Ghost Pepper or Carolina Reaper 😆
Posted on Reply
#9
Aquinus
Resident Wat-man
TheLostSwedeDid they run out of nerdy names?
They either know it's going to be fire or is going to run hot. Either way, their bases are covered.
Posted on Reply
#10
TheLostSwede
News Editor
AquinusThey either know it's going to be fire or is going to run hot. Either way, their bases are covered.
Jalapenos aren't all that hot though, so maybe it'll just fizzle?
Posted on Reply
#11
trsttte
TheLostSwedeJalapenos aren't all that hot though, so maybe it'll just fizzle?
Like openAI when all the normies figure Claude and Gemini are much better?

Posted on Reply
#12
LittleBro
How'bout OpenAI finally unveilved some profits?
Posted on Reply
#13
Aquinus
Resident Wat-man
TheLostSwedeJalapenos aren't all that hot though, so maybe it'll just fizzle?
They have a bit of kick if you don't remove the seeds. Maybe they should have called it habanero. I've taken a bite out of one of those before and by golly, those are hot.
trsttteLike openAI when all the normies figure Claude and Gemini are much better?

DeepHWE suggests that GPT 5.5 is almost on par with Fable 5 from a cost efficiency and successful result perspective. Don't say that too loudly though because the US government might try to take it down. :confused:
deepswe.datacurve.ai/

The real crazy thing is how far GLM 5.2 has come.

Edit: Also Gemini isn't really all that good. Opus 4.8 and GPT 5.5 are pretty awesome though.
Posted on Reply
#14
Wirko
AquinusMaybe they should have called it habanero.
The owner (and destroyer) of Habana Labs might sue them for a spicy sum of money for trademark infringement.
Posted on Reply
#15
Aquinus
Resident Wat-man
WirkoThe owner (and destroyer) of Habana Labs might sue them for a spicy sum of money for trademark infringement.
Maybe? Was Habana actually short for Habanero? A quick Google search says no. Their old logo doesn't look like a pepper or anything either, so that might be a stretch, but I wouldn't put it past Intel for trying.
Posted on Reply
#16
igormp
trsttteLike openAI when all the normies figure Claude and Gemini are much better?
All of them are bad in their own special ways... so companies have to pay for all of them to manage something out of it.
Posted on Reply
Add your own comment
Nov 15th, 2026 16:37 CST change timezone

New Forum Posts

Popular Reviews

TPU on YouTube

Controversial News Posts