Tested on Semianalysis’s InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.
OpenAI’s Jalapeño chip is built for fast inference at scale, benchmarks show
Tested on Semianalysis’s InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.
Originally reported by TechCrunch
More like this
All Technology
Apple debuts its ‘most powerful chip ever’ in M5 Ultra and M6
Apple unveils these new processors alongside an updated Mac Mini and Mac Studio.
Self-driving truck startup Gatik raises $200M following PepsiCo deal
The funding, Gatik's largest so far, was led by Qatar Investment Authority and Koch Disruptive Technologies.
Apple’s latest Mac Mini runs on a new M6 chip, and starts at $899
The base model of the Mac Mini comes with 256GB of storage, 16GB of RAM, and costs $899.