Tested on SemiAnalysis’ InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.
OpenAI’s Jalapeño chip is built for fast inference at scale, benchmarks show
Related Posts
Data centers expected to use 4x more electricity by 2035
New data centers built through 2033 could consume as much electricity as India uses today.
All the important news from the ongoing India AI Impact Summit
India is hosting a four-day AI Summit this week that will be attended by executives from major AI…
A Marc Benioff-backed startup thinks AI can solve the AI deployment problem
June emerged from stealth today with a $20 million pre-seed round to make AI adoption simpler.
