Forbes

Groq's Record-Breaking Language Processor Hits 100 Tokens Per Second On A Massive AI Model

Groq's newly announced language processor, the Groq LPU, has demonstrated that it can run 70-billion-parameter enterprise-scale language models at a record speed of more than 100 tokens per second. In ...
The Next Platform

Cerebras Inks Transformative $10 Billion Inference Deal With OpenAI

If GenAI is going to go mainstream and not just be a bubble that helps prop up the global economy for a couple of years, AI ...
WDAF-TV

Groq™ First to Achieve 100 Tokens Per Second Per User on Meta AI's Llama-2 70B, Leading All Artificial Intelligence Solutions Providers in Inference Performance

MOUNTAIN VIEW, Calif., Aug. 8, 2023 /PRNewswire/ -- Groq, an artificial intelligence (AI) solutions provider, today announced it now runs the Large Language Model (LLM), Llama-2 70B, at more than 100 ...
VentureBeat

Groq's breakthrough AI chip achieves blistering 800 tokens per second on Meta's LLaMA 3

In a surprising benchmark result that could shake up the competitive landscape for AI inference, startup chip company Groq appears to have confirmed through a series of retweets that its system is ...