Processors specifically designed for AI model inference tasks, pursuing low latency, high energy efficiency, and high stability. With the large-scale deployment of AI applications, the AI inference chip market is experiencing explosive growth, becoming an important track for domestic chip breakthroughs.
The Groq 3 LPX, a rack-mounted LPU (Language Processing Unit) inference hardware system launched after acquiring the Groq team, deviates from the general-purpose GPU route.
It focuses on massive memory capacity, air-cooled deployment, and low-cost inference, rather than the large-model training market.
OpenAI, in collaboration with Broadcom, unveiled “Jalapeño,” a proprietary ASIC dedicated to inference.
Core Event On April 22 local time, Google officially released two artificial intelligence chips—the TPU 8t and TPU 8i—at the Cloud Next 2026 conference in Las Vegas. This marks Google’s first-ever separation of AI training and inference tasks into distinct processors, representing a significant strategic transformation in the company’s AI chip domain. Technical Breakthrough: First … Read more
