BTC $79,173.05 +0.49%
ETH $2,509.05 +1.03%
BNB $754.88 +1.24%
XRP $1.43 +2.87%
SOL $104.21 +0.91%
TRX $0.3386 +1.00%
DOGE $0.0906 +0.85%
ADA $0.2203 +1.10%
BCH $259.95 +0.63%
LINK $12.56 -0.83%
HYPE $85.91 +1.82%
AAVE $129.84 -1.13%
SUI $0.8221 +0.64%
XLM $0.1893 -0.51%
ZEC $1,229.83 +9.32%
BTC $79,173.05 +0.49%
ETH $2,509.05 +1.03%
BNB $754.88 +1.24%
XRP $1.43 +2.87%
SOL $104.21 +0.91%
TRX $0.3386 +1.00%
DOGE $0.0906 +0.85%
ADA $0.2203 +1.10%
BCH $259.95 +0.63%
LINK $12.56 -0.83%
HYPE $85.91 +1.82%
AAVE $129.84 -1.13%
SUI $0.8221 +0.64%
XLM $0.1893 -0.51%
ZEC $1,229.83 +9.32%

groq

All
Article
Flash

first_img NVIDIA announces full-scale production of Groq racks, which will be deployed at Nebius

On Monday local time, Nvidia Senior Director Dion Harris announced that the Groq 3 LPX rack has entered full-scale production and will be deployed in the data center of the new cloud service provider Nebius, expected to go live later this year. This move marks the commercialization of the technology obtained by Nvidia after reaching a technology licensing deal worth approximately $20 billion with Groq last December. Several core employees from Groq have joined Nvidia, with founder Jonathan Ross serving as Nvidia's Chief Software Architect.Nvidia is accelerating the production of Groq chips and providing products to customers, highlighting the importance of low-latency inference. The Groq 3 LPX, released in March this year, is an inference accelerator for the Vera Rubin platform, integrating 500 megabytes of high-speed SRAM on the chip die to reduce memory bottlenecks. Each LPX rack can integrate 256 Groq 3 chips, and Nvidia cites benchmarks indicating it can process 3,400 tokens per second; the chip is manufactured by Samsung.Harris stated that low-latency chips are not meant to replace GPUs but are designed to use the appropriate processor for different stages of workloads, allowing cloud service providers to offer higher-priced packages for latency-sensitive users. Nvidia CEO Jensen Huang plans to allocate about a quarter of the data center space for programming applications to Groq chips, with the remainder using the Vera Rubin system, and expects cumulative sales of Blackwell and Vera Rubin to reach $1 trillion by 2027.

NVIDIA: SpaceXAI will deploy Vera CPU to accelerate proxy-based AI and expand the Vera Rubin platform to space-based computing

NVIDIA officially announced that SpaceXAI will deploy the NVIDIA Vera CPU to accelerate its next-generation agent-based AI applications. Vera is the first CPU specifically built for AI agents, featuring 88 NVIDIA self-developed Olympus cores, utilizing spatial multithreading technology and LPDDR5X high-bandwidth memory, with a bandwidth of up to 1.2TB/s. In scenarios such as agent-based AI, reinforcement learning, and data processing, the task completion speed can be improved by up to 1.8 times compared to x86 CPUs.Mike Nicolls, President of SpaceXAI, stated that the CPU performance and memory bandwidth of Vera are sufficient to support large-scale task orchestration, code execution, and data processing, allowing GPUs to operate at peak efficiency, thus gaining more effective output per watt of computation.SpaceXAI also plans to expand the AI infrastructure behind Grok based on the NVIDIA Vera Rubin platform, moving towards gigawatt-level computing capacity. Vera Rubin integrates NVIDIA accelerated computing, NVLink interconnect, Spectrum-X networking, and BlueField data processing technologies, aiming to reduce the cost per token and improve the overall energy efficiency of AI factories.More notably, SpaceXAI will send an optimized version of the Vera Rubin NVL72 system into space, with its first-generation Starmind AI satellite adopting this rack-level architecture, becoming the first iconic deployment of NVIDIA accelerated computing extending from ground data centers to orbital computing.
app_icon
ChainCatcher Building the Web3 world with innovations.