BTC $80,922.34 -3.06%
ETH $2,356.42 -5.88%
BNB $717.73 -3.51%
XRP $1.30 -5.02%
SOL $102.10 -4.85%
TRX $0.3304 -0.06%
DOGE $0.0796 -5.91%
ADA $0.2203 -6.43%
BCH $262.60 -5.98%
LINK $12.07 -6.46%
HYPE $79.87 -2.38%
AAVE $150.16 -6.80%
SUI $0.9864 -6.38%
XLM $0.1785 -6.09%
ZEC $1,097.40 -12.14%
AAPL $346.27 +1.16%
AMZN $250.94 -3.31%
GOOGL $342.43 -3.96%
MSFT $530.83 -2.56%
META $730.16 -4.97%
NVDA $218.89 -4.39%
TSLA $362.62 -3.62%
SNDK $1,340.10 -7.82%
INTC $95.46 -6.80%
SPCX $149.01 -5.44%
MU $878.90 -7.20%
AMD $559.23 -7.65%
BTC $80,922.34 -3.06%
ETH $2,356.42 -5.88%
BNB $717.73 -3.51%
XRP $1.30 -5.02%
SOL $102.10 -4.85%
TRX $0.3304 -0.06%
DOGE $0.0796 -5.91%
ADA $0.2203 -6.43%
BCH $262.60 -5.98%
LINK $12.07 -6.46%
HYPE $79.87 -2.38%
AAVE $150.16 -6.80%
SUI $0.9864 -6.38%
XLM $0.1785 -6.09%
ZEC $1,097.40 -12.14%
AAPL $346.27 +1.16%
AMZN $250.94 -3.31%
GOOGL $342.43 -3.96%
MSFT $530.83 -2.56%
META $730.16 -4.97%
NVDA $218.89 -4.39%
TSLA $362.62 -3.62%
SNDK $1,340.10 -7.82%
INTC $95.46 -6.80%
SPCX $149.01 -5.44%
MU $878.90 -7.20%
AMD $559.23 -7.65%

gpu

All
Article
Flash

Silicon Valley venture capital targets GPU computing power, a16z plans to expand with about 20,000 cards

Multiple venture capital firms in Silicon Valley are competing to secure GPU computing power to provide exclusive resources for their AI startups. a16z established a computing power pool of about 20,000 GPUs as early as 2024 and is negotiating expansion with data center companies Switch and Volta. General Catalyst plans to build a data center for its portfolio companies and has brought in the former head of NVIDIA DGX Cloud in May this year to oversee AI infrastructure operations.Even if AI startups complete their financing, they may not be able to rent GPUs in a timely manner. In April this year, major cloud providers like Microsoft were reported to prioritize allocating computing power to internal teams and large clients, leaving some startups facing months of waiting. a16z previously disclosed that during times of computing power shortages, prices that could originally be secured with a six-month contract might require a three-year commitment. Model training requires a large amount of GPU usage in a short period, while inference demand is difficult to predict, making it easy to waste funds by locking in computing power for several years in advance.a16z is concentrating on purchasing and leasing computing power through the Oxygen project, redistributing it to its portfolio companies, allowing them to access prices and contract terms typically reserved for large clients. In August this year, a16z co-led a $300 million financing round for Volta, which is valued at $2.4 billion, with investments covering both AI startups and data center companies providing computing power. The small venture capital firm Crucible Capital has built a cluster with 576 NVIDIA B300 GPUs for its portfolio companies to test, while also selling some computing power to a cutting-edge AI laboratory. This model allows venture capital firms to take on investments that were previously mainly borne by cloud providers and data center operators.

first_img Analysis: Some B300 transaction prices exceed 24 USD per hour

User gpugene stated during a discussion on computing power trading: Some B300 transaction prices have exceeded 24 dollars per GPU hour, and the price of computing power with a term shorter than 1 year remains above 7 dollars and is still rising. gpugene expressed the hope to use computing power derivatives to guard against the rise in GPU hour prices while retaining the flexibility to adjust rental durations; if inference clouds sell services at fixed prices and their own GPU bills fluctuate, they have effectively taken on the risk of computing power price changes.The article provides an example where a supplier can offer a plan for 2048 B300s, available for rent for 5 years at 4.15 dollars per GPU hour, corresponding to an amount of 372,264,960 dollars. If the client goes live after 12 months and uses this scale from the 13th to the 15th month, the total would be 4,485,120 GPU hours. gpugene calculated that the current premium for a call option with an exercise price of 4.50 dollars is approximately 4.83 million dollars; if changed to a compound option, the current payment would be about 2.70 million dollars, with an additional payment of about 4.49 million dollars upon exercising in the 12th month.gpugene also compared 4000 hypothetical 5-year rental and demand paths. The average cost of annual renewal is 4.72 dollars per hour, with the worst 5% scenario averaging 10.91 dollars; after adding the call option, these figures change to 4.88 dollars and 7.20 dollars, respectively, with the premium included. gpugene believes that the emerging computing power derivatives market may change how neocloud and related participants expand and protect themselves.
app_icon
ChainCatcher Building the Web3 world with innovations.