BTC $80,100.66 -1.62%
ETH $2,319.69 -2.00%
BNB $740.10 -1.90%
XRP $1.29 -2.89%
SOL $100.25 -2.74%
TRX $0.3312 -0.19%
DOGE $0.0780 -2.74%
ADA $0.1999 -3.65%
BCH $279.55 -6.99%
LINK $11.51 -2.45%
HYPE $82.54 +0.50%
AAVE $131.32 -3.22%
SUI $0.9130 -3.15%
XLM $0.1686 -1.88%
ZEC $1,255.59 -4.49%
AAPL $348.36 +0.72%
AMZN $252.29 -0.69%
GOOGL $291.26 -10.71%
MSFT $546.04 +2.90%
META $619.71 -0.64%
NVDA $214.34 -2.53%
TSLA $403.19 -1.55%
SNDK $1,372.60 +0.24%
INTC $92.21 -3.79%
SPCX $144.06 -3.83%
MU $956.41 -1.27%
AMD $563.91 -1.15%
BTC $80,100.66 -1.62%
ETH $2,319.69 -2.00%
BNB $740.10 -1.90%
XRP $1.29 -2.89%
SOL $100.25 -2.74%
TRX $0.3312 -0.19%
DOGE $0.0780 -2.74%
ADA $0.1999 -3.65%
BCH $279.55 -6.99%
LINK $11.51 -2.45%
HYPE $82.54 +0.50%
AAVE $131.32 -3.22%
SUI $0.9130 -3.15%
XLM $0.1686 -1.88%
ZEC $1,255.59 -4.49%
AAPL $348.36 +0.72%
AMZN $252.29 -0.69%
GOOGL $291.26 -10.71%
MSFT $546.04 +2.90%
META $619.71 -0.64%
NVDA $214.34 -2.53%
TSLA $403.19 -1.55%
SNDK $1,372.60 +0.24%
INTC $92.21 -3.79%
SPCX $144.06 -3.83%
MU $956.41 -1.27%
AMD $563.91 -1.15%

putin

All
Article
Flash

Huawei Ascend 950PR's matrix computing speed is only 43% of H100

The semiconductor research organization SemiAnalysis has released the actual test results of Huawei's Ascend 950PR. The organization selected 1,055 sets of commonly used matrix calculations for large models. Huawei's own underlying program has allowed the 950PR to achieve 86% of its theoretical computing power, higher than NVIDIA's H100 at 75.5%; however, the actual computation speed is still only 43% of the H100, and only 21% compared to the relatively newer B300. This set of results has not yet utilized the newly ported operators from DeepSeek.DeepSeek is working on reducing data movement and waiting from the software side. In attention computation, after adjusting storage with FlashMLA, the two sets of data that originally needed to be read separately can now be retrieved at once; TileLang allows the chip to compute while preloading the next batch of data. SemiAnalysis measured that automatic scheduling has reduced the time for some small computing tasks by up to about 40%. DeepSeek has also ported DeepEP, which is responsible for MoE expert communication, but communication and computation will still compete for memory bandwidth, and Huawei plans to continue improving the firmware.Last year, DeepSeek attempted to train R2 using Huawei's Ascend chips, but even with Huawei engineers on-site for assistance, it could not be completed due to issues related to chip stability, inter-card communication, and software support. This year, both parties continue to collaborate, and by the end of September, DeepSeek focused on publicly releasing six sets of Ascend adaptation code. In October, it was reported that Huawei is adjusting the next generation of chip designs according to DeepSeek's model requirements. The 950PR tested this time is mainly aimed at inference input processing, while DeepSeek is preparing to use the 950DT for large-scale pre-training as early as the end of the year. Previously, both parties had conducted tests at the thousand-card level, but to enable tens of thousands of chips to complete a round of large model training continuously, more complex coordination and stability issues still need to be resolved.

Institution reviews Anthropic's prospectus, focusing on growth and computing power costs

After Anthropic publicly submitted its prospectus the previous evening, investment institutions and market participants began to assess its growth quality, cost structure, and potential valuation. Morningstar senior equity analyst Malik Ahmed Khan and PitchBook analyst Rolfes stated that as of September 30, Anthropic had over 11,900 enterprise customers contributing at least $100,000 in revenue over the last 12 months, compared to about 950 in the same period last year. Khan believes this reflects a faster adoption of Claude in the enterprise market and significant revenue growth.Analysts also pointed out that the rapid increase in customer numbers alone is insufficient to indicate long-term revenue stability. The prospectus lacks detailed data on customer retention, and the disclosed net revenue retention rate is also affected by a small base; as the comparison base expands, this metric may decline. Investment in computing power is another focus. Morningstar believes that Anthropic currently demonstrates a certain level of computing efficiency and operational efficiency, but some computing resources and related expenditures have not yet been fully reflected; as more computing power is utilized, costs may rise, and if revenue growth does not keep pace, profit margins will be under pressure.PitchBook analyst Rolfes reminded that the scale of future computing contracts and infrastructure commitments is enormous, and whether revenue growth can be sustained is an important variable in assessing profitability prospects. Gavin Baker, managing partner and chief investment officer of Atreides Management, stated that it is still possible for Anthropic to reach an annualized recurring revenue of $100 billion by the end of the year; this statement reflects his personal judgment and is not the company's published performance guidance. Nigel Green, CEO of independent financial advisory firm deVere Group, questioned the market's rumored potential valuation of $2 trillion, calling this expectation "absurd," and reminded to pay attention to infrastructure investments, slowing growth, and future financing needs. The $2 trillion figure remains a market rumor, and the prospectus has yet to determine the offering price and scale.

first_img Evan Conrad: Most AI startups cannot purchase computing power

Evan Conrad published an article on October 22 titled "The end of startups," with the subtitle "The coming credit crunch." Evan Conrad stated that within the next six months, most AI startups will be unable to purchase computing power, as global computing power is sold out. To obtain capacity, new clusters need to be contracted, and it is becoming increasingly difficult for non-investment-grade entities to secure online capacity.Evan Conrad mentioned that startups are not investment-grade, thus they are required to pay larger upfront payments. He has seen cases where 100% of the contract amount is required to be prepaid, as lenders and cloud providers are unwilling to take on additional credit risk. He believes that investment-grade tenants are scarce, and due to leveraging and selling to non-investment-grade token buyers, their ratings are downgraded, which he refers to as a credit bottleneck. He anticipates that investment-grade GPU buyers will increasingly demand that token buyers themselves be investment-grade or pay large upfront deposits.In the article, he provides an example where, at the time of writing, B300 could be purchased for $6 per hour and then sold for approximately $30 per hour for inference. He expects GPU prices to rise, and the gross margin for inference layers to decline, making it harder for clients with poor credit to obtain tokens. He proposed that lenders treat GPU clusters as collateral and stated that the physical delivery forward market SF Compute could allow lenders to use GPU hours on a liquidity book as collateral, rather than relying on a single service provider's cluster.

first_img Alibaba Cloud helps Jielue Xingchen build a computing power factory, creating 30,000 sandboxes in minutes

The official account of Alibaba Cloud stated that the large model company Step Star has globally released its flagship open-source model Step 5 Preview, positioned as a primary working model for real-world intelligent agent tasks, excelling in AI programming, software engineering, professional knowledge work, and financial scenarios. The model has a total of 600 billion parameters and 27 billion active parameters, utilizing sparse MoE, with a maximum context window of 1 million, capable of processing text, images, and videos. The article mentions that it recently ranked second globally in both weekly and daily call volume on OpenRouter. On the day of the release, Alibaba Cloud announced the completion of DAY0 adaptation, optimized for joint inference based on chips, super node instances, and models, with inference computing power provided by the Lingjun super node.Step Star has developed its own intelligent agent reinforcement learning training platform, with the sandbox platform managed by Alibaba Cloud. The solution is based on Alibaba Cloud's Agent Sandbox and Kubernetes container service, aimed at elastic computing power in training mode, claiming to create tens of thousands of sandboxes in a single minute, with a maximum concurrency of up to one million, compatible with E2B API, and providing native Kubernetes interfaces. Through multi-level image caching, intelligent pre-scheduling, and control link optimization, it achieves millisecond-level application and minute-level creation of 30,000 sandboxes, with the sandbox lifecycle uniformly managed by Alibaba Cloud's backend.In terms of storage, each Pod starts with 15GB of free temporary storage, automatically increasing by 30GB each time when usage exceeds 70%, up to a maximum of 300GB. For security, MicroVM-level isolation is adopted by default, covering computing, networking, storage, and permissions, with zero-trust access to cloud products and large model interfaces. The results provided in the article include: a 90% reduction in image startup time, model evaluation cycles compressed from weekly to daily, and an average savings of about 40% on EBS storage costs; relying on ACK One Fleet, it can support the stable operation of hundreds of thousands of sandboxes simultaneously.
app_icon
ChainCatcher Building the Web3 world with innovations.