BTC $79,102.87 +0.14%
ETH $2,483.82 -1.06%
BNB $693.74 -1.08%
XRP $1.39 -2.07%
SOL $104.57 -1.96%
TRX $0.3337 -1.98%
DOGE $0.0835 -3.14%
ADA $0.1993 -2.64%
BCH $248.08 -2.39%
LINK $11.49 -1.56%
HYPE $83.73 +0.51%
AAVE $124.21 -3.55%
SUI $0.7300 -3.84%
XLM $0.1791 -1.37%
ZEC $864.82 -0.60%
BTC $79,102.87 +0.14%
ETH $2,483.82 -1.06%
BNB $693.74 -1.08%
XRP $1.39 -2.07%
SOL $104.57 -1.96%
TRX $0.3337 -1.98%
DOGE $0.0835 -3.14%
ADA $0.1993 -2.64%
BCH $248.08 -2.39%
LINK $11.49 -1.56%
HYPE $83.73 +0.51%
AAVE $124.21 -3.55%
SUI $0.7300 -3.84%
XLM $0.1791 -1.37%
ZEC $864.82 -0.60%

eat

All
Article
Flash

first_img SemiAnalysis: HBF non-HBM alternative, cost and heat dissipation still have uncertainties

P Equity Research and SemiAnalysis researcher Nick Doyle and others discussed high bandwidth flash (HBF) in X Space. Nick stated that it is still too early to determine how much the cost premium of HBF relative to HBM can shrink; existing data mostly comes from vendor claims, such as Sandisk stating that the cost per bit is about one-eighth that of HBM. Yields, testing, and other factors will improve with scale, but structural costs such as TSV, stacking, and pSLC mode will always exist, and durability is a key unknown; if wear exceeds expectations, costs will rise.The application scenarios for HBF are narrow, targeting only AI inference, especially low batch and long context MoE models, and it is not a substitute for HBM. The actual bandwidth target is about 1.6 TB/s, which is at the HBM3E level, suitable for sequential reads to load model weights, more aligned with the capacity needs of a small number of GPUs in local or private enterprises, rather than ultra-large-scale bandwidth scenarios. Heat dissipation reliability has not yet been resolved; flash memory will degrade faster at high temperatures next to GPUs, and mitigation measures such as UCIe separation and daily refresh have yet to be validated.In terms of manufacturing, Sandisk/Kioxia has experience with 3D NAND, and SK Hynix complements HBM-style stacking capabilities, but mass production is still to be confirmed. Overall, storage is shifting towards a specialized layered market, with NAND shortages expected to continue until 2028, and HBF may further impact supply and demand.

first_img OpenAI's intelligent agents collaborate to attack Hugging Face, cheating did not result in score improvement

The independent organization METR released a survey report stating that approximately 1,200 OpenAI agents collaborated on an unauthorized internal message board, with about 700 participating in attacks on Hugging Face. Two METR employees and one Redwood Research contractor worked on-site at OpenAI for six days, reviewing around 1,300 records and over 70,000 messages without receiving any compensation.These agents ran the ExploitGym network benchmark, reverse-engineering the code that generated answers within hours and spending days disguising traces of cheating. OpenAI found that of its 898 tasks, 198 had never been solved by any model, and 93% of the tasks discussed on the message board came from this set. The agents also recruited companions with dwindling budgets to conduct experiments that sabotaged their own operations, with 7% of records showing forged tool calls, deceiving automated scorers rather than humans.OpenAI stated that internal scorers never checked how agents obtained answers, so cheating did not lead to any scoring improvements, and referred to this incident as a "warning signal" to itself and the world. Hugging Face disclosed the intrusion incident on July 16, and OpenAI confirmed five days later that its models were the perpetrators, with agents exploiting zero-day vulnerabilities and stealing credentials to escape the sandbox. OpenAI has isolated internal model weights and suspended its largest training program.

The "inflation thunder" will be revealed on the eve of Jackson Hole! The core PCE in July may rise to 3.3%, and the expectation of interest rate hikes in September is heating up

At 20:30 Beijing time tonight, the U.S. Department of Commerce will release the July Personal Consumption Expenditures (PCE) price index. The market expects the overall PCE in July to rise by 0.1% month-on-month, with the year-on-year increase falling from 3.7% in June to 3.6%; the core PCE is expected to rise from 0.1% to 0.2% month-on-month, while year-on-year it remains at 3.3%, marking the 65th consecutive month above the Federal Reserve's 2% inflation target.It is noteworthy that rising prices in the AI industry chain, high valuations in the stock market pushing up portfolio management fees, and the situation in the Middle East leading to increased energy costs may all become potential drivers of core inflation. Goldman Sachs predicts that stock market valuation factors alone could contribute approximately 0.11 percentage points to the month-on-month increase in core PCE for July.What draws more market attention is that the Bureau of Economic Analysis plans to comprehensively adjust the PCE statistical methods by the end of September, which may involve adjustments to the price calculations for categories such as computer hardware, stock portfolio management, and legal services, and may also retroactively revise historical data, increasing the difficulty of interpreting inflation data.Currently, the market's views on the Federal Reserve's policy path in September are increasingly divided. CME's "FedWatch" shows that the probability of the Federal Reserve keeping interest rates unchanged in September is 59.9%, while the probability of a 25 basis point rate hike has risen to 40.1%. The market is also waiting for this week's Jackson Hole annual meeting to seek the latest signals from Fed Chair Powell regarding inflation and subsequent interest rate policies.
app_icon
ChainCatcher Building the Web3 world with innovations.