tpu

Google's Senior Director of Supply Chain Infrastructure, Nikhil Cherian, revealed that to overcome memory bottlenecks, Google is developing software and hardware solutions and dismantling retired servers to recycle DDR4 components to establish an internal recycling supply chain. Google has designed special hardware adapters to connect the previous generation DDR4 to the new generation of AI servers while importing retired servers to remove their DDR4 modules for recycling.Cherian stated that the AI industry has rapidly shifted from being compute-constrained to memory-constrained, with high-performance memory accounting for about 75% of the bill of materials cost for a given AI server. A Goldman Sachs report indicated that memory prices will continue to rise in the third quarter, with personal computer DRAM prices expected to increase by 18% to 23% and server DRAM prices expected to rise by 13% to 18%. Trendforce data shows that in August, the spot market prices for DDR4 8GB and DDR5 8GB rose to $142 and $133, respectively.The two TPU ASICs launched by Google this year have been optimized for memory design, claiming to reduce memory demand to one-sixth of the original. The TPU8i chip features a dedicated layered memory design that relies on a high-speed DDR5 memory architecture to perform host-level tasks, with each chip equipped with 288GB of HBM3e high-bandwidth memory.

The SEMICON Taiwan 2026 Memory Summit took place on the 1st, where Nikhil Cherian, Senior Director of Supply Chain Infrastructure at Google Cloud under Alphabet, pointed out that with the popularity of multimodal and mixed expert architectures, AI computation has shifted from being power-limited to memory-limited, with high-performance memory accounting for over 75% of the cost of AI server hardware bill of materials. In the face of capacity, bandwidth, and power consumption bottlenecks, Google is breaking through the AI memory bottleneck through a dual-track strategy of hardware offloading for inference and training, and lossless quantization software algorithms.Google adopts an offloading strategy in hardware architecture, launching TPU 8i for low-latency inference and TPU 8t specialized for large-scale training. The TPU 8i is equipped with 288 GB of high-bandwidth memory, with SRAM capacity on the chip increased threefold to 384 MiB, placing dynamic conversation states and key-value caches on the chip itself to achieve zero chip-off latency. The TPU 8t forms a super-large computing cluster with 9600 chips, achieving a shared pool of HBM at a scale of 2 PB, eliminating chip-off data transfer bottlenecks, along with TPU Direct Storage technology.Google has developed the training-free TurboQuant lossless quantization algorithm, compressing the key-value cache of large models from 32 bits to 3 bits, reducing memory usage by six times without loss of accuracy, resulting in an eightfold acceleration in attention computation, and integrating old-generation DRAM technology to extend the lifecycle of components.

According to a report by the Economic Daily, ASE Technology Holding benefited from the increased capacity of Google TPU, significantly adding advanced packaging and testing orders. Intel is accelerating the promotion of its EMIB advanced packaging platform while simultaneously expanding its outsourcing orders to ASE Technology Holding, with the previously raised testing quotes showing benefits. Google continues to increase its AI capital expenditures to expand data centers, using TPU to support the Gemini large model, AI agents, and Google Cloud services. The market estimates that Google TPU will enter a large-scale production phase by 2028, with shipments expected to reach 12 to 15 million units. ASE Technology Holding has mastered 2.5D, 3D advanced packaging, and high-end testing technologies, and Google is also expanding its use of TSMC's advanced processes and CoWoS capacity.Intel is racing to advance its EMIB packaging platform, with major cloud companies like Meta and Google successively adopting the EMIB and EMIB-T platforms. ASE Technology Holding, positioned as a pure testing and packaging foundry, can directly procure organic embedded silicon bridge substrates to undertake backend wafer-level assembly and high-end testing services. Wu Tianyu, the Chief Operating Officer of ASE Technology Holding, believes that Intel's EMIB and TSMC's CoWoS are not zero-sum competitors. As the testing time for AI chips lengthens, the costs of equipment, materials, and labor are rising, and high-end packaging and testing capacity is becoming increasingly tight. Major testing and packaging factories have gradually raised prices based on products, capacity, and customer conditions, with increases of about 5% to 10%.

According to DIGITIMES, the Taiwanese semiconductor supply chain reveals that advanced packaging technology is diversifying, with Intel's EMIB becoming a key option. Google TPU has confirmed the adoption of EMIB packaging, and the first TPU using this technology has met yield standards, with technology, cost, and capacity performance all aligning with Google's original criteria. The likelihood of continuing to use EMIB in future generations of TPU has significantly increased.Against the backdrop of ongoing tight capacity at TSMC's CoWoS, as long as EMIB yield and technology remain up to standard, Google will continue to adopt it. MediaTek, as a relevant ASIC partner, has some managers in its U.S. team with Intel backgrounds, facilitating smoother collaboration between the two parties. Although MediaTek still relies heavily on TSMC, its success with Intel on TPU helps solidify Google's trust, secure more projects, and provide diverse packaging solutions to cloud customers.Previously, TSMC called for more suppliers to invest in advanced packaging to share the pressure during its earnings call. The supply chain generally believes that its own capacity expansion will not be limitless, making the diversification of packaging paths, such as those from Intel, a necessary direction, and related testing equipment and interface companies are also expected to benefit.

DeepSeek announced the new pricing for the V4 API, effective August 17. The V4-Pro peak period price for cache misses on input has increased from 3 yuan to 9 yuan per million tokens, and the output has risen from 6 yuan to 27 yuan, representing increases of 3 times and 4.5 times, respectively.During off-peak hours, although the price is only half of the peak rate, it is still more expensive than the current rates. The V4-Pro input is 4.5 yuan, and the output is 13.5 yuan; the V4-Flash input is 1.5 yuan, and the output is 4.5 yuan.Peak hours are from 9:00 to 12:00 and 14:00 to 18:00 Beijing time. The remaining hours are charged at off-peak prices.

The research organization SemiAnalysis released an analysis indicating that Google DeepMind is no longer among the leading AI laboratories. A week prior, DeepMind co-founder Demis Hassabis stepped back from daily operations, and key members such as Google Chief Scientist Jeff Dean and Gemini co-lead Oriol Vinyals left to establish a new lab called Discovery Loop. The analysis suggests that the long-term struggle within Google over computing power allocation between Gemini and GCP has concluded with GCP emerging victorious.SemiAnalysis stated that Gemini 3.5 Pro has been canceled, and Gemini 3.6 Flash's performance is inferior to that of leading Chinese open-source models and Grok 4.5. Currently, Gemini has fallen to the 8th or 9th position in the large model rankings. Meanwhile, GCP is selling a large number of TPUs to competitors like Anthropic, having secured long-term leasing and sales contracts for hundreds of thousands of TPUs over the past nine months. The Tokenomics model estimates that Gemini's own ARR is about $12 billion, while GCP's third-party AI cloud service revenue is expected to exceed $73 billion by the end of 2027, with TPU system sales contributing an additional over $120 billion. GCP's latest quarterly growth rate is 82%, and it is expected to accelerate to over 100% by 2027 due to TPU system sales, contributing approximately $3 to Google's earnings per share.

According to GlobeNewswire, Nasdaq-listed Bitcoin mining company Bitdeer released an unaudited production and operation update for June 2026. The company's Bitcoin mining output in June was 990 coins, a year-on-year increase of 388%; self-mining computing power was 73 EH/s, with a total managed computing power of 86.1 EH/s, and 243,000 self-owned mining machines.The Sealminer Nevada manufacturing plant has begun construction and is expected to be completed by the end of 2026. In terms of AI cloud business, monthly ARR has increased to $76 million, GPU utilization is at 95%, and the delivery of the NVIDIA GB300 NVL72 cluster has been completed. Currently, Bitdeer's total controllable power capacity globally reaches 3.02 gigawatts, with multiple cryptocurrency data centers simultaneously advancing the transformation into AI computing center plans.

According to PR Newswire, Canaan Creative announced unaudited Bitcoin mining operation update data, producing 64 Bitcoins in June.After deducting operating costs and accounting for the Bitcoins received from the sale of mining machines in June, the cryptocurrency reserves increased by 49 Bitcoins, bringing the total cryptocurrency holdings to a record 1,915 Bitcoins and 3,952 Ethers.

The U.S. stock-listed Bitcoin mining company Bitdeer disclosed that as of July 3, 2026, its own BTC holdings remain at 0, excluding customer deposits.This week, Bitdeer produced 223.1 BTC, sold 223.1 BTC, resulting in a net increase of 0 BTC. Bitdeer has disclosed its own BTC holdings as 0 since February 20, 2026, and it has continued for 19 weeks.

Tianfeng International analyst Ming-Chi Kuo revealed that Google is deepening its collaboration with MediaTek on the TPU v9, developing an upgraded chip codenamed Triggerfish. It is reported that MediaTek has exclusively obtained this high-value order. The new chip is positioned as a v9 variant with stronger inference capabilities, primarily targeting the AI Agent and reinforcement learning fields, aiming to address CPU and memory bottlenecks in the computing process.In terms of technical specifications, Triggerfish's SRAM capacity has increased by 2 to 3 times compared to the basic version (Humufish), with the addition of dedicated analog chips for reinforcement learning and AI Agent collaboration, and memory upgraded from HBM4 to HBM4E. Kuo expects that while the basic version chip maintains a shipment expectation of 4 to 5 million units, Google has added 1 to 2 million new orders for Triggerfish. The chip is expected to enter production by the end of 2027 and achieve mass production and shipment in 2028, with a unit price approximately 30% higher than the basic version, likely becoming a new driving force for MediaTek's business growth in 2028.

According to Reuters, private equity giant Apollo Global Management and Blackstone Group are bringing in more investors for a debt financing deal worth approximately $36 billion to help Anthropic build its artificial intelligence infrastructure.Insiders revealed that this debt financing will be used to purchase Google-customized TPU (Tensor Processing Unit) chips, which will then be leased by Anthropic. Broadcom, which assisted Google in developing the chips, will provide guarantees for the majority of the funds in this transaction.This move is expected to become one of the largest private credit transactions in history and may also be the largest chip financing debt transaction to date. The plan aims to provide computational power support for Anthropic by leveraging Broadcom's creditworthiness.

According to BBX data, several listed companies disclosed their latest reserve actions yesterday, with the core dynamics as follows:Tron Inc. (NASDAQ: TRON) announced that it increased its holdings of 154,494 TRX tokens at an average price of $0.3236 yesterday, further raising the total amount of TRX in its treasury to over 693.3 million tokens.The Jupiter Strategic Reserve Trust, Jupiter Litterbox Trust, increased its holdings by 211,474 JUP yesterday, valued at approximately $36,000. This month, it has accumulated a total purchase of 9,405,535 JUP, valued at about $1.63 million. As of now, its total purchases amount to 113,508,785 tokens, valued at approximately $19.76 million.Nasdaq-listed Bitcoin mining company Bitdeer (NASDAQ: BTDR) released the latest data on its Bitcoin holdings. As of the week of April 24, the Bitcoin mining output was 185.7 Bitcoins, but the same amount was sold during the same period, resulting in a net addition of 0 Bitcoins, and it currently maintains zero Bitcoin holdings.

According to PR Newswire, Bitcoin mining company Ionic Digital announced a mining output of 28.05 BTC in March, a month-on-month decrease of 14.9%, with an average daily hash rate of 2.04 EH/s, a month-on-month decrease of 19.4%.In terms of assets, Ionic Digital stated that the company still maintains a zero-debt structure as of now, and did not sell any Bitcoin in March. As of March 31, the total Bitcoin holdings increased to 2815.6 BTC, an increase of approximately 28.2 BTC compared to the previous month.

According to BBX data, global listed companies made key progress in "health optimization" of their treasury structures yesterday:$50 million addition: Boyaa Interactive (0434.HK) announced yesterday that the board has approved an additional budget of $50 million for increasing its holdings in Bitcoin and Ethereum. So far, the group has invested over $250 million, aiming to establish itself as the largest digital asset treasury entity in Asia.Officially entering "debt-free holding": TeraWulf (NASDAQ: $WULF) announced yesterday that it has used cash flow generated from its high-performance computing business to pay off the last of its high-interest debt. As one of the most energy-efficient mining companies globally, the company reiterated that it has entered the "100% output retention" phase as of yesterday.Computing power as net reserves: HIVE Digital (TSX-V: $HIVE) disclosed yesterday that the profits from its AI data center in Sweden have fully covered global operating expenses for two consecutive months. This means that all Bitcoin produced yesterday is recorded as "net reserves," with no need for any market sell-off.$10 million procurement settled: Acurx Pharmaceuticals (NASDAQ: $ACXP) confirmed yesterday that its first $10 million strategic procurement of Bitcoin has been fully completed. As a biopharmaceutical company, ACXP plans to use this asset as a "value anchor" for its clinical research and development funding over the next five years.Automated treasury upgrade: Public.com launched an "automated treasury balancing" suite for small and medium-sized enterprises globally yesterday, supporting the automatic proportional conversion of idle corporate funds into BTC, with the first-day subscription scale exceeding $80 million.

According to market news, the Nasdaq-listed Bitcoin mining company LM Funding America announced its financial performance data. The company mined 22 BTC in the fourth quarter of 2025 and held 354.7 Bitcoins as of February 28, 2026, including 174 Bitcoins held in the Galaxy Digital digital asset receivables account, with a total mining hash rate of approximately 782 PH/s.

Bitcoin mining company Ionic Digital disclosed on platform X that its mining output in February was 32.95 BTC, with an average daily output of 1.18 BTC. As of the end of February, its holdings increased to 2787.4 BTC.

According to BBX data, yesterday global listed companies showed a trend of transitioning from "opportunistic buying" to "standardized automatic execution" in their crypto treasury allocations:$150 million allocation: Robinhood (NASDAQ: $HOOD) board approved a $150 million BTC/ETH mixed purchase plan today. The company clearly stated that it will leverage the liquidity advantage of its proprietary trading platform to complete the position within the next 30 days, aiming to optimize the long-term purchasing power of the company's idle cash.92% output retention: Iris Energy (NASDAQ: $IREN) disclosed its operational data for the first quarter of 2026, revealing that its Bitcoin output retention rate reached 92% yesterday, and announced plans to acquire an additional 800 BTC using renewable energy power premiums, aiming to align the company's asset structure more closely with "hard assets."40% net asset ratio: Meitu (1357.HK) financial report shows that the fair value of its held crypto assets has accounted for 40% of its total net assets. The company announced that it will continue to implement the "profit-to-coin" plan, continuously investing 20% of its annual business net profit into Bitcoin reserves.300 BTC energy arbitrage: Aker ASA (Seetee) disclosed that through its industrial energy arbitrage project in Norway, it converted surplus electricity into a holding of 300 BTC again yesterday. This giant is continuously diluting its fiat currency debt risk through a closed loop of "energy-computing-assets."$5 million standard configuration: Wolfspeed (NYSE: $WOLF) board passed a resolution to approve $5 million in Bitcoin as a long-term treasury reserve for the first time. This further validates that the semiconductor and high-tech manufacturing industries are beginning to view BTC as a "standard component" for financial health.

According to PR Newswire, Nasdaq-listed Bitcoin mining company Canaan Creative has released an update report on Bitcoin mining, disclosing a mining output of 86 BTC. As of now, the total cryptocurrency holdings have reached a record 1,793 Bitcoins and 3,952 Ethers, estimated to be worth $128 million.In addition, it has also disclosed that the deployed computing power has reached 14.75 EH/s.

According to market news, Nasdaq-listed Bitcoin mining company CleanSpark has released its latest Bitcoin mining and operational update report, which discloses that the company mined 568 BTC, with a total of 1,141 BTC mined year-to-date. Additionally, the company revealed that it sold 553.02 BTC last month at a price of $66,279, bringing its total Bitcoin holdings to 13,363 BTC.

According to The Information, Meta has signed a multi-year agreement to lease Google TPU for training new AI models; Google has also established a joint venture to lease TPU externally and is in talks with Meta to procure TPU for its data centers as early as 2027.