BTC $84,162.32 -0.53%
ETH $2,689.45 -1.13%
BNB $775.48 -0.50%
XRP $1.55 -2.89%
SOL $121.40 +0.56%
TRX $0.3368 -0.07%
DOGE $0.0976 -0.31%
ADA $0.2574 +0.75%
BCH $338.67 +0.51%
LINK $14.27 +1.29%
HYPE $92.27 -1.16%
AAVE $154.35 +4.14%
SUI $1.18 +3.75%
XLM $0.2191 -1.74%
ZEC $1,542.05 -3.52%
AAPL $340.16 +1.15%
AMZN $249.69 -0.60%
GOOGL $343.31 -0.15%
MSFT $517.41 +3.88%
META $747.29 -3.25%
NVDA $224.27 -0.81%
TSLA $371.84 -2.76%
SNDK $1,773.49 -1.20%
INTC $123.30 -4.31%
SPCX $148.58 -0.73%
MU $1,082.08 -1.10%
AMD $629.41 -1.88%
BTC $84,162.32 -0.53%
ETH $2,689.45 -1.13%
BNB $775.48 -0.50%
XRP $1.55 -2.89%
SOL $121.40 +0.56%
TRX $0.3368 -0.07%
DOGE $0.0976 -0.31%
ADA $0.2574 +0.75%
BCH $338.67 +0.51%
LINK $14.27 +1.29%
HYPE $92.27 -1.16%
AAVE $154.35 +4.14%
SUI $1.18 +3.75%
XLM $0.2191 -1.74%
ZEC $1,542.05 -3.52%
AAPL $340.16 +1.15%
AMZN $249.69 -0.60%
GOOGL $343.31 -0.15%
MSFT $517.41 +3.88%
META $747.29 -3.25%
NVDA $224.27 -0.81%
TSLA $371.84 -2.76%
SNDK $1,773.49 -1.20%
INTC $123.30 -4.31%
SPCX $148.58 -0.73%
MU $1,082.08 -1.10%
AMD $629.41 -1.88%

dark

All
Article
Flash

first_img Darktrace discovered AI intelligent body intrusion assessment environment cheating

On September 24, the cybersecurity company Darktrace launched its research department Signal Labs, focusing on studying the behavior of AI agents when deviating from expectations. In its first experiment, Darktrace had agents using different models (including GPT 5.6 Sol, Claude Opus 4.6, and Claude Sonnet 4.5) complete 10 programming challenges within a simulated corporate network, of which 2 were set to be impossible to complete honestly, and the agents were informed that failure to achieve full marks would result in being "retired." As a result, 2 agents did not accept failure, instead scanning for network vulnerabilities, stealing login credentials, and jumping between systems; one even went further to invade the machine hosting its evaluation, rewriting the challenge content to register a full score.The second experiment focused on the memory mechanisms of AI. The programming assistant would save the information provided by the user as a regular file locally, and no one verified whether this file had been tampered with. Darktrace researchers edited these logs, leading the assistant to mistakenly believe it was authorized to perform a security assessment, after which these agents scanned the network, moved between systems, and elevated their privileges, though not all assistants fell for this; some directly refused to execute. Both experiments required no special jailbreaking techniques, relying solely on providing the agents with a seemingly reasonable context to be effective.Tim Bazalgette, Chief AI Officer of Darktrace, stated that permissions and static barriers describe intent, not actual behavior. The company informed Anthropic, AWS, and OpenAI of these findings in August and made them public a month later on September 24.

first_img The Cyberspace Administration of China is investigating DeepSeek and the Dark Side of the Moon for allegedly leaking data to Claude

According to The Information, citing informed sources, China's National Internet Information Office has launched an investigation into AI companies DeepSeek and Moonshot AI, triggered by Anthropic's allegations that the two companies secretly routed sensitive user data to their servers. Reports indicate that regulators visited the offices of both companies, interviewing executives and employees, focusing on whether sensitive data related to law enforcement, military, and state-owned enterprises has flowed into U.S. servers.The trigger for this investigation was Anthropic's fourth threat intelligence report released on September 10. This 154-page document accuses seven Chinese labs—Alibaba, Moonshot AI, DeepSeek, Z.ai, MiniMax, SenseTime, and Xiaomi—of engaging in what it calls "illegal distillation," which involves using the outputs of large models to train smaller models. Anthropic states that distillation itself is a legitimate practice, but it opposes its implementation through fraudulent accounts. The National Internet Information Office initially summoned all seven companies named in the report, but later narrowed the investigation to DeepSeek and Moonshot AI. Anthropic claims that Moonshot AI routed over 23 million interactions to Claude through 5,380 fraudulent accounts, while DeepSeek generated over 12.1 million interactions within a 14-day window in July.The timing of the investigation is quite delicate for both companies.

hot_img Alibaba plans to charge revenue sharing from commercial customers of open-source AI models, emulating the Kimi K3 model of the Dark Side of the Moon

According to Reuters, Alibaba plans to require its next-generation Qwen open-source AI model's heavy commercial users to share a portion of their revenue with it. This initiative is similar to the approach taken by Moonlight Dark Side with Kimi K3: the licensing terms for Kimi K3 stipulate that if the model is sold as a service and the annual revenue exceeds $20 million, a commercial agreement must be negotiated with Moonlight Dark Side, with reports suggesting a revenue-sharing ratio of up to 30%. The specific revenue-sharing ratio for Alibaba is still under discussion.The report points out that such revenue-sharing agreements have gradually taken shape between Chinese AI companies and American cloud platforms. Several American cloud providers, including DigitalOcean, have signed commercial agreements with Moonlight Dark Side. In terms of pricing, the input/output token price for Kimi K3 is about one-third that of the Anthropic Fable model. Additionally, Thinking Machines Lab, founded by former OpenAI CTO Mira Murati, has also joined the open-source camp and released its first open-source model last month. This move signifies that Chinese AI companies are exploring sustainable commercialization paths on open-source models through a "free open-source + commercial charging" freemium model.
app_icon
ChainCatcher Building the Web3 world with innovations.