ByteDance trains a 100 trillion parameter AI model, aiming for global top-tier standards

According to the Financial Times, as Chinese companies continue to narrow the gap with the top AI labs in the United States, ByteDance is training an AI model that may be close in scale to Anthropic's advanced Mythos system. According to three insiders, this Chinese tech giant is currently in the early stages of training a large-scale model, which may have a parameter count reaching the trillions, approximately three times that of the largest model released in China, the Kimi K3 model under the Moonlight brand.

One insider stated that ByteDance's model is currently undergoing pre-training, a phase that typically takes three to six months. If all goes well, it will then undergo fine-tuning and be released. The specific scale of the model will be determined later. Anthropic has not publicly disclosed the parameter scale of its models, but industry estimates suggest that its advanced Mythos 5 model has a parameter count of about 8 trillion, while Fable 5 has around 5 trillion.

It is important to note that the number of parameters determines the model's basic capacity for storing information or memory limit, but the actual capabilities of the model also depend on other factors, including data quality and training methods.