theia-llama-3.1-8b

ChainCatcher news, the decentralized full-chain data network Chainbase announced the open-source release of the cryptocurrency-centric large language model Theia-Llama-3.1-8B, with training data sourced from CoinMarketCap and detailed project research reports. Chainbase stated that this model has a lower perplexity and a higher BERT score compared to other mainstream models, utilizing LORA for efficient fine-tuning, allowing large pre-trained models to adapt to specific tasks with lower computational power, significantly reducing the model's memory footprint and accelerating inference speed while maintaining acceptable accuracy.According to previous reports, Chainbase completed a $15 million Series A financing round in July this year, led by Tencent Investment Group and Matrix Partners China.

ChainCatcher news, the full-chain data network Chainbase announced the open-source of its large language model Theia-Llama-3.1-8B specifically designed for the cryptocurrency field on HuggingFace.The Chainbase team has innovatively built the first professional Web3 dataset, which includes various information on the top 2000 projects from CoinMarketCap. The dataset has been manually and algorithmically filtered to ensure the accuracy, diversity, and professionalism of the training data. Based on this dataset, the team efficiently fine-tuned the model using LoRA technology and accelerated the training process with tools like DeepSpeed. The model has been quantized to the Q8 GGUF format, significantly reducing memory usage and improving inference speed.It is reported that Theia-Llama-3.1-8B is Chainbase's initial attempt at a large model in the cryptocurrency field, and this model has been successfully applied in Chainbase's DEMO interactive application TheiaChat, which currently has over 300,000 daily active users.