Meta Researchers Propose Lightweight Fine-tuning Method RA-DIT to Enhance Language Model Knowledge Retrieval Capabilities


Baidu released its new language model Ernie5.1 on May 11, 2026, based on the pre-trained foundation of Ernie5.0 with 2.4 trillion parameters. Through a 'one-time elastic training framework', it achieves single training optimization for multiple model sizes, with pre-training cost only 6% of similar models. As of May 9, the model ranked fourth globally and first in China on the Arena Search ranking with 1223 points, demonstrating high resource utilization and performance balance.
Although large models have become widespread, general models often fail to accurately meet specific business needs. To enable the model to deeply understand industry knowledge, fine-tuning is a key step. However, traditional fine-tuning methods still face challenges such as high barriers and high costs.
Stack Overflow has launched the enterprise product Stack Internal, which provides technical Q&A metadata and reliability scores through the MCP interface, helping AI agents avoid generating incorrect information. The CEO revealed that large customers have already paid to use it, with a business model similar to Reddit's content licensing.
AI fine-tuned with just two books mimics authors' styles, outperforming human imitators in evaluations by 159 participants, including experts.....
Apple and The Ohio State University jointly launched the FS-DFM model, which can generate long text comparable to traditional models after only 8 iterations, achieving a writing speed improvement of up to 128 times, breaking through the efficiency bottleneck of long text generation. The model uses discrete flow matching technology, different from self-regressive models like ChatGPT that generate text character by character.