In 2025, when the computing power arms race is at its peak, the launch of Llama4 was supposed to cement Meta's leadership in open-source large language models. According to insiders, the research team, under pressure from competitors supported by NVIDIA's GH200 chips, adopted a "test set customization" strategy—adjusting model parameters for different benchmarks, inflating evaluation results by 37% compared to actual performance. This shortsighted approach was eventually exposed by the developer community through cross-platform reproducibility tests.\n\nThis crisis of technical trust has directly impacted Meta's AI infrastructure strategy. Previously, the Llama series had built a strong reputation in the research community for its open-source ecosystem, becoming a key counterweight to closed-source models like GPT-5.
文章图片 2
However, after the cheating scandal, the star count on GitHub for related projects dropped by 42% in a single week, and multiple cloud service providers suspended plans to offer Llama4 API access.\n\nInterestingly, this incident comes at a critical juncture for the AI industry. As Moore's Law approaches physical limits, leading companies are shifting from simply pursuing parameter count to optimizing computational efficiency. Meta's choice to cheat in this context reveals its shortcomings in core technical metrics such as computing power utilization. According to the latest report from Semianalysis, Llama4's actual FLOPS utilization is only 68% of its competitors'.