Against the backdrop of explosive growth in generative AI, deepfake capabilities powered by large language models are being maliciously exploited by certain merchants. Using AI face-swapping, voice cloning, and video synthesis, bad actors mass-produce fake celebrity accounts to conduct deceptive livestream marketing. This not only violates portrait rights but also severely disrupts the digital economy built on computing infrastructure.
A typical case disclosed by regulators shows that accounts such as "Department Store Supermarket" used AI chip-driven forgery systems to mimic celebrities and promote products. This behavior essentially constitutes an abuse of AI computing power resources and exposes current technological shortcomings in identity verification and content moderation. According to statistics, over 8,700 pieces of violative content have been removed across affected platforms, with the scope of this action setting a new record for similar campaigns.
This crackdown places special emphasis on platform responsibility, requiring companies to upgrade moderation algorithms and optimize risk identification mechanisms in large models. From an industry perspective, it reflects the dual-edged nature of AI technology—while the democratization of hardware computing power like GPUs lowers technical barriers, it also introduces novel regulatory challenges.