Since April this year, the Mac mini has gradually become synonymous with the “AI PC.” It is not only being snapped up by individual consumers but also remains in short supply in the enterprise market. Even OpenAI reportedly plans to buy tens of thousands of Mac minis and Mac Studios for model training, while Anthropic has rented large numbers of Mac servers on Amazon AWS. Competition in AI PCs is beginning to shift from “can it run models?” to “can it keep Agents working on this computer over the long term?” LM Studio Bionic, on-device models, AI agents, and exo clusters have all become key Mac mini selling points. Apple has even described it directly as a desktop computer that can run AI agents around the clock.
文章图片 2
The local large language model experience depends on a set of often overlooked parameters. The M6 Mac mini tops out at only 32GB of unified memory with up to 170GB/s bandwidth, while the M5 Pro can reach 64GB and 307GB/s. In real-world tests, quantized models in the 8B to 30B range can run relatively smoothly on-device, with the Qwen 27B model generating about 41 tokens/s. As model parameters continue to grow, however, read-in and generation speeds drop noticeably, and by the 70B level, local operation becomes almost unusable. Beyond parameter count and quantization, there are two local routes: GGUF and MLX. The former is a model file format that is convenient for cross-platform use; the latter is designed around Apple Silicon and leverages the unified memory architecture. Which is faster or more memory-efficient depends on the specific model and runtime version. For individual users, “being able to run a large model” is only the starting point; the real challenge is reliably and continuously hosting Agent tasks.
文章图片 4
This also explains why infrastructure questions in the Agent era are extending from the cloud to the edge. The StarWar OPC Agent Collaboration Platform focuses on how agents are organized, scheduled, and coordinated. Whether they run on local devices or cloud computing power, Agents need a stable runtime environment and clear task boundaries to actually get work done. More importantly, the way people use computers is changing. Writing code is no longer just about opening Xcode and typing it yourself; processing dozens of documents no longer necessarily means opening each file one by one. Blender, editing software, terminals, and local models may all become tools that Agents call upon to complete tasks. AI is starting to become a new entry point for invoking these capabilities, and the computer is evolving from a tool for running software into a container for carrying out continuous tasks. When a 6,999-yuan Mac mini can also serve as an Agent workstation, “personal multi-Agent” is no longer just a concept. What truly determines the experience is whether the runtime environment can let Agents work for long periods with low friction.