2026-11-08 12:31:36
Homelab Builder Runs 2.8-Trillion-Parameter AI Model on Intel Optane Memory Alone, Warns of Extreme Heat Threat to DRAM
According to Tom's Hardware, a homelab builder recently ran Moonshot AI's 2.8-trillion-parameter Kimi K3 model on Intel's second-gen Optane PMem 200 memory using a 40-core 3rd-gen Xeon Scalable CPU and CPU-only inference, achieving 0.85 tokens per second with 1-bit quantization. The builder warned t
