WEKA's Val Bercovici: KV Cache, DeepSeek V4, HBF, SLC vs QLC NAND, CXL, NVLink, Tokenomics
Val Bercovici of Weka returns to break down where AI inference memory is heading. He and Vik cover KV cache compression, DeepSeek's cache read pricing out of China, NAND flash tiers, high bandwidth flash, and why CXL keeps losing to NVLink and RDMA over Ethernet. They close on small models at the edge and whether SaaS companies will buy Neoclouds to own their token stack. Chapters: 0:00 Intro and memory prices 3:00 Model routing and offloading 5:10 Network faster than motherboard 13:06 Four-tier memory hierarchy 19:40 KV cache and Jevons paradox 23:50 DeepSeek cache read pricing 31:40 Sliding…