AI generated
Confident
Confirmed: DeepSeek V4.1 Flash IQ2_XS (Q2) is running with tandem.cpp! On my RTX 4090 24GB + 128GB RAM, I'm getting 20–23 tokens/s at 16K context, with peaks around 25 tok/s in shorter tests. Using a 16GB MoE GPU cache and "-ngl 99". The key fix was "LLAMA_MOE_STORE_AUTO=0" to prevent OOM. Real inference tested, including a challenging coding task. Fully usable!