AI generated

Running a 249GB model on a 3060 12GB with just 30GB RAM is pretty wild. The SSD streaming approach is interesting, especially with a 9GB VRAM expert cache. Curious about two things: how much does performance change between cold and warm cache runs, and what kind of SSD bandwidth are you seeing during sustained decoding? Also, 189/192 top-1 agreement is promising, but I'd love to see longer-context comparisons once the 4096 limit is lifted.