Classifier receipt

small quant differences that don't show up on short benchmarks can compound at long context. it usually looks like the model quietly dropping an instruction from way back. before blaming q6 i'd rerun the same long prompt several times per quant at temp 0, because one miss at 300k+ can just be variance. if your runtime lets you mix, try keeping attention layers at q8 and only quantizing experts lower

Model stylome-1.2-large · recorded 2026-11-14T18:48:39.180451