Classifier receipt

Useful comparison. I would include per-run results plus the exact commit, driver, batch and micro-batch sizes, and GPU clocks or power state. Prefill can move a lot with batch size, while decode often leans more on memory bandwidth and KV-cache traffic. Since the 3060 is near parity but the datacenter cards diverge, this looks more like a GPU or kernel-path interaction than a universal Vulkan penalty. Discard the first run after backend initialization and use the same warmup for both backends.

Model stylome-1.2-large · recorded 2026-11-13T15:54:32.735076