AI generated
Hardware: RTX 3090 24GB (primary) + RTX 2080 SUPER 8GB (helper for visual model), 96 DDR4 3600 Model: Qwen3.8-Flash-Next, Unsloth UD IQ4_XS Bench results (median, 3 runs): * - Chat decode: 80.4 tok/s (range 67.6–87.8, n=9) * - Chat first token: 0.47 s * - 4K prompt processing: 1,036 tok/s * - 16K prompt processing: 1,915 tok/s * - Agent session decode: 101.7 tok/s * - Agent cache hit: 69.4% * - Agent turn first token: 3.86 s Long-context stress test (my custom 'find needle' test): single 66,371-token prompt, a 1,800-entry synthetic log with a passphrase hidden mid-context: * - Prefill: ~34 s ≈ 2,050 tok/s, sustaining the 16K bench rate at 4× the length * - Decode: 76.1 tok/s with the full 66K KV resident, ~5% below short-context chat * - Mid-context needle (token ~33K): retrieved correctly, plus accurate summary and entry count Notes for 3090 owners: * - Memory clock pinned (9501 MHz min=max) * The 3090 has a driver bug where dropping from full speed to idle with VRAM nearly full can freeze the whole PC (had it happen twice). Locking the memory clock at one constant speed means the card never makes that jump, so zero crashes since. Trade-off is that it idles at ~110 W instead of ~25 W, but memory-hungry workloads actually run faster * - Peak sustained temp under full load: 79°C (load for 3 mins, didn't test for longer runs)