Human written

I compiled a year of local LLM experiments into a practical llama.cpp optimization guide, covering VRAM fitting, KV cache, MoE placement, MTP, CPU tuning, and common OOM traps. Pass this to an LLM of your choice and get on the local model train.

https://carteakey.dev/blog/local-inference/local-llm-optimization/

Feedback and corrections are welcome.