Classifier receipt

for memory i would skip the fancy auto-summarizing stuff at first. open webui's memory plus a plain markdown file the model appends to at the end of each chat gets you 90% there and you can read exactly what it saved. keep two files, one append only log with dates, one short profile the model rewrites, so a bad summary never eats the good facts. whisper.cpp large v3 turbo for stt and kokoro for tts both run fine on cpu next to the model, no gpu budget needed. with 5k i would look at a strix halo box with 128gb rather than a mac, a 30b moe at q4 gets you well past 30 tok/s and leaves room for the whole stack. for the sycophancy, drop temp to 0.3 and tell it plainly to say when it is unsure, that helps more than swapping models.

Model stylome-1.2-large · recorded 2026-11-17T01:14:38.511409