@karebu also i get like 180 t/s on it or something extremely stupid so im not fussed lmao, if you havent already then start using the gemma QAT models on hf they're great
@karebu honestly the way ive got it setup, whisper/piper on my main server (on CPU) and ollama on my desktop for the model, its like almost instant for everything. i wanna try do the voice thing so fucking bad tho 😭😭😭 what's that ui you're using btw?
i bet it must've been crazy good to see stephen strange, effectively a 2016-era redditor, getting completely mogged with "le facts and logic is actually cringe"
