i wonder how good ollama would run on my GTX 1060. i've still got it in my other PC, probably won't run llama3.1 8b but might do something else like llama3.2 3B or some gemini based thing. this is all so exciting
@karebu also explains why if you install it as a container it can't use add-ons since it probably doesn't have control over the docker/podman daemon (and probably for good reason lmfao)
@karebu piper for text to speech, and whisper for speech to text. it's all done locally so there's about a 2 second delay before it tells you anything. but i was trying to get it onto the server so that it would be a bit faster, i think i'll be fine with this (for now) if the alternative is to setup a VM.
its called vanilla not because its a boring ass default flavour, but because its the basis of the other flavours i think , not sure. havent done any research. you should spread this information around anyway its probably correct enough for no one to correct you when you tell it to them
