User avatar
-> @kopper@wetdry.world @kopper@brain.d.on-t.work
1y
hm. deepseek 7b model seems to be a finetuning of a model explicitly advertised for math and nothing else. i wonder if i should've used the 8b one instead
1
0
1
0
User avatar
-> @kopper@wetdry.world @kopper@brain.d.on-t.work
1y
or i can try 14b. it says it requires 16 gb ram, which i do have given i'm running on a cpu (thanks amd (lol))
2
0
1
0
User avatar
Two Hollywood Phonies @autumn@cafe.autumn.town
1y
@kopper the way it works is that you just need enough ram to store the entire model in memory. which is why high vram is so important for ai gpus lol
0
0
1
0