User avatar
no longer kopper @kopper@wetdry.world
1y
llm talk wanted to see if i could get github.com/ollama/ollama/pull/9650 working so i can get gpu acceleration (not that i'll be using any models regularly) and only ended up managing to move it from my cpu to the integrated gpu fuck my amd life
2
0
2
0
User avatar
Two Hollywood Phonies @autumn@cafe.autumn.town
1y
llm talk @kopper okay but is it faster . trol
1
0
1
0
User avatar
no longer kopper @kopper@wetdry.world
1y
re: llm talk @autumn not really...?
1
0
0
0
User avatar
Two Hollywood Phonies @autumn@cafe.autumn.town
1y
@kopper well !
1
0
1
0
User avatar
Two Hollywood Phonies @autumn@cafe.autumn.town
1y
@kopper i would have expected a tiny boost lol but i guess at that low end hardware it doesn't even matter
1
0
2
0
User avatar
no longer kopper @kopper@wetdry.world
1y
@autumn i mean i haven't benchmarked it going based on vibes here
1
0
0
0
User avatar
Two Hollywood Phonies @autumn@cafe.autumn.town
1y
@kopper yeah but the whole point is vibes isnt it like if it's too slow to use then what's the point
1
0
1
0
User avatar
no longer kopper @kopper@wetdry.world
1y
@autumn it feels slightly slower but doesn't spin up the fans so i'm assuming it's GREENER overall
:glurp:1
0
0
2
1