Works on the AMD Pro series GPUs and my 6800xt on Pop OS
Works on the AMD Pro series GPUs and my 6800xt on Pop OS
I have an RX6800XT and I use KoboldCPP to run models I download off of Huggingface.
I’m not sure how many tokens per second it generates, probably about 10?
If you want to try it yourself here’s a link to the Github page: https://github.com/LostRuins/koboldcpp
I don’t know what your - and your kid’s - situation is, but I worry pushing Linux onto someone would be counterproductive to getting them to like it.
I only use it because I genuinely like and appreciate it. I’d probably start by getting him interested in it. If he likes it enough then he’ll try and learn more by himself.
I recently got an LLM running locally on an AMD GPU. This was only possible on Linux. Depending on your son, something like that could be a cool way to get him interested.
How do you mean teach?
Just getting them to use it or teaching them terminal commands?
If it’s not UwUntu, I don’t want it 😤
If I could have Pixel software on Sony hardware, I’d be golden.
Honestly, podcasts on YouTube are better if you have sponsorblock
What distro/software are you using?
I was so close to pulling the trigger on a Sony Xperia. Then I found out they only do 2 years of software updates.
Also, there were limited options for custom ROMS
I’ve found that it does work in private sessions
Take this with a huge grain of salt, but I remember hearing once that the eyes are kind of an external piece of the brain.