MasterNerd@lemm.eetoSelfhosted@lemmy.world•Is it possible to run a LLM on a mini-pc like the GMKtec K8 and K9?English
31·
4 months agoI don’t have any experience with them honestly so I can’t help you there
I don’t have any experience with them honestly so I can’t help you there
Look into ollama. It shouldn’t be an issue if you stick to 7b parameter models
Kinda weird that they’re calling it an OS, but ig they’re just trying to cater to the windows audience
I mean you could always hack the firmware…