llama.cpp works on windows too (or any os for that matter), though linux will vive you better performances
llama.cpp works on windows too (or any os for that matter), though linux will vive you better performances
Revolt tries to be a discord clone/replacement and suffer from some of the same issues. Matrix happens to have a lot of feature in common, but is focused on privacy and security at its core.
Mistral modèles don’t have much filter don’t worry lmao
They is no chance they are the one training it. It costs hundreds of millions to get a descent model. Seems like they will be using mistral, who have scrapped pretty much 100% of the web to use as training data.
Buying second hand 3090/7090xtx will be cheaper for better performances if you are not building the rest of the machine.
You are limited by bandwidth not compute with llm, so accelerator won’t change the interferance tp/s
I use similar feature on discord quite extensively (custom emote/sticker) and i don’t feel they are just a novelty. Allows us to have inside joke / custom reaction to specific event and I really miss it when trying out open source alternatives.
they released a search engine where the model reads the first link before trying to answer your request