I’ll include mine to show that it’s not unusual to support them! it’s my favorite and most used self hosted project

if you have off-site backup, that could potentially count as the two types, but probably not in the spirit of the backup.

I have two spinning disks, a SATA SSD cache, and off-site backup

ah, I’m using interstellar and piefed, which aggregate the cross posts

the complaints in these comments is an illustration of why the left doesn’t accomplish jack squat

I actually just wrote about today’s fun experience! https://gotosocial.michaeldileo.org/@mdileo/statuses/01K7YKQ9584YBY1QTYQ8RMW7SS

not for LLMs. I have a 16GB and even what I can fit in there just isn’t really enough to be useful. It can still do things and quickly enough, but I can’t fit models that large enough to be useful.

I also don’t know if your GPU is compatible with ROCM or not.

i had to do a particular command to get the AMD GPU properly available in docker. i can’t find that if you need

cloudflare happened first and I haven’t been bothered to change it yet

I switched to it because the ISP blocked ports 80/443. It was good and things actually got a bit faster with them handling SSL certs.

but one thing to note is that the free tier has a 100MB file limit. I got around some of that by using the tail scale vpn with a custom domain entry to point to the local network.

I did these changes (wire guard to tail scale, dns to tunnels, etc) at different times, which is why things aren’t very consistent.

if you’re on your home network the address will be the IP address and, if you’re not using a reverse proxy, the port the app runs on.

with reverse proxy: http/s://192.168.8.2 or whatever without: http/s://<IP address>:3000 or whatever the port is

filled! I’m looking forward to the results!

this was a fun read! I haven’t done much web UI in years, so it was nice to learn about some of the new, nice things that are available. i don’t think I’d remember some of the more advanced stuff though.

Cloudflare tunnels - it used to be dynamic dns, but the ISP blocked ports 80/443, so I switched to tunnels.
External DNS on the Gl-Inet router, included with the product
Goodcloud, from Gl-Inet (included and really nice to have another way to get to it)

for the home self-hosting, that’s pretty much it.

For the (coming soon TM) fediverse apps in Keyboard Vagabond, add in S3, cloudflare CDN

in addition to the other suggestions of checking the rame stick, do you have resource limits on your containers? It’s generally a good thing to have anyway, but I’d do that after checking the ram and cooling situation. Check your cpu temps as well.

the ISP blocked my ports and cloudflare got me around it. I’ll accept the compromise ;)