Get a cheap VPS and set up a VPN of your choice.
I don’t know of any project that already supports that AI processor. You’d still be using the CPU and GPU at the moment.
I can really recommend XCP-ng. For me it strikes a pretty good balance of features and ease of use.
Using whatever works better for the current project is doing Hybrid Cloud. Now your boss can brag about how modern the infrastructure is.
And 2d, who self host on a server/VPS they rented somewhere.
deleted by creator
You can install Wireguard or another VPN to encrypt your traffic to the VPS.
You’ll want to install a reverse proxy of your choice on the VPS. Have clients access it over ipv4 and configure it to proxy pass it to your ipv6 address. Nginx at least is capable of doing ipv4 & ipv6 -> ipv4, I think the inverse should also be possible.
You can use OpenCL instead of ROCm for GPU offloading. In my tests with llama.cpp that improved performance massively.
Definitely do benchmarks for how many layers you can offload to the GPU. You’ll see when it’s too many, as performance will crater.
By launching llama.cpp as a server you’ll actually be able to continue to use openwebui as you currently have.
It’s probably still more efficient to keep a 192k opus and a 320k mp3 around than one flac.
I remember a HackerNews comment by the lead XFCE dev about how KDE was actually better optimized, because they have so many more devs working on it.
Yes. I use a hacky script to copy them to the right place
*for 20-series and later graphics cards
Of course KDE supports that…
Yeah, they’re more power hungry, but they’re also way more performant than a pi 4.
VAAPI is the “standard” interface for hardware en-/decoding on Linux. It should work with any GPU using the open source drivers and mesa.
I don’t know how QSV can be installed; AMF, the AMD equivalent, is limited to their proprietary driver.
I know at least one pr that wasn’t (still hasn’t been?) merged for years; Proper 8-bit color sequence support.
Wood cutting might have a similar appeal.
As a user it’s definitely harder to get into than apt or dnf. However, as a packager, it’s very easy to package new applications for pacman. That’s also why the AUR offers this many packages often not found in other distros.
BTW, I did fix the error. Turns out I was in a public network and the rule only applied to domain networks.
Also these fucking rules don’t show in the usual GUI, you have to look into the registry.
HKEY_LOCAL_MACHINE\SYSTEM\ControlSet001\Services\SharedAccess\Parameters\FirewallPolicy\Mdm\FirewallRules
Reddit post for rule source