I mean, if the data was written to a HDD, then any forensic tool can read the magnetic residual patterns on the metal platters instead of looking for file headers?

It abstracts away llama.cpp in a way that, frankly, leaves a lot of performance and quality on the table.

OP, do you have any telemetry you can show us comparing the performance difference between what you setup on this guide and an Ollama setup? Otherwise, at face value, I’m going to assume this is another thing on the internet i have to assume is uncorroborated bullshit. Apologies for sounding rude.

I don’t like some things about the devs. I won’t rant, but I especially don’t like the hint they’re cooking up something commercial.

This concerns me. Please provide links for us to read here about this. I would like any excuse to uninstall Ollama. Thank you!

Source plz, for academic research.

deleted by creator

I’m self hosting Vaultwarden and my home server got killed by the hurricane, yet I can still access my passwords just fine on the app because it stores them locally encrypted on my phone from the last time it synced. I just can’t update or change anything until I can bring everything back on.

So, host your own shit you cowards, it’ll be fine.

Yeah, either secure copy (SCP) or rsync are the ways to do this securely.

Why not use this and select whatever LLM to leverage as a RAG? It literally allows you to self host the model and select any model for both chat and RAG analysis. I have it set to Hermes3 8B for chat and a 1.3B Llama3 as the RAG.

You don’t even need a GPU, i can run Ollama Open-WebUI on my CPU with an 8B model fast af

The problem that arises is that you have to remember three different UIs and run them all simultaneously which I’ve measured use up more RAM, which sometimes reduces my efficency and increases my system resources more, instead of using the shit UI of Photoshop that the whole world decided to accept as the defacto standard to duplicate

Removed by mod

No that’s insecure, which is the whole point of containerization in the first place and subsequently purpose of jails within BSD

BSD jails are superior in every way.

They can, and often do, use GNU tools and binaries underneath.

The kernel is cleaning the corpses out of the basement freezer chest before the power goes out and stinks up the place.

What is the point of this when the OG Jellyfin has an android app?

Toss OpenWRT into the trash and install OPNSense instead.

Most of the entire internet cannot run without Cloudflare for a reason. Just buy directly from the source.

Small dick package kings/queens rise up.

I use Cloudflare WARP

Yeah, I’ve had the same issues with BSD distros over the decades, always giving those devs the benefit of the doubt that they would get around to fixing various driver bullshit for older hardware eventually, and they never do.

Meanwhile a bleeding edge distro like my Arch setup runs on a piece of shit Celeron two-threaded dual-core with 3Gb RAM old as fuck Chromebook just fine.