Also u might wanna check out openwebui its a great frontend for llms. U can plug it into a bunch of services including remote api endpoints (I use open router for larger models), image gen, tools, searxng, etc. It also allows u to generate ur own api keys so its real easy to integrate any agents u use it to generate with other client services.
Ollama
I might be surprised with the performance u can get. Mind u a GPU would defiantly help.
Welp I have 64gb of ram and I only ever use that much running llms.
What are you doing?
Except I’m in rural Australia. Star link is objectively the best option.
Starlink gives me an ipv6 its not static as such but a dynamic DNS can solve that issue. My ISP issue is that my mobile provider doesn’t give me an ipv6 at all so I can’t route to my home server without a gateway to proxy.
I’m still a fan of the theory that the only thing he was good at was creating was ai
This sounds like a problem I’m too Linux to understand
Here is my searxng rocker compose:
services:
redis:
container_name: redis
image: docker.io/valkey/valkey:7-alpine
command: valkey-server --save 30 1 --loglevel warning
restart: unless-stopped
networks:
- local_bridge
volumes:
- ./data/reddis:/data
cap_drop:
- ALL
cap_add:
- SETGID
- SETUID
- DAC_OVERRIDE
logging:
driver: "json-file"
options:
max-size: "1m"
max-file: "1"
searxng:
container_name: searxng
image: docker.io/searxng/searxng:latest
restart: unless-stopped
networks:
- local_bridge
- proxy
volumes:
- ./data/searxng:/etc/searxng
environment:
- SEARXNG_BASE_URL=https://${SEARXNG_HOSTNAME:-localhost}/
- SEARXNG_SECRET=${SEARXNG_SECRET}
cap_drop:
- ALL
cap_add:
- CHOWN
- SETGID
- SETUID
logging:
driver: "json-file"
options:
max-size: "1m"
max-file: "1"
networks:
local_bridge: # local bridge with ipv6 internet access
driver: bridge
enable_ipv6: true
proxy:
external: true
And my searxng settings:
searxng/data/searxng/settings.yml
# see https://docs.searxng.org/admin/settings/settings.html#settings-use-default-settings
use_default_settings: true
server:
# base_url is defined in the SEARXNG_BASE_URL environment variable, see .env and docker-compose.yml
limiter: false # can be disabled for a private instance
image_proxy: false
ui:
static_use_hash: true
query_in_title: true
infinite_scroll: true
default_theme: simple
theme_args:
# style of simple theme: auto, light, dark
simple_style: dark
redis:
url: redis://redis:6379/0
search:
safe_search: 0
autocomplete: 'duckduckgo'
default_lang: "en"
formats:
- html
- json
outgoing:
# default timeout in seconds, can be override by engine
request_timeout: 3.0
enabled_plugins:
- 'Hash plugin'
- 'Basic Calculator'
- 'Self Informations'
- 'Tracker URL remover'
# - 'Ahmia blacklist'
- 'Hostnames plugin' # see 'hostnames' configuration below
- 'Open Access DOI rewrite'
And the proxy network is just the docker network that nginx is connected to. Here is my nginx conf https://github.com/muntedcrocodile/nginxconf .
Vibe coding L
Like I use a lot of ai but u gotta be specific and understand the architecture lol.
Ohh fuck no don’t start this suit again
Huh the more u know lol
So it’s kinda like a docker container its got its own filesystem and root runtime but not its own kernel?
Hmmm. I use QubesOS mainly for the ability to have a separate VM for different things that I can muck around in and not break shit. Does bazzite offer a similar experience?
Lim t->0 x/t =infinity when x>0
Ur function args if fucked up should always throw an error that’s the entire point of python type hints
I like the exception being raised their is no reason I should be passing in None to the function it means I’ve fucked up the value of whatever I’m passing in at some point.
But that’s an extra step of logic u must hold in ur head while trying to understand 12 other things.
I can’t unfortunately. They only feature I use is that fact I can access my ipv6 only server via an ipv4 only network.