• 0 Posts
  • 97 Comments
Joined 3 years ago
cake
Cake day: December 16th, 2023

help-circle

  • WalnutLum@lemmy.mltoLinux@lemmy.ml•Rich Hickey: 'AI' is Not a Tool
    link
    fedilink
    arrow-up
    7
    arrow-down
    6
    ·
    14 days ago

    Good tools have many properties LLMs lack - they are predictable, reliable, deterministic, of bounded function, hopefully simple etc.

    These are all things that LLMs have but are typically stripped or hand-waved away for the sake of convenience or ease of use.

    Predictability? Reliability? Deterministic, bounded function? The same seed pushed through a model’s weights ends with the same output. You can change the behavior for how the weights are processed, what tokens are more important than others, etc.

    Simple they are not and likely won’t be, but most models are way more controllable than most people realize. The problem is the thing that makes them interesting in novel isn’t what we can control about them, it’s about what’s not controlled. The fact that they can produce seemingly novel information is the thing everyone wants to sell, and what everyone thinks they want to buy.

    AI (in as far as an LLM is concerned) is a tool being sold, bought, and discussed as if it was something more than what it is, and articles like this don’t help the fantasification and anthropomorphization of them.










  • They’re both “immutable” in the sense that they’re setting up either read-only Filesystem Hierarchies (as in bazzite, which uses ostree) or Symlinking their entire filesystem hierarchy to a read-only “store” (as in nixos).

    Bazzite uses something called ostree to “diff” the filesystem hierarchy much like git does, while Nix basically makes giant read-only store of files and hashes them, then weaves them all together into a “view” of a filesystem that gets symlinked into the context of a running program.