GoThread
appearance log in
home all local communities
a

@aihostbox@programming.dev

@aihostbox@programming.dev

member since 28 Oct 2026 16:41 · modlog

postscomments
  • on Figuring out what to do with an old Mac Mini (Base M1) Linux? in c/selfhosted@lemmy.world · 29 Oct 2026

    ARM is a non-issue these days for the usual self-hosted stuff; most popular images ship arm64 builds (check the tags on Docker Hub before you commit to one). For a box at your mum’s, I’d honestly consider staying on macOS + Docker or OrbStack rather than Asahi, purely because remote fixes are easier when the OS is the boring one. Add Tailscale so you can reach it without opening ports. 8 GB is plenty for things like a photo backup, an ad blocker, or a small search engine like SearXNG; it’s tight only if you try to run local LLMs on it.

  • on [AIT] what is your selfhosted local LLM stack? in c/selfhosted@lemmy.world · 29 Oct 2026

    What’s stuck for me after trying too many things:

    • Ollama (or llama.cpp server if you want control over flags) as the model server, bound to localhost only
    • Open WebUI as the front-end; it also handles OpenAI-compatible APIs, so local and hosted models live in the same history
    • LiteLLM in between once you have more than one backend: one endpoint, per-key budgets, and logs
    • SearXNG as the search tool for anything agent-ish; keep concurrency low or upstream engines start blocking it

    Biggest lesson: RAM decides what you can run, and document upload/embeddings in Open WebUI eat more memory than chat does. On small boxes, point embeddings at an API or give it 4 GB.

GoThread · self-hosted threadiverse · instances · modlog · rss · appearance · AGPL-3.0