My Homelab AI Dev Platform

(rsgm.dev)

57 points | by rsgm 2 hours ago ago

21 comments

  • david-giesberg 23 minutes ago

    I've been doing something pretty similar, except instead of having a persistent opencode server, I've been using this workflow that runs opencode inside of the Forgejo action runners:

    https://codeberg.org/dragonfyre13/forgejo-opencode

    Still tinkering with it, but the gist is that I can invoke Opencode with /oc inside of an Forgejo issue, then it will come back with a PR for me to review.

  • doctorspazz 40 minutes ago

    I've been trying to find the motivation to do a write up on my AI lab, and this is just what I needed. Thanks for sharing. My setup is a similar idea, just with n8n/git/argo/k3s. It's mainly for automated workflows that Qwen or Gemma4 can handle.

  • dlxfoo an hour ago

    Im doing something very similar. Running my OpenCode on a proxmox lxc. I have an additional layer of Kimaki, which gives you Discord integration (hate it or love it). Chatting with your codebase (voice messages, too, if that’s your jam), is very very cool.

    • rsgm 38 minutes ago

      That's very cool. Thanks, I'll have to check that out.

  • taleodor 43 minutes ago

    Very cool, we're doing similar except we let agents open PRs as well + we track release metadata and agentic sessions via our ReARM system + we've recently launched an option for agents to track helm-based deployments via ReARM - https://docs.rearmhq.com/workflows/devops.html

  • variety8675 an hour ago

    How do you run inference for Open Code? What models are you running

  • _def an hour ago

    I wonder how gitops is done with docker compose

    • stryan 36 minutes ago

      I see a lot of people using Komodo for it, though if I had to pick I'd go with Doco CD[0]. You can also use standard Ansible for just cron+bash script to git pull.

      On the Podman side, I wrote a tool named Materia[1] for it, but there's also the wonderful Ansible quadlet role as well as Quadit and Orchess.

      [0] https://github.com/kimdre/doco-cd

      [1] https://primamateria.systems or https://github.com/stryan/materia

    • rsgm 44 minutes ago

      I recently setup Arcane and started migrating stuff from Truenas apps, they were all deployed as custom docker compose services so it worked out. Arcane supports Git syncs to auto deploy compose stacks, https://getarcane.app/docs/features/projects#sync-from-git I'll write up some posts on my full setup soon.

      • blumomo 26 minutes ago

        What _IS_ Arcane? I fail to understand from their website https://getarcane.app/

        Is it a deployment automation platform where it can run a project’s docker services, with rollback and all?

        • rsgm 11 minutes ago

          so, the project is pretty much vibe coded, including the docs. It makes a lot more sense if you play around with it. It's just a docker host management UI, I like using it. It has gitops built in and a nice container log view. It doesn't do rollbacks, it only seems to sync from git and run compose up.

  • fazgha an hour ago

    So first post in the blog, and it went directly HN frontpage.

    Then, I said homelab AI, I thought it's an interesting post about local GPU setup (and I am really interested in this topic).. but no, just another hype post about how to use whatever-code...

    • rsgm an hour ago

      I looked into running local models last month. They just aren't quite there for agentic tool use workflows without spending a small fortune. I'm hopeful smaller local models get much better soon.

      I was also hoping to put out another post on my homelab setup, it has some neat stuff, but I haven't had a chance to finish it.

      • sosodev an hour ago

        I think it heavily depends on what you're asking the model to do. Qwen3.6, both 27B and 35B-A3B, do agentic tool use very well. Their decision making is sus, but the dense model is decent in that way. A 4-bit quant for either of those can run on many home systems with a bit of configuration.

        The biggest issue I've noticed is that the chat templates for open models are really hit or miss. The default Qwen3.6 chat template mostly works these days, but depending on your workload it may cause major issues. There are plenty of "fixed" chat templates on hugging face, but people report mixed success. It really seems to depend a lot on what the tool you're using expects.

    • reactordev an hour ago

      you can't explain the HN hug. You feel it, or your servers do.

  • johnnytech 2 hours ago

    Really cool! Do you autoapprove edits or do you approve manually?

    • rsgm an hour ago

      I'll verify the PR code myself before merging, but that's usually a quick skim.