This week was highly unstructured in regards to working on Lazerbunny, to the point that you could have rolled a dice to figure out which task from the todo list I will pick up at any given day. The two most important ones were progress on the avatar and adding context compression to the coding agent.
I am a very big fan of self-hosting services I use on a daily basis or that hold my data. Some services are mostly a backup, some are in day to day production use for my company, some are to toy around. Whenever one of the big providers messes up, has a data breach or is bought and shuts down people advocate for self-hosting similar services, and you might think I’d be one of the,. Sadly it is not that easy.
One of the key components of any personal assistant is the ability to remember what you ask them to do and put it in the context of what happened before. So for this week I was mostly focused on building the memory layer of LazerBunny. A fun little exercise when trying to push search and retrieval with minimal resource usage.
Having an agent work while you do other things sounds like a neat idea. How well it works depends on a number of factors including the model you choose for the hallucination machine powering it, the prompts, tools and of course how patiently and you tell it exactly what to do. Having an agent write all the code has not worked for me, but I found some value in having one ready. So what better way to spend a Saturday watching LEC than writing one for LazerBunny?
I have a relatively simple setup to host services locally: One Caddy container acting as reverse proxy for all services. DNS is set up, containers talk via Docker networking and I run an ACME server for SSL certificates. The disadvantage of this is that each client needs to trust the root certificate. Easy on most desktops. Okay to do on mobile devices. The most painful thing I ever did on an Apple TV. But it is a bit inconvenient when we have visitors over, and on top of that my wife is really good at ignoring my suggestions to set the certificates up and rather does not use the services. So we have to fix this.