Using open-webui#

I set up a local LLM using ROCm on my desktop in my last post. So I have the LLM running locally, but its pretty clunky and as a paying user of ChatGPT, I want that cleaner UI/UX. Enter open-webui. This is exactly what I was looking for as a front-end for the ollama server I set up.

I decided to go with the Docker setup.

Running ROCm on Pop!#

This has gotten sooo much easier than when I tried to set this up 2 years ago. ROCm has come a long way, but the support and tooling has advanced as well. Now you don’t have to jump through tons of hoops to get AI libraries and software to work with ROCm. The last time I tried this, I needed to add ubuntu repos, edit my /etc/os-release file to pretend I was using ubuntu", and do a rain-dance to get my Raedeon 6900xt in a usable state.

Updating DNS Records#

This was a fairly straightforward process:

1. Log into GitHub > Go to your public repo > Settings > Pages: and enter your domain in the Custom Domain section
2. Add your domain name www.wesgould.com
3. Log into your DNS provider.
   • Delete CNAME / A-RECORDs for www.wesgould.com and wesgould.com to avoid conflicts with the new records.
   • ADD CNAME RECORD for www.wesgould.com.
   • Add A-RECORD for wesgould.com.
4. To create A records, point your apex domain to the IP addresses for GitHub Pages:

   - 185.199.108.153
   - 185.199.109.153
   - 185.199.110.153
   - 185.199.111.153
   

5. To create AAAA records, point your apex domain to the IP addresses for GitHub Pages:

   - 2606:50c0:8000::153
   - 2606:50c0:8001::153
   - 2606:50c0:8002::153
   - 2606:50c0:8003::153
   

6. Be impatient because “it didn’t work!” (immediately). But it’s DNS propagation and it’s slow. I understand why it takes a while, and theoretically it could take days to fully propagate, but it also seems crazy that it’s not instantaneous in 2023. That said, it probably took me longer to complain here than it did to propagate.
7. Try accessing the site. GitHub may report an error at first under where you entered your custom domain, but check again, and it should work.

   wesgould.com is improperly configured
   Domain does not resolve to the GitHub Pages server. For more information, see documentation (NotServedByPagesError).
   

   
8. Make sure you check the HTTPS box.
9. Do one last terminal dig to see the changes like a nerd.
10. Bug your wife and friends to see if they can get to your site. Pretend they are as excited as you are even though “Okay now what” is about all you’ll get from them. That’s an exact quote from my wife.

It’s been an…adventure.

Why Switch from Publii to Hugo?#

I am switching from Publii to Hugo because I wanted to take advantage of the text notes I was already taking with Vimwiki for my various projects. The Publii interface was nice, but I’m already writing notes in a format that doesn’t require me to use their WYSIWYG editor. I know that seems lazy, but it’s an extra step that caused just enough friction that I wouldn’t update the blog.

Turkey Trot 2k19#

Date: November 28, 2019

The family decided to go to a Turkey Trot before we ate Thanksgiving dinner. I bet my niece $1 that I would run it in under 40 minutes. I got < 33 minutes (unofficially—the times aren’t posted yet).

About 900 people signed up for this particular 5k!

The 2nd prize was a huge pie (and a $50 Dick’s gift card, but you can’t eat that so it’s less important).