All Posts
My Two Cents on Agentic AI
- 2024-08-25
Agentic AI has become a popular buzzword in our field. While it has been claimed to be very promising, what it entails in terms of practical implementations and best practices is still very new and developing. As I dig deeper, I’ve found that the shapes and forms of agentic workflows are not as clear as I thought, even though the internet is flooded with articles and videos on the topic. This post offers a cleaner definitional abstraction of the idea, some examples, and some honest opinions on the topic.
Setting Up an LLM Server on Your Home Kubernetes Cluster
- 2024-07-26
The new Llama 3.1 is out, and the fact that a smaller quantized version of the model can be deployed in a home environment is quite exciting. If you have some spare computing resources such as a GPU, you should go ahead and deploy an LLM server on your PC or home server. This is a setup guide on deploying an LLM server on your home Kubernetes cluster.
Deploying a Local Kubernetes Cluster on Ubuntu Servers
- 2024-07-15
When I set up my local Kubernetes for the first time, I had to go through a lot of trial and error to get it right. There were some blog posts on setting up Kubernetes, but they were either outdated or lacked the explanation I needed. As I went through the tedious process of learning everything, I wrote down steps in my personal notebook. I figured I might as well reorganize these notes and share them with you. This is a summary of how to deploy a Kubernetes cluster locally.
Setting Up a Private Docker Registry
- 2024-07-12
I initially thought setting up a Docker registry for a local cluster would be a one-line command, but experience showed otherwise. I have browsed around and discovered that much of the obstacle many others and I encountered was due to TLS misconfiguration that was a requirement implicitly imposed by Docker and Kubernetes. In this post, I would like to share how to set up a TLS enabled private Docker registry in a local network. As a disclaimer, this is not really the best practice guide for a production environment, the aim of this post is to illustrate a barebones setup so that you can connect your Docker and Kubernetes environment to a private registry successfully.