Posts tagged set-up-guide
Setting Up an LLM Server on Your Home Kubernetes Cluster
- 2024-07-26
The new Llama 3.1 is out, and the fact that a smaller quantized version of the model can be deployed in a home environment is quite exciting. If you have some spare computing resources such as a GPU, you should go ahead and deploy an LLM server on your PC or home server. This is a setup guide on deploying an LLM server on your home Kubernetes cluster.
Deploying a Local Kubernetes Cluster on Ubuntu Servers
- 2024-07-15
When I set up my local Kubernetes for the first time, I had to go through a lot of trial and error to get it right. There were some blog posts on setting up Kubernetes, but they were either outdated or lacked the explanation I needed. As I went through the tedious process of learning everything, I wrote down steps in my personal notebook. I figured I might as well reorganize these notes and share them with you. This is a summary of how to deploy a Kubernetes cluster locally.
Setting Up a Private Docker Registry
- 2024-07-12
I initially thought setting up a Docker registry for a local cluster would be a one-line command, but experience showed otherwise. I have browsed around and discovered that much of the obstacle many others and I encountered was due to TLS misconfiguration that was a requirement implicitly imposed by Docker and Kubernetes. In this post, I would like to share how to set up a TLS enabled private Docker registry in a local network. As a disclaimer, this is not really the best practice guide for a production environment, the aim of this post is to illustrate a barebones setup so that you can connect your Docker and Kubernetes environment to a private registry successfully.