Posts tagged homelab
Setting Up an LLM Server on Your Home Kubernetes Cluster
- 2024-07-26
The new Llama 3.1 is out, and the fact that a smaller quantized version of the model can be deployed in a home environment is quite exciting. If you have some spare computing resources such as a GPU, you should go ahead and deploy an LLM server on your PC or home server. This is a setup guide on deploying an LLM server on your home Kubernetes cluster.
Deploying a Local Kubernetes Cluster on Ubuntu Servers
- 2024-07-15
When I set up my local Kubernetes for the first time, I had to go through a lot of trial and error to get it right. There were some blog posts on setting up Kubernetes, but they were either outdated or lacked the explanation I needed. As I went through the tedious process of learning everything, I wrote down steps in my personal notebook. I figured I might as well reorganize these notes and share them with you. This is a summary of how to deploy a Kubernetes cluster locally.