Posts tagged LLM
My Two Cents on Agentic AI
- 2024-08-25
Agentic AI has become a popular buzzword in our field. While it has been claimed to be very promising, what it entails in terms of practical implementations and best practices is still very new and developing. As I dig deeper, I’ve found that the shapes and forms of agentic workflows are not as clear as I thought, even though the internet is flooded with articles and videos on the topic. This post offers a cleaner definitional abstraction of the idea, some examples, and some honest opinions on the topic.
Setting Up an LLM Server on Your Home Kubernetes Cluster
- 2024-07-26
The new Llama 3.1 is out, and the fact that a smaller quantized version of the model can be deployed in a home environment is quite exciting. If you have some spare computing resources such as a GPU, you should go ahead and deploy an LLM server on your PC or home server. This is a setup guide on deploying an LLM server on your home Kubernetes cluster.