Posts Tagged with "llamacpp"

LLaMA.cpp: Serving Language Models

In this article we will explore how to use llama.cpp to deploy large language models (LLM) and vision language models (VLM) on a consumer hardware. Showing how the community was been using local models to create and consume AI applications.