llama-cpp
an archive of posts with this tag
-
Running a local LLM with llama.cpp: build, download, serve, benchmark
A minimal llama.cpp workflow for running GGUF models on your own machine — from the cmake build to an OpenAI-compatible server and llama-bench.