openQA-llm-server

Local LLM Server features for openQA workers

openQA workers can optionally host a local llama.cpp server to provide LLM features directly from the worker node. This package provides the Podman Quadlet configuration to automatically manage the server.

cloud_download Downloads