AI use cases

Inference serving

Process text, audio, images and video using local model engines.

From Llama.cpp vs vLLM: Which Local LLM Engine Actually Scales? by IBM Technology