Spring AI with Docker Model Runner vs Ollama: Local LLMs Benchmarked on the Same Laptop
Point one Spring AI 2.0.2 OpenAiChatModel at Docker Model Runner and at Ollama by changing only base-url and the model name. Same GGUF model, same prompts: decode speed, time to first token, container memory and tool-call success, with transcripts. Measured on a CPU-only shared sandbox with the real docker/model-runner image; GPU and Docker Desktop paths were not measured and the post says so.