asmhatre/spring-ai
1
0
Fork 0
Code Activity

Add docker-model-runner module: Spring AI OpenAI starter against Docker Model Runner and Ollama with a benchmark runner (time to first token, decode tokens/second, container memory, tool-call success); real docker/model-runner v1.2.9 CPU image and Ollama 0.40.13 on a shared 2-vCPU sandbox, no GPU

Browse Source 
Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_017ic4b4VQVEJWetTT1dYzyJ
This commit is contained in:
asmhatre
2026-10-29 06:24:00 +00:00
co-authored by Claude Sonnet 5.5
parent 6d792f00e0
commit c97bcf9adf
18 changed files with 668 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docker-model-runner/output/01-wire.txt
+8
View File
@@ -0,0 +1,8 @@
base-url = http://127.0.0.1:<port>/engines/v1
spring.ai.openai.chat.options.model = configured-model
call 1, model.call(new Prompt("ping"))
POST /engines/v1/chat/completions | Authorization: Bearer not-needed | model: configured-model
call 2, same prompt with OpenAiChatOptions.builder().temperature(0.0).build()
POST /engines/v1/chat/completions | Authorization: Bearer not-needed | model: gpt-5-mini