asmhatre/spring-ai
1
0
Fork 0
Code Activity

Add llm-gateway module: routing, failover below the tool-calling advisor, per-provider circuit breakers, dollar caps and token limits, tenant-keyed cache; real OpenAI and Anthropic models against a local fake

Browse Source 
Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01JXVi2GMQ7bR5EmbUFdDj7N
This commit is contained in:
Claude
2026-10-09 10:24:57 +00:00
parent 80cd21f89b
commit cdee85d3f4
51 changed files with 2404 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
llm-gateway/output/02-failover.txt
+12
View File
@@ -0,0 +1,12 @@
# Failover: which statuses move to the next provider
status second tried? outcome trail
408 true answered [first: failed with status 408, second: ok]
429 true answered [first: failed with status 429, second: ok]
500 true answered [first: failed with status 500, second: ok]
503 true answered [first: failed with status 503, second: ok]
400 false rethrown [first: rejected with status 400, not retried]
401 false rethrown [first: rejected with status 401, not retried]
404 false rethrown [first: rejected with status 404, not retried]
both down: No provider could answer: [a: failed with status 503, b: failed with status 429]