asmhatre/spring-ai
1
0
Fork 0
Code Activity

Add llm-gateway module: routing, failover below the tool-calling advisor, per-provider circuit breakers, dollar caps and token limits, tenant-keyed cache; real OpenAI and Anthropic models against a local fake

Browse Source 
Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01JXVi2GMQ7bR5EmbUFdDj7N
This commit is contained in:
Claude
2026-10-09 10:24:57 +00:00
parent 80cd21f89b
commit cdee85d3f4
51 changed files with 2404 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
llm-gateway/output/05-wire.txt
+8
View File
@@ -0,0 +1,8 @@
# Real OpenAI and Anthropic models: failover in the middle of a tool loop
trail: [openai: ok, openai: failed with status 503, anthropic: ok]
answered by anthropic; tool executions 1; requests: openai 2, anthropic 1
request 1 to OpenAI: model=gpt-6.1-sol, max_tokens=256, tools=[refund_order]
request to Anthropic: model=claude-sonnet-5-5 max_tokens=256
conversation it received: [assistant:tool_use(id=call_1, name=refund_order), user:tool_result(tool_use_id=call_1)]