spring-ai/llm-gateway/output/07b-budget-concurrency.txt at cdee85d3f41bde7e8dd94171072f98cdfbda31a4 - spring-ai - Gitea: Git with a cup of tea

asmhatre/spring-ai

Files

T

Claude cdee85d3f4 Add llm-gateway module: routing, failover below the tool-calling advisor, per-provider circuit breakers, dollar caps and token limits, tenant-keyed cache; real OpenAI and Anthropic models against a local fake

Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01JXVi2GMQ7bR5EmbUFdDj7N

2026-10-09 10:24:57 +00:00

6 lines

178 B

Plaintext

Raw Blame History

 # 64 simultaneous requests against a cap that fits 10
 cap 10000, each call 1000, 64 threads at once
 check then record: admitted 64, spent 64000
 reserve then settle: admitted 10