Add llm-gateway module: routing, failover below the tool-calling advisor, per-provider circuit breakers, dollar caps and token limits, tenant-keyed cache; real OpenAI and Anthropic models against a local fake

Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01JXVi2GMQ7bR5EmbUFdDj7N
This commit is contained in:
Claude
2026-10-09 10:24:57 +00:00
parent 80cd21f89b
commit cdee85d3f4
51 changed files with 2404 additions and 0 deletions
@@ -0,0 +1,9 @@
# What the vendor SDKs throw, and what the gateway does with it
vendor status exception transient? HTTP requests for one call
openai 400 com.openai.errors.BadRequestException false 1
openai 401 com.openai.errors.UnauthorizedException false 1
openai 429 com.openai.errors.RateLimitException true 1
openai 503 com.openai.errors.InternalServerException true 1
anthropic 400 com.anthropic.errors.BadRequestException false 1
anthropic 529 com.anthropic.errors.InternalServerException true 1