Add observability module: Spring AI built-in meters and spans, cost per endpoint from token usage, Prometheus and Grafana dashboard
Co-Authored-By: Claude Sonnet 5.5 <[email protected]> Claude-Session: https://claude.ai/code/session_01JXVi2GMQ7bR5EmbUFdDj7N
This commit is contained in:
@@ -0,0 +1,10 @@
|
||||
# Tokens and cost per endpoint (illustrative price: 0.15 USD in / 0.60 USD out per million tokens)
|
||||
|
||||
endpoint input output cost USD
|
||||
ask 1 4 0.00000255
|
||||
summarize 511 13 0.00008445
|
||||
weather 19 18 0.00001365
|
||||
|
||||
framework model-level tokens: input=531 output=35
|
||||
our per-endpoint tokens : input=531 output=35
|
||||
total cost USD: 0.00010065
|
||||
Reference in New Issue
Block a user