Files
java-ai-agents/onnx-djl/output/07-http-latency.txt
T

9 lines
478 B
Plaintext

Round trip over HTTP on the same machine (client and server in one JVM), median of 20 requests.
1 text(s) per request: 17.6 ms per request, 17.6 ms per text
4 text(s) per request: 31.7 ms per request, 7.9 ms per text
16 text(s) per request: 80.0 ms per request, 5.0 ms per text
64 text(s) per request: 297.2 ms per request, 4.6 ms per text
100 requests of 1 text: one client after another 1.7 s (59 requests/s), 4 clients at once 1.4 s (70 requests/s)