Add onnx-djl module: DistilBERT sentiment with ONNX Runtime and DJL, batching and a Spring Boot endpoint with measured latency

Co-Authored-By: Claude Sonnet 5.5 <[email protected]> Claude-Session: https://claude.ai/code/session_01G8ikz8xdWuTP5yun8DZ1hk
2026-10-11 09:33:36 +00:00
parent fdff2b7388
commit 280cbe7d56
20 changed files with 805 additions and 0 deletions
@@ -0,0 +1,8 @@
+Round trip over HTTP on the same machine (client and server in one JVM), median of 20 requests.
+
+   1 text(s) per request:   17.6 ms per request,  17.6 ms per text
+   4 text(s) per request:   31.7 ms per request,   7.9 ms per text
+  16 text(s) per request:   80.0 ms per request,   5.0 ms per text
+  64 text(s) per request:  297.2 ms per request,   4.6 ms per text
+
+100 requests of 1 text: one client after another 1.7 s (59 requests/s), 4 clients at once 1.4 s (70 requests/s)