Add onnx-djl module: DistilBERT sentiment with ONNX Runtime and DJL, batching and a Spring Boot endpoint with measured latency
Co-Authored-By: Claude Sonnet 5.5 <[email protected]> Claude-Session: https://claude.ai/code/session_01G8ikz8xdWuTP5yun8DZ1hk
This commit is contained in:
@@ -0,0 +1,8 @@
|
||||
The same two things started in one JVM, in both orders (a separate JVM for each).
|
||||
|
||||
direct-first (ONNX Runtime created by my code, then DJL):
|
||||
Caused by: java.lang.IllegalStateException: Tried to specify the thread pool when creating an OrtEnvironment, but one already exists.
|
||||
|
||||
djl-first (ONNX Runtime created by DJL, then my code):
|
||||
both started
|
||||
|
||||
Reference in New Issue
Block a user