Add jlama module: run a 4-bit TinyLlama inside the JVM with Jlama on the Vector API, with tokens per second, streaming and an Ollama baseline

Co-Authored-By: Claude Sonnet 5.5 <[email protected]> Claude-Session: https://claude.ai/code/session_01G8ikz8xdWuTP5yun8DZ1hk
2026-10-11 09:24:56 +00:00
parent 10545299f8
commit fdff2b7388
17 changed files with 564 additions and 0 deletions
@@ -0,0 +1,4 @@
+The question is 26 prompt tokens long.
+
+Limit 30: generated 3 tokens (prompt + generated = 29)
+Limit 20: IllegalArgumentException: Prompt exceeds max tokens