Add jlama module: run a 4-bit TinyLlama inside the JVM with Jlama on the Vector API, with tokens per second, streaming and an Ollama baseline

Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01G8ikz8xdWuTP5yun8DZ1hk
This commit is contained in:
Claude
2026-10-11 09:24:56 +00:00
parent 10545299f8
commit fdff2b7388
17 changed files with 564 additions and 0 deletions
+13
View File
@@ -0,0 +1,13 @@
Temperature 0.0, asked twice:
1: A Java record is a data structure that allows for the creation of immutable, named, and indexed collections of
2: A Java record is a data structure that allows for the creation of immutable, named, and indexed collections of
identical: true
Temperature 0.9, asked three times:
1: In Java, a record is a type of data structure that stores and retrieves data in a logical, indexed
2: A Java record is a type of nested class (or interface) that represents a collection of related data objects in
3: A Java record is a data structure that contains multiple values and provides a way to represent multiple instances of the same
distinct answers: 3
Temperature 0.0, limit 64, asked six more times: 1 distinct answer(s)
6x: A Java record is a data structure that allows for the creation of immutable, named, and indexed collections of objects.