java-ai-agents/jlama/output/07-token-limit.txt at 280cbe7d56e17659b869a884ef113a53e3b04cf8 - java-ai-agents - Gitea: Git with a cup of tea

asmhatre/java-ai-agents

Files

T

Claude fdff2b7388 Add jlama module: run a 4-bit TinyLlama inside the JVM with Jlama on the Vector API, with tokens per second, streaming and an Ollama baseline

Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01G8ikz8xdWuTP5yun8DZ1hk

2026-10-11 09:24:56 +00:00

5 lines

157 B

Plaintext

Raw Blame History

 The question is 26 prompt tokens long.
 Limit 30: generated 3 tokens (prompt + generated = 29)
 Limit 20: IllegalArgumentException: Prompt exceeds max tokens