engine label: dmr
java: 25.0.5+8-LTS
first request (includes model load): ttft 5018 ms, 48 completion tokens

throughput, 5 prompts x 3 repeats, temperature 0, max_tokens 48
p    rep    ttft_ms  decode_tps  wall_tps  prompt   compl
1    1          514       19.97     16.70      41      48
1    2           74       18.03     17.88      41      48
1    3           91       17.50     17.26      41      48
2    1          350       16.35     14.85      45      48
2    2          488       13.79     12.29      45      48
2    3           82       14.19     14.12      45      48
3    1          315       17.07     15.60      43      48
3    2           75       18.15     17.99      43      48
3    3           91       17.61     17.36      43      48
4    1          337       16.42     14.97      46      48
4    2           87       17.94     17.70      46      48
4    3          101       18.15     17.80      46      48
5    1          308       17.45     15.96      45      48
5    2           76       18.30     18.09      45      48
5    3           89       18.15     17.88      45      48

median ttft_ms 91 | median decode_tps 17.61 | median wall_tps 17.26 | n=15

tool calling (one tool), 10 runs, temperature 0.7 so runs differ
question: What is the temperature in Oslo in Celsius? Use the tools.
expected: currentTemperature(Oslo), answer contains 17
run  1 wrong or missing call  calls=[celsiusToFahrenheit(12)] answer=The temperature in Oslo is 54 degrees Fahrenheit.
run  2 ok                     calls=[currentTemperature(Oslo)] answer=The temperature in Oslo is 17 degrees Celsius.
run  3 wrong or missing call  calls=[celsiusToFahrenheit(12)] answer=The temperature in Oslo is 54 degrees Celsius.
run  4 wrong or missing call  calls=[celsiusToFahrenheit(12)] answer=The temperature in Oslo is 54 degrees Fahrenheit.
run  5 wrong or missing call  calls=[celsiusToFahrenheit(12)] answer=The temperature in Oslo is 54 degrees Fahrenheit.
run  6 wrong or missing call  calls=[celsiusToFahrenheit(0)] answer=The temperature in Oslo is 32 degrees Celsius.
run  7 wrong or missing call  calls=[celsiusToFahrenheit(10)] answer=The temperature in Oslo is 50 degrees Fahrenheit.
run  8 wrong or missing call  calls=[celsiusToFahrenheit(0)] answer=The temperature in Oslo is 32 degrees Fahrenheit.
run  9 wrong or missing call  calls=[celsiusToFahrenheit(14)] answer=The temperature in Oslo is 57 degrees Fahrenheit.
run 10 wrong or missing call  calls=[celsiusToFahrenheit(12)] answer=The temperature in Oslo is 54 degrees Fahrenheit.
tool-call success (one tool): 1/10 (no call 0, wrong/missing call 9, wrong answer 0, errors 0)

tool calling (two tools in sequence), 10 runs, temperature 0.7 so runs differ
question: What is the temperature in Pune in Fahrenheit? Use the tools.
expected: currentTemperature(Pune), celsiusToFahrenheit(31), answer contains 88
run  1 wrong or missing call  calls=[currentTemperature(Pune)] answer=The temperature in Pune is 31 degrees Fahrenheit.
run  2 wrong or missing call  calls=[celsiusToFahrenheit(22)] answer=The temperature in Pune is 72 degrees Fahrenheit.
run  3 wrong or missing call  calls=[currentTemperature(Pune)] answer=The temperature in Pune is 31 degrees Fahrenheit.
run  4 wrong or missing call  calls=[celsiusToFahrenheit(25)] answer=The temperature in Pune is 77 degrees Fahrenheit.
run  5 wrong or missing call  calls=[celsiusToFahrenheit(15)] answer=The temperature in Pune is 59 degrees Fahrenheit.
run  6 wrong or missing call  calls=[celsiusToFahrenheit(0)] answer=The temperature in Pune is 32 degrees Fahrenheit.
run  7 wrong or missing call  calls=[currentTemperature(Pune)] answer=The temperature in Pune is 31 degrees Fahrenheit.
run  8 wrong or missing call  calls=[celsiusToFahrenheit(15)] answer=The temperature in Pune is 59 degrees Fahrenheit.
run  9 wrong or missing call  calls=[celsiusToFahrenheit(32)] answer=The temperature in Pune is 90 degrees Fahrenheit.
run 10 wrong or missing call  calls=[celsiusToFahrenheit(15)] answer=The temperature in Pune is 59 degrees Fahrenheit.
tool-call success (two tools in sequence): 0/10 (no call 0, wrong/missing call 10, wrong answer 0, errors 0)

memory (idle container memory before: 3.695MiB)
container memory during run: peak 546 MiB, median 511 MiB, 58 samples