Add rerank module: bi-encoder retrieval plus an ONNX Runtime cross-encoder reranker behind a Spring AI DocumentPostProcessor; hit@k and MRR by pool size and question kind, latency by candidates, batch size, threads and int8, and five reproduced traps. Local MiniLM models, no database or API key.

Co-Authored-By: Claude Sonnet 5.5 <[email protected]> Claude-Session: https://claude.ai/code/session_01Cfo2K4u4rF18QsPXPFnytf
2026-10-24 18:00:05 +00:00
parent 2ccf1d8d19
commit a429aa40f6
34 changed files with 1617 additions and 0 deletions
@@ -0,0 +1,11 @@
+# Questions whose gold passage is not in the bi-encoder's top 5
+
+gold     question                                                       bi-encoder   reranked top 50
+E-4106   What does error E-4106 mean?                                   28           3
+E-4118   We see E-4118 in the logs, what should we do?                  8            3
+E-4129   How do I fix E-4129?                                           12           1
+E-4138   What causes E-4138 on the shop floor?                          6            1
+G-01     What happens when a customer's monthly payment does not go ~   6            11
+
+5 questions have no answer passage in the top 5; a reranker over the top 5 cannot help them,
+a reranker over the top 50 brings 4 of them into the top 5