Files
spring-ai/rerank/output/04-quality-by-question-kind.txt

12 lines
639 B
Plaintext

# Bi-encoder alone against bi-encoder top 50 + cross-encoder, by kind of question
kind ranking hit@1 hit@3 hit@5 MRR@10
exact error code bi-encoder 2/12 5/12 8/12 0.374
reranked 8/12 12/12 12/12 0.792
exact SKU or setting bi-encoder 12/12 12/12 12/12 1.000
reranked 12/12 12/12 12/12 1.000
paraphrase bi-encoder 15/24 22/24 23/24 0.767
reranked 17/24 20/24 20/24 0.778
code plus words bi-encoder 12/12 12/12 12/12 1.000
reranked 12/12 12/12 12/12 1.000