Co-Authored-By: Claude Sonnet 5.5 <[email protected]> Claude-Session: https://claude.ai/code/session_01Cfo2K4u4rF18QsPXPFnytf
12 lines
639 B
Plaintext
12 lines
639 B
Plaintext
# Bi-encoder alone against bi-encoder top 50 + cross-encoder, by kind of question
|
|
|
|
kind ranking hit@1 hit@3 hit@5 MRR@10
|
|
exact error code bi-encoder 2/12 5/12 8/12 0.374
|
|
reranked 8/12 12/12 12/12 0.792
|
|
exact SKU or setting bi-encoder 12/12 12/12 12/12 1.000
|
|
reranked 12/12 12/12 12/12 1.000
|
|
paraphrase bi-encoder 15/24 22/24 23/24 0.767
|
|
reranked 17/24 20/24 20/24 0.778
|
|
code plus words bi-encoder 12/12 12/12 12/12 1.000
|
|
reranked 12/12 12/12 12/12 1.000
|