Files
spring-ai/rerank/output/12-trap-score-scale.txt
T

9 lines
475 B
Plaintext

# Raw cross-encoder scores for the gold passage and for the best wrong passage
gold passage score : min -11.5, median 2.1, max 9.0
best wrong passage score : min -11.4, median -1.4, max 7.8
questions whose best-scoring passage is below 0: 26 of 60
a fixed cut-off of 0 would drop the gold passage for 26 of 60 questions
a fixed cut-off of 2 would drop the gold passage for 30 of 60 questions
a fixed cut-off of 4 would drop the gold passage for 38 of 60 questions