Claude
a429aa40f6
Co-Authored-By: Claude Sonnet 5.5 <[email protected]> Claude-Session: https://claude.ai/code/session_01Cfo2K4u4rF18QsPXPFnytf
27 lines
1.5 KiB
Plaintext
27 lines
1.5 KiB
Plaintext
# Gold passage rank before and after reranking the top 50 (only questions whose rank changed)
|
|
|
|
gold question bi-encoder reranked
|
|
E-4106 What does error E-4106 mean? 28 3 better
|
|
E-4116 Why am I getting E-4116? 1 2 worse
|
|
E-4118 We see E-4118 in the logs, what~ 8 3 better
|
|
E-4120 Explain E-4120 2 1 better
|
|
E-4122 Support told me to look up E-41~ 4 3 better
|
|
E-4126 What is E-4126? 2 1 better
|
|
E-4129 How do I fix E-4129? 12 1 better
|
|
E-4131 Our service started returning E~ 4 1 better
|
|
E-4133 Meaning of E-4133 5 1 better
|
|
E-4135 Is E-4135 our fault? 2 1 better
|
|
E-4138 What causes E-4138 on the shop ~ 6 1 better
|
|
G-01 What happens when a customer's ~ 6 11 worse
|
|
G-05 How do I experiment safely befo~ 1 14 worse
|
|
G-07 Accept money from people who do~ 4 1 better
|
|
G-10 Stop dodgy purchases automatica~ 3 6 worse
|
|
G-12 What if our website is down whe~ 2 1 better
|
|
G-16 A client wants to stop being bi~ 3 1 better
|
|
G-17 Give our bookkeeper everything ~ 1 25 worse
|
|
G-20 How do we avoid ever handling r~ 2 1 better
|
|
G-24 One item in the basket is sold ~ 3 1 better
|
|
G-28 Which colleague altered the set~ 1 2 worse
|
|
|
|
better: 15, worse: 6, unchanged: 39
|