# Gold passage rank before and after reranking the top 50 (only questions whose rank changed)

gold   question                           bi-encoder  reranked
E-4106 What does error E-4106 mean?       28          3  better
E-4116 Why am I getting E-4116?           1           2  worse
E-4118 We see E-4118 in the logs, what~   8           3  better
E-4120 Explain E-4120                     2           1  better
E-4122 Support told me to look up E-41~   4           3  better
E-4126 What is E-4126?                    2           1  better
E-4129 How do I fix E-4129?               12          1  better
E-4131 Our service started returning E~   4           1  better
E-4133 Meaning of E-4133                  5           1  better
E-4135 Is E-4135 our fault?               2           1  better
E-4138 What causes E-4138 on the shop ~   6           1  better
G-01   What happens when a customer's ~   6           11  worse
G-05   How do I experiment safely befo~   1           14  worse
G-07   Accept money from people who do~   4           1  better
G-10   Stop dodgy purchases automatica~   3           6  worse
G-12   What if our website is down whe~   2           1  better
G-16   A client wants to stop being bi~   3           1  better
G-17   Give our bookkeeper everything ~   1           25  worse
G-20   How do we avoid ever handling r~   2           1  better
G-24   One item in the basket is sold ~   3           1  better
G-28   Which colleague altered the set~   1           2  worse

better: 15, worse: 6, unchanged: 39
