# Threshold sweep: 30 cached questions, 90 rewordings and 20 off-topic questions asked threshold = the value given to SearchRequest.similarityThreshold (Spring AI score); cosine = 2 x threshold - 1. A served answer is RIGHT if it belongs to the intent of the question asked, WRONG if it belongs to another intent. An off-topic question has no right answer in the cache, so any hit on it is WRONG. threshold | cosine | hit rate | right | wrong (reworded) | wrong (off-topic) | wrong / all hits | cached pairs of different intents that answer for each other 0.50 | 0.00 | 100% | 86/90 | 4/90 | 20/20 | 21.8% | 396 of 435 0.60 | 0.20 | 100% | 86/90 | 4/90 | 6/20 | 10.4% | 151 of 435 0.70 | 0.40 | 99% | 86/90 | 3/90 | 0/20 | 3.4% | 27 of 435 0.75 | 0.50 | 94% | 83/90 | 2/90 | 0/20 | 2.4% | 13 of 435 0.80 | 0.60 | 86% | 77/90 | 0/90 | 0/20 | 0.0% | 2 of 435 0.85 | 0.70 | 58% | 52/90 | 0/90 | 0/20 | 0.0% | 1 of 435 0.90 | 0.80 | 26% | 23/90 | 0/90 | 0/20 | 0.0% | 0 of 435 0.95 | 0.90 | 3% | 3/90 | 0/90 | 0/20 | 0.0% | 0 of 435 Questions that were answered WRONGLY at threshold 0.80 (asked -> served from): none among these 110 probes Rewordings the cache MISSED at threshold 0.80 (best stored question and its score): 0.787 "Where can I end my membership plan?" (nearest: "How do I cancel my monthly subscription?") 0.746 "Can you tell me what qualifies for getting my money back?" (nearest: "Which items can be refunded?") 0.696 "Where is my package right now?" (nearest: "Can I pick up my order at a store?") 0.759 "I want to see the delivery status of my purchase" (nearest: "How can I track my order?") 0.752 "Has my returned parcel arrived at your warehouse yet?" (nearest: "How long will delivery take?") 0.790 "My device broke, how do I get it repaired under warranty?" (nearest: "How do I make a warranty claim?") 0.797 "How many days until my parcel gets here?" (nearest: "How long will delivery take?") 0.739 "Can I pay with a credit card or PayPal?" (nearest: "Which payment methods do you accept?") 0.798 "How can I pay for my order?" (nearest: "How can I track my order?") 0.769 "I need a receipt for my purchase, where do I find it?" (nearest: "Where can I download an invoice for my order?") 0.743 "Is in-store collection available?" (nearest: "Can I pick up my order at a store?") 0.753 "I would rather collect my purchase myself, is that an option?" (nearest: "Can I pick up my order at a store?") 0.703 "Do you offer click and collect?" (nearest: "Do you sell gift cards?")