Claude
65f580c5bc
Co-Authored-By: Claude Sonnet 5.5 <[email protected]> Claude-Session: https://claude.ai/code/session_01JXVi2GMQ7bR5EmbUFdDj7N
9 lines
440 B
Plaintext
9 lines
440 B
Plaintext
# RuleBasedJudge(0.6) on hand-labelled answers to: Can I get a refund on a monthly plan?
|
|
|
|
answer type correct? judge says verdict
|
|
correct, same words true pass right
|
|
WRONG: negation dropped false pass WRONG
|
|
WRONG: roles swapped false pass WRONG
|
|
correct, paraphrased true fail WRONG
|
|
correct, but a refusal true fail WRONG
|