Add text-to-sql module: schema prompt through a restricted role, JSqlParser guard, read-only role with column grants and timeout, row cap, execution-based evaluation on a real PostgreSQL

Co-Authored-By: Claude Sonnet 5.5 <[email protected]> Claude-Session: https://claude.ai/code/session_01JXVi2GMQ7bR5EmbUFdDj7N
2026-10-09 07:22:28 +00:00
parent d67ac0630b
commit 85a3359186
26 changed files with 1179 additions and 0 deletions
@@ -0,0 +1,13 @@
+# Eight questions, scored three ways (the model is a script, not a language model)
+
+question                                       string   execution  what happened
+How many customers are in Germany?             no       match      same result
+What is the total revenue of paid orders?      no       match      same result
+Which 3 products sold the most units?          no       match      same result
+Which customers have never ordered?            no       match      same result
+How many orders are there per status?          no       no         DIFFERENT result: got [paid, 750], expected [paid, 250]
+What is the average order value?               no       no         DIFFERENT result: got [15.5000000000000000], expected [78.0150000000000000]
+What is the revenue by country?                no       no         refused by the guard: table sales is not allowed
+How many orders were placed in March 2025?     no       match      same result
+
+string match: 0/8   execution match: 5/8   refused before running: 1   ran and returned a wrong answer: 2