open-source · since 2026-11
InsightPilot
Open source (heji110705)
Chinese self-service analytics agent with a governed semantic layer, BM25 retrieval, SQL AST allowlisting, read-only execution, trace replay and reproducible result-equivalence evaluation. Its published ablations explicitly report that the critic did not improve SQL execution accuracy.
Verified 2026-11-04 from repository README and committed evaluation docs: 60-question, six-category synthetic snapshot; two runs per configuration; full system 50.0% strict execution accuracy and 57.5% coverage consistency; no-critic 50.8%, no-schema 45.0%, single-chain 45.0%; rule baseline 18.3%. Repository reports 267 tests and 54 attack samples. Important limits: single-machine SQLite, small/two-day data snapshot, n=2 runs, no row-level security or masking, and no demonstrated multi-agent benefit.