research · since 2026-10-30
EvalForge
Navaneeth-007
Reproducible Phi-3 text-to-SQL QLoRA training and evaluation workbench with paired base/adapter predictions, bounded SQLite execution scoring, published manifests, a recorded evidence viewer, and optional model serving.
text-to-sqlfine-tuningevaluationspiderqlora
desk notes
Initial audit 2026-10-30: published pilot adapts Phi-3 on 987 Spider training examples and evaluates the same 200 development questions. Reports 53.0%→57.5% SQLite execution accuracy and 11.0%→26.0% normalized exact match; adapter fixed 30 base errors and introduced 21 regressions. Includes all predictions, hashes, executed notebook, training manifest, release artifact, and explicit caveat that this is a development split rather than an official Spider test result.