Context budgets are the real SQL problem

The hard part of production text-to-SQL isn’t the generation. It’s deciding what fits in the prompt before generation starts. An 8K context window forces you to summarize tables, prune candidates, and cache schema digests. Most of the engineering effort shows up as context management, not prompting.