The Hallway Track
Engineering Insights

SQLite compressed text-history prototypes

Simon Willison · Aug 09, 2026 · Engineering Insights

Compressed JSON arrays reduce 20MB of SQLite revision history to 80KB

“1,000 simulated revisions to a document resulted in 20.4 MB of raw revision text that compressed to 80.3 KB as Zstandard-compressed JSON array.”

Simon Willison prototyped a SQLite revision-history scheme using zstd-compressed JSON arrays, achieving 250x compression on 1,000 document revisions. Notably, he used GPT voice mode to brainstorm the idea then prompted GPT-5.6 Sol Pro to build the prototype over 38 minutes. The engineering result is solid but the AI-conference signal is thin — this is a developer workflow anecdote, not a major industry announcement.

sqlite compression llm-assisted-development gpt-5 prototyping

Watch / read the original source →