The Hallway Track
Engineering Insights

Your Agents Need a Save Button - Hamza Tahir, ZenML

AI Engineer · Jul 18, 2026 · Engineering Insights

AI agents lack persistent state checkpoints, making debugging and replay impossible today.

“all of that is lost and it is only stamped as a read-only trace by the end, which is sitting in another tool far away from where the actual code is.”

ZenML's Hamza Tahir identifies a critical gap in agent infrastructure: current observability tools emit read-only traces that are disconnected from the runtime state, meaning variables, file system state, and decision context are lost after execution. He proposes a 'save button' paradigm via durable runtimes that capture full execution state, enabling replay and what-if analysis such as model swapping or tool mocking. An emerging category of tooling sits atop existing agent frameworks to provide this durable runtime layer.

agent infrastructure observability state persistence debugging durable execution MLOps

Watch / read the original source →