The Hallway Track

tool-calling

9 tracked signals on tool-calling.

How to Evaluate AI Agents From Tool Calls to Task Completion

NVIDIA Developer Blog · Sep 21, 2026

AI agent evaluation must shift from scoring single tool calls to measuring full multi-step task completion.

“Scoring whether the model sounds right tells you almost nothing about whether the work finished.”
WWDC26: LLM search using Core Spotlight | Apple

Apple Developer (WWDC) · Jun 08, 2026

Apple introduces SpotlightSearchTool, letting on-device LLMs search app content via Core Spotlight for grounded responses.

“today, we're introducing SpotlightSearchTool. It's a tool that adopts the tool protocol, to let a language model directly search your app's content in Core Spotlight for contextual response generation.”
What is an agent harness?

LangChain · Jun 25, 2026

An agent harness is the surrounding engineering scaffolding built around the core model-and-tool-calling loop.

“Harness is sort of the surrounding support that we add onto that core model and tool-calling loop.”
Improve your agent’s tool-calling accuracy with SFT and DPO on Amazon SageMaker AI

AWS Machine Learning Blog · Jun 03, 2026

Combining SFT and DPO on SageMaker AI improves a small model's tool-calling accuracy for agents.

“When an agent picks the wrong tool, formats parameters incorrectly, or breaks a workflow chain, task completion times grow, error rates rise, support costs increase, and user experiences degrade.”
Build AI-first business apps that turn dashboards into actions | ODSP911

Microsoft Developer (Build) · Jun 03, 2026

DevExpress demos connecting Azure OpenAI tool calling to Blazor grid and reporting controls for natural-language data interaction

“This is not about generating code and it's not about dropping a chatbot beside an existing app and calling it done. This is about connecting AI to the controls, to the data, and to the workflows users already rely on.”
What is Tool Calling?

Databricks Blog · Aug 06, 2026

Databricks explains tool calling as AI models interacting with external tools and APIs