2026-11-05 · America/Los_Angeles · 社区动态 · #9

DialFork: a benchmark for procedural hallucination in conversational agents [R]

Hi all, author here (Idiap Research Institute, joint work with Logitech). We recently released DialFork and thought it might interest people here. It's a benchmark for a failure mode of LLM agents that is easy to miss: every turn is fluent and factual, the tool calls are correct, yet the agent stops following the procedure it was given. For example, asked for the weather, it fetches the forecast (correct tool call) but never tells you, and starts asking you to rate its service instead. Most steps of a conversational procedure aren't tool calls but things the agent has to say: asking,…

热度 40.2 / 100；排名与评分保留该期记录。