ClawForge: Generating Executable Interactive Benchmarks for Command-Line Agents
Published • May 18, 2026
Authors:,,
Yuxiang Lai
Peng Xia
Haonian Ji
Abstract
Interactive agent benchmarks face a tension between scalable construction and realistic workflow evaluation. Hand-authored tasks are expensive to extend and revise, while static prompt evaluation misses failures that only appear when agents operate over persistent state. Existing interactive benchma...
Subject
Finding related papers...
Discussions
(0)No comments yet
Be the first to share your thoughts!