NobleBlocks
Public

ClawForge: Generating Executable Interactive Benchmarks for Command-Line Agents

Published • May 18, 2026
Authors:
Yuxiang Lai
,
Peng Xia
,
Haonian Ji

Abstract

Interactive agent benchmarks face a tension between scalable construction and realistic workflow evaluation. Hand-authored tasks are expensive to extend and revise, while static prompt evaluation misses failures that only appear when agents operate over persistent state. Existing interactive benchma...

Finding related papers...

Discussions

(0)

No comments yet

Be the first to share your thoughts!