Efficient Grammar-Constrained Decoding via Parser Stack Classification
Published in Proceedings of the ACM on software engineering. • Oct 1, 2026
Authors:,,
Yongmin Li
Yihong Dong
Jia Li
Abstract
LLMs are widely used to generate structured output like source code or JSON. Grammar-constrained decoding (GCD) can guarantee the syntactic validity of the generated output, by masking out tokens that violate rules specified by a context-free grammar. However, the online computational overhead of ex...
Finding related papers...
Discussions
(0)No comments yet
Be the first to share your thoughts!