VeriGuard: Enhancing LLM Agent Safety via Verified Code Generation

Source: arXiv Authors: Lesly Miculicich, Mihir Parmar, Hamid Palangi, Krishnamurthy Dj Dvijotham, Mirko Montanari, Tomas Pfister, Long T. Le Date: 2025-10-03 Primary category: cs.SE All categories: cs.SE, cs.AI, cs.CR

Abstract

VeriGuard separates expensive formal assurance from cheap runtime checking. It first clarifies intent, synthesizes a behavioral policy, and iterates through testing plus formal verification offline; later it monitors each proposed action online against that pre-verified policy before execution. The paper is not only about safer single agents: it points toward coordination regimes where role behavior, handoff rights, and state-promotion actions are checked against explicit verified constraints.