Research indexObservational
Monitoring, Evaluation, and Program Optimization with AI
Kilburg
Chapman & Hall/CRC eBooks14 Aug 2026
NobleIDark:/48914/w1/20261105/799E153DDOI10.1201/9781003612377-7
Monitoring, Evaluation, and Program Optimization with AI
Kilburg · Chapman & Hall/CRC eBooks · 2026 · Subscription
NobleIDark:/48914/w1/20261105/799E153DDOI10.1201/9781003612377-7
The full text is at the publisher
You can read the abstract here, or open it at the publisher.
Abstract
This chapter examines how AI transforms diplomatic evaluation from expensive, retrospective surveys to continuous, data-rich assessment that enables real-time program adaptation. Opening with a scenario where an embassy’s analytics dashboard produces misleading scholarship program metrics by amplifying urban alumni voices while rendering rural participants invisible, the chapter demonstrates that evaluation is not neutral but reflects choices about whose voices count. Technical analysis covers real-time sentiment tracking, narrative decay metrics, validator amplification mapping, and predictive impact modeling. Case studies include Canada’s Directive on Automated Decision-Making requiring algorithmic impact assessments, WHO&s;s EARS platform introducing "rumor half-life" as a dynamic metric, UK Cabinet Office Copilot trials measuring productivity alongside error rates, and USC Center on Public Diplomacy pilots surfacing hidden gender disparities through natural language processing. The attribution challenge receives attention: AI makes measuring influence pathways both easier and harder. Credibility depends on treating dashboards as provisional, conducting equity audits, and ensuring publics recognize their experiences as accurately represented.