Google Research (Otilia Stretcu, Leijie Wang) · Interactive Classifier Framework

Agile Deliberation

Agile Deliberation is a framework for building image classifiers for subjective categories, such as "healthy food" or clickbait "pay-to-play" content. It guides users through concept scoping, where they define sub-categories and exclusions, then uses vision-language models to surface borderline images and an LLM-driven prompt optimisation loop to refine the classifier. In 18 live sessions of 1.5 hours each, the authors report higher-performing classifiers than zero-shot, automated-collaborator and manual baselines, with reduced user fatigue. The underlying code and algorithms are open-sourced on GitHub.