Kolors Team, Kuaishou Technology (Haoxiang Cao et al.) · Image Synthesis Benchmark

LongBanana

LongBanana is an expert-designed and expert-verified benchmark for long-context multi-reference image synthesis, covering 90 tasks with about 32 reference images, 20 constraints and 4,670 atomic evaluation items in total. Evaluation uses an entity-relation graph and checklists for content fidelity, relational binding and global constraint satisfaction, with a 15% double-labelled subset showing 89.4% exact agreement and a 0.83 quadratic weighted kappa. The authors also introduce LongBanana-Gen, an agent-harness framework, where a ReAct-Plan-Exec-Reflect workflow gives harness-dependent gains over direct generation. Code and data are stated to be available at long-banana.com.