TIGER-AI-Lab · Web Agent Benchmark

WebsiteBench

WebsiteBench is a benchmark in which agents must reverse-engineer a full-stack version of a production website they can only explore through a browser, matching its appearance and behaviour. It contains 70 websites and 46,916 hidden test cases, scored by the share of cases passing functional checks and a normalised SSIM of 0.99 on visual checkpoints. Code and verifier are Apache-2.0, installable via PyPI and run with the Harbor framework; the reference websites are for non-commercial research only.

Open the source ↗

Similar Research & Safety releases

Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.