SLAI-AITP (AI Training Platform Team) · Kernel Optimisation Benchmark
AscendGYM
AscendGYM is a benchmark for measuring how well models and agents optimise existing Ascend NPU kernels, using 48 kernels across three difficulty levels. Test cases use data types and tensor shapes collected from real training and inference workloads. It supports model and model-harness evaluation, and introduces the Speedup-Token Score (STS), which measures speedup relative to token cost. Code is available on GitHub.
Open the source ↗Similar Research & Safety releases
- SWE-CoWork: Benchmarking Coding Agents as Digital Employees in Organizations
Xinping Lei et al. (Tokenwave.AI) · Org-level coding benchmark · Week 48, 2026
- InclusionMed
The InclusionMed Collaboration · Medical AI Benchmark · Week 48, 2026
- Nemotron RL Litmus-Bench V2.0
NVIDIA · Science Post-Training Dataset · Week 48, 2026
- VibePrevisBench
Kling-Keye (Yuzhe Chen, Muxi Diao, Lele Yang, Wenbin Xu, Xuyang Liu, Qile Su, Changyi Liu, Jiankang Chen) · Agent Benchmark · Week 48, 2026
- NovaAtom-Lite
Geodesic Intelligence · All-atom structure prediction · Week 47, 2026
- XYBench
Ai2 (allenai), with researchers at Carnegie Mellon, NVIDIA and Johns Hopkins · XY problem benchmark · Week 47, 2026
Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.