Dharma-AI (Hugging Face blog) · Fine-tuning Time Predictor
Predicting End-to-End Fine-Tuning Time for Generative Language Models
Dharma-AI present a preview of a paper on predicting wall-clock time for supervised fine-tuning jobs, using 272 production runs on shared NVIDIA H200 GPUs (about 7,382 GPU-hours). A CatBoost regressor that uses only pre-dispatch configuration features reaches R² 0.98 and MAE 1.71 h in 5-fold cross-validation, compared with R² 0.31 and MAE 12.41 h for a FLOP-based baseline at 30% MFU. The full arXiv version is described as forthcoming.
Open the source ↗Similar Research & Safety releases
- WorldRuler: Interactive World Modeling under Configurable Rules
Mingliang Zhai, Chuanhao Li, Jiaming Tan, Zhen Li, Yuwei Wu, Yunde Jia, Zian Meng, Yuanyang Yin (Alaya Lab) · Rule-driven world model · Week 48, 2026
- PROLA: Principal-Orthogonal Low-rank Adaptation
Minseo Yoon, Minseong Bae, Sojin Lee, Hyunwoo J. Kim · Weather LoRA adaptation · Week 48, 2026
- From Repositories to Training Environments: Scaling Long-Horizon Coding Agents with Environment Evolution Loop
IQuest (Yang Tian et al.) · Coding agent environments · Week 48, 2026
- The Resolution Hypothesis: Agent Evolution's Key Is Identifying Improvements
Yuanhao Zeng, Shaocheng Lan, Ao Lu, Kuang Yan, Heng Lin, Xinang Xu, Yuan Luo, Yueting Wang (ShanghaiTech University) · Agent Evolution Study · Week 48, 2026
- Weight-Space Programming Doesn't Need Transformers
Hyunjong Ok and Jaeho Lee, Pohang University of Science and Technology · Weight-space architecture · Week 48, 2026
- Multi-Branch Transformer
Gaotang Li, Lingjie Chen, Chunyuan Deng, Zhiwei Xu, Hongzheng Chen, Christopher De Sa, Jingrui He, Yingheng Wang · Branching Transformer · Week 48, 2026
Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.