MLGym: A New Framework and Benchmark for Advancing AI Research Agents

Source: arXiv Authors: Deepak Nathani, Lovish Madaan, Nicholas Roberts, Nikolay Bashlykov, Ajay Menon, Vincent Moens, Amar Budhiraja, Despoina Magka, et al. Date: 2025-02-20 Primary category: cs.CL All categories: cs.CL, cs.AI, cs.LG

Abstract

MLGym is explicitly framed as a gym environment for machine-learning research tasks, intended to support RL on AI research agents. It is an excellent example of a domain-specific but serious harness substrate: open-ended tasks, experiment iteration, and real research workflows rather than toy puzzles.