ML Debug Env
An RL environment that teaches LLMs to debug PyTorch code
A partially observable reinforcement-learning environment where an LLM agent diagnoses and fixes broken PyTorch training scripts through diagnostic tool calls.
- Rewards only fixes that pass sandboxed subprocess grading, AST validation and an LLM judge of the diagnosis.
- An adversarial task scheduler serves harder bugs as the agent improves.
- PyTorch
- Qwen2.5
- LoRA
- GRPO
- RL
