Introducing QwenGyre: Bringing Elastic Reinforcement Learning (Elastic RL) to extreme-long-horizon (XLong) agent training.
This approach introduces two core designs:
-
Elastic Scheduler: Dynamically reallocates GPUs between rollout and training on demand—without ever preempting running tasks. Achieves up to a 1.85× speedup over colocate setups and a 1.78× speedup over asynchronous (Async) setups.
-
Trajectory Processor: Converts branching execution processes (compression, sub-agents, retries) into prefix-sharing trajectory trees, generating bounded, deduplicated training samples. Partial progress from timed-out runs can still be scored.
When scaled to Qwen3.8-2.4T-A95B with rollouts reaching ~700K tokens, QwenGyre improved NL2RepoBench performance from 52.5% to 58.5% in just 48 steps, slashing end-to-end training time by approximately 44% compared to Async setups.
🔗 Paper:
arxiv.org/abs/2609.33848
Top Discussions
DAlmighty (⬆58): These guys are on another level. Mysterious_Finish543 (⬆38): …evaluated NL2RepoBench using Qwen 3.6 122B during training steps 1–42… we evaluated QWENGYRE on… using Qwen 3.6 122B. Dany0 (⬆26): Now we can train absolute agent behemoths at home too, as long as we can cobble together enough compute. GalacticDistances (⬆30): Great idea, I’ll DM you an address—ship your hardware over. rahulkadukar (⬆7): Here’s my address: 127.0.0.1, or ::1 if you prefer IPv6. OttoRenner (⬆10): What a coincidence, we live in the same house! gnoremepls (⬆10): Let’s do it, and casually solve a few random math proofs while we’re at it. lolwutdo (⬆7): Praying for a Qwen 4 drop this week.