RT by @huggingface: If you're using GRPO in TRL, you should really switch to the new async trainer…

TL;DR - Hugging Face recommends TRL users switch GRPO workloads to its new asynchronous trainer, reporting roughly 2–4× faster performance in internal benchmarks.

• The update targets Group Relative Policy Optimization (GRPO) training in TRL.
• Asynchronous execution is presented as the source of improved training throughput.
• The post does not provide benchmark methodology, hardware, or workload details.