ResearchResearch paperReinforcement Learning · Training & Scaling1 source · Oct 9, 2026

AutoEnvScaling: Automating the Data Flywheel with Terminal Agents

We introduce AutoEnvScaling, which treats environment design as a terminal task and uses agents to automate the data flywheel.

Key points

  • Terminal agents solve tasks in software engineering and scientific research by executing commands in a terminal.
  • Training them via reinforcement learning (RL) requires diverse and verifiable environments, but these environments are still mostly designed by human researchers, so their supply grows only as fast as researchers can work.
  • We show that training Qwen3.5-35B-A3B on AutoEnvScaling environments from GPT-5.6-sol improves its Terminal-Bench 2.1 score by 4.3 points over the matched Tmax baseline.
  • We show that Qwen3.6-35B-A3B, acting in both roles, gains 12.2 points on Terminal-Bench 2.1 and raises its Terminal-Bench 4.0 score from 1.6 to 3.2.

Sources (1)

  • [1]AutoEnvScaling: Automating the Data Flywheel with Terminal Agents
    Hugging Face Daily Papers · Oct 9, 12:00 AM
    We introduce AutoEnvScaling, which treats environment design as a terminal task and uses agents to automate the data flywheel.
    Terminal agents solve tasks in software engineering and scientific research by executing commands in a terminal.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 8, 2026[AINews] not much happened today
  2. Oct 8, 2026REMORY: Learning Residual Memory for Context Compaction
  3. Oct 8, 2026SoftwareGym: Scaling Computer-Use Agent Training with Diverse Synthesized Software Environments
  4. Oct 7, 2026reflection/Beam-1.0-501B-A23B
  5. Oct 7, 2026[AINews] Claude Haiku 5.5 — better than GPT-6 Luna at the same pricing
  6. Oct 7, 2026nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-LiLiCorr

Related