ornith-ai/Ornith-1.5-122B (Qwen finetune)

Key points

• Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts.1
• Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning.1
• For more details on the task, harness, and rollout reward design, please refer to our blog.1

Sources (1)

• [1]ornith-ai/Ornith-1.5-122B (Qwen finetune)
  r/LocalLLaMA (top, daily) · Oct 20, 02:19 PM

  Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.

  Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts.

Extractive summary: sentences quoted from the sources.