ResearchResearch paperLarge Language Models · Reinforcement Learning · Data & Datasets2 sources · Oct 10, 2026

Vela: User Behavior as Supervision Sparks LLM Intelligence

We propose user behavior as supervision and introduce Vela, a framework that converts real user behavior data into trainable tasks and trajectories.

Key points

  • Large language models are increasingly deployed in applications that act on users' long-term behavior histories, from personal assistants to recommendation and advertising systems.
  • These applications demand the user dimension of LLM intelligence: inferring a person's preferences, intent, and likely future actions from weeks to years of behavior data.
  • From the anonymized behavior records of 100,000 users, Vela generates 100,000 tasks across 91 real-world task templates; difficulty-based filtering and trajectory acceptance criteria retain approximately 75,000 tasks with selected training trajectories.
  • Training on more user behavior data further improves user-related performance, and reinforcement learning after fine-tuning outperforms reinforcement learning from the base model by up to 7.7 points.

Sources (2)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 9, 2026SAT-RL: Training Language Models for Logical Reasoning with Symbolic Solvers
  2. Oct 9, 2026ASSET: Adaptive Speech Segmentation via Reinforcement Learning
  3. Oct 9, 2026Minions: A Dynamic and Distributed Virtual GPU Cloud Built on Idle Apple Silicon Devices
  4. Oct 9, 2026The Thinking Leakage in Reinforcement Learning for LLMs
  5. Oct 9, 2026Surfing the Activation Wave: Analyzing the Information and Geometry of LLM Hidden States for Speculative Decoding
  6. Oct 8, 2026Understanding Jev, the new model everyone is talking about

Related