Technique

Computer use

Also known as: computer-use, computer-use agent

15stories this week
34last 30 days
37all time

Timeline

  1. Oct 17, 2026 · Tutorial / explainer · 14 sources
    Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio
    In this post, we show how to run the latest frontier-class model — Muse Spark Open, with nearly a trillion parameters — right from your desk, using the latest version of MLX, released today.
  2. Oct 16, 2026 · Product / feature launch · 2 sources
    ChatGPT can peek at your Chrome tabs now
    OpenAI's ChatGPT Atlas browser is gone, but now ChatGPT's Google Chrome extension is getting some upgrades that allow it to use the browser tabs you already have open.
  3. Oct 16, 2026 · Research paper · 1 source
    Adaptation of Computer Use Agents to New Software with User Manuals
    In this paper, we propose MAGE (Manual-augmented computer use AGent Execution and learning), a framework that leverages user manuals as a scalable source of procedural knowledge to improve both inference and training.
  4. Oct 16, 2026 · Research paper · 1 source
    PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas
    We introduce PersonaCUABench, which holds 74 tasks across 11 domains fixed and varies only who asks.
  5. Oct 15, 2026 · Research paper · 1 source
    Multimodal Filesystem Memory For Long-Horizon Embodied Agents
    We present MFM, a multimodal filesystem memory architecture that keeps complementary types of agent memory.
  6. Oct 15, 2026 · Open-source release · 1 source
    unslothai/unsloth v0.1.908-beta: NVIDIA Nemotron 3.5 + Meta Muse Spark Open
    Run NVIDIA's new Nemotron 3.5 models and Meta's new Muse Spark Open locally in Unsloth.
  7. Oct 15, 2026 · Research paper · 2 sources
    LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use Agents
    To this end, we propose LEASH, a training-free framework that unleashes the strong agent only when the weak agent's latent uncertainty signals it is needed, and keeps it on a leash afterward.
  8. Oct 15, 2026 · Open-source release · 2 sources
    OpenGCUA: Toward a Fully Open Stack for Generalist Computer Use
    We introduce Open Generalist CUA (OpenGCUA), an ongoing project to develop and open the full stack for GCUAs with the community.
  9. Oct 15, 2026 · Research paper · 1 source
    Probe-and-Resume: When and How to Evaluate Agent Execution
    Test-time search can improve agent performance by exploring alternative actions and using a critic to select promising branches.
  10. Oct 14, 2026 · Research paper · 2 sources
    MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments
    We introduce MAI-Gym, an open all-in-one platform that unifies GUI agent evaluation, data collection, and online RL training across mobile, computer, and web environments.
  11. Oct 14, 2026 · Research paper · 2 sources
    Player-1: Learning to Play from Synthetic Experience
    We introduce Player-1, a post-training framework for learning game control beyond demonstrations through synthetic experience.
  12. Oct 14, 2026 · Model release · 10 sources
    [AINews] Meta Muse Wonder & Wonder Full: MSL’s Claude 5.5-tier Frontier Model
    We have been coveringe MSL’s 14 month journey to becoming a frontier lab, but only today did the final ball drop: Meta’s Muse Wonder to match Spark and Glimmer, the way that OpenAI has Sol/Terra/Luna and Anthropic has Opus/Sonnet/Haiku.
  13. Oct 13, 2026 · Research paper · 2 sources
    CLASHarness: Benchmarking Multi-Agent Conflict in Computer Use via a Controllable and Verifiable Generation Pipeline
    We introduce CLASHarness (Conflict-Loaded Agent Scenario Harness), a controllable framework for generating verifiable multi-agent conflicts in computer use, with a benchmark of 600 multi-round tasks.
  14. Oct 13, 2026 · Research paper · 1 source
    Towards Safe Autonomy for Computer Use
    We introduce SA-CUA, a dual-LLM framework that generates a reliable trust boundary for CUAs by deriving conservative deterministic rules from the accessibility tree for unmasking trusted regions from the privileged LLM's screenshot, keeping trusted and untrusted content separated.
  15. Oct 13, 2026 · Research paper · 1 source
    Interaction-as-a-Judge
    We study Interaction-as-a-Judge, an evaluation paradigm where computer-use agents (CUAs) directly interact with an application.
  16. Oct 12, 2026 · Research paper · 1 source
    Computational Reflective Equilibrium for Agentic AI: A Rawlsian Alignment Scaffold for Governance
    The rapid deployment of agentic AI has introduced complex challenges for the ethics and governance of AI systems.
  17. Oct 11, 2026 · Opinion / analysis · 1 source
    The Autonomous Computer: Infrastructure for Computer Use Agents — Ang Li, Simular
    Ang Li uses that demonstration to explain Simular's approach to autonomous computers: combine adaptable vision agents with reusable automation code, then check the environment as each step runs.
  18. Oct 11, 2026 · Open-source release · 1 source
    onehumanbeing/esp32-iphone-agent: Let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, any OpenAI-compatible vision model. No Mac, no developer acc
    Let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, any OpenAI-compatible vision model.
  19. Oct 9, 2026 · Product / feature launch · 5 sources
    [AINews] Claude Haiku 5.5 — better than GPT-6 Luna at the same pricing
    It’s been about a year since Anthropic shipped Haiku 4.5, and with successive launches of Sonnet and Opus and Fable up to 5.5 it was seeming a little forgotten, especially as OpenAI launched Luna 6 alongside Astra and Sol 6.
  20. Oct 9, 2026 · Research paper · 2 sources
    Work2Skill: Capturing Human GUI Experience for Reusable Agent Skill Induction
    We thus introduce Work2Skill, a framework that captures human GUI experience for reusable agent skill induction.
  21. Oct 9, 2026 · Research paper · 1 source
    AutoEnvScaling: Automating the Data Flywheel with Terminal Agents
    We introduce AutoEnvScaling, which treats environment design as a terminal task and uses agents to automate the data flywheel.
  22. Oct 8, 2026 · Research paper · 2 sources
    SoftwareGym: Scaling Computer-Use Agent Training with Diverse Synthesized Software Environments
    Computer-use agents (CUAs) are rapidly improving, yet synthesizing diverse and reliable software environments at scale remains challenging.
  23. Oct 8, 2026 · Research paper · 1 source
    Can LLMs Fix It Without Code? Toward Automated Verification of No-Code Bug Fixes
    This study proposes an automated, execution-based pipeline for evaluating the capability of large language models (LLMs) to generate no-code fixes in a real browser environment.
  24. Oct 8, 2026 · Research paper · 1 source
    AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use Tasks
    To this end, we introduce AgentHorizon, a benchmark of 1,373 computer-use tasks (instruction-trajectory pairs) drawn from 166 hours of human-recorded trajectories spanning three operating systems.
  25. Oct 7, 2026 · Opinion / analysis · 1 source
    Opposable
    Computer use for phones to give your AI thumbs
  26. Oct 7, 2026 · Research paper · 1 source
    AgentTime: Can Agents Estimate and Control Their Own Runtime?
    We present AgentTime, a benchmark for testing whether agents can work for a requested duration, predict their runtime, and estimate elapsed time afterward.
  27. Oct 7, 2026 · Research paper · 1 source
    Secure-CUA: Controlling Untrusted Influence in Computer-Use Agents
    Computer-use agents (CUAs) perform tasks across applications (such as desktops, mobile apps, and web browsers) by observing graphical interfaces and issuing commands such as clicks and keystrokes.
  28. Oct 6, 2026 · Open-source release · 1 source
    OrgoAI/bops: Bops: a team of AI bots that run your business ops, each with its own computer, email and phone number. bops.bot
    Bops: a team of AI bots that run your business ops, each with its own computer, email and phone number. bops.bot Language: TypeScript.
  29. Oct 6, 2026 · Opinion / analysis · 1 source
    Advancing computer use with Ironclad
    Learn how OpenAI and Ironclad are training and evaluating AI agents on complex contracting workflows to advance computer use for professional work.
  30. Oct 1, 2026 · Product / feature launch · 3 sources
    [AINews] OpenAI DevDay 2026: Dots, 6.1 Sol, Ultrafast, Decisions API, Agents API, Spaces, Marketplace, and 1.2 Billion ChatGPT WAU
    In any case, you have any number of recaps coming at you today, and we’ll be shipping our DevDay pod soon, so you can either watch the full 1 hour livestream or this 15 minute supercut:

Often appears with