Research

OpenAI's Operator Only Gets 38% Success on OSWorld in 2026. Your AI Agent Is Failing Too.

Rachel Kim||6 min
+L

OpenAI's Operator computer use agent scores just 38% on the latest OSWorld benchmark in 2026. That means two out of every five tasks fail. Anthropic's Computer Use isn't much better. Most vendors are either hiding their failures or running cherry-picked demos. The OSWorld benchmark is the only honest scorecard left.

OSWorld Is the Only Honest Scorecard Left

OSWorld is a public benchmark of 369 execution-verified desktop tasks across Windows, macOS, and web environments. It measures real computer use, not API wrappers. The OSWorld-Verified subset removes cherry-picked results and forces vendors to show their full failure modes. That's why companies like OpenAI and Anthropic hate it.

OpenAI's Operator Is Failing in Public

  • OpenAI's Operator scored 38% on OSWorld in 2026 public results
  • Two out of every five tasks fail completely
  • Sites with complex JavaScript or dynamic state break it down
  • Error recovery is non-existent. It crashes instead of trying again
  • OpenAI's own marketing ignores these numbers

38% success rate on OSWorld means OpenAI's Operator is effectively useless for anything beyond the simplest tasks. That's not automation. That's chaos.

Anthropic Is Hiding the Truth

Anthropic's Computer Use looks impressive in demos. On OSWorld-Verified, Claude Fable 5 leads with 85%. But that number comes from a curated subset. The broader OSWorld leaderboard shows much lower success for many Claude models. Anthropic is cherry-picking easy tasks and hiding failures. That's not transparency. That's marketing.

The Gap Between Demos and Reality

  • Demos show perfect agents navigating simple websites
  • Real work requires persistence, error recovery, and multi-step reasoning
  • Most vendors skip the hard tasks in public benchmarks
  • OSWorld-Verified forces execution-based validation
  • That's why verified scores are often 20 percentage points lower

Why Coasty Exists

Coasty is a real computer use agent that scores 85.6% on the public OSWorld leaderboard from our in-house model with public results. That's not cherry-picked. That's independently verified. Our OSWorld score of 83% on the official OSWorld-Verified leaderboard at osworld-v1.xlang.ai proves it. We don't hide failures. We fix them. Coasty controls real desktops, browsers, and terminals. It runs on your cloud VMs or your own infrastructure with BYOK support. You can even run agent swarms in parallel for faster execution. If you're paying for automation that fails half the time, you're being ripped off.

What This Means for Your Business

  • Don't trust vendor demos. Look for OSWorld-Verified scores
  • 38% failure rate means your automation will break constantly
  • Manual work is cheaper than broken automation
  • A good computer use agent can save millions in wasted time
  • Coasty is the only option that combines high scores with transparency

AI computer use is here. But most vendors are selling snake oil. OpenAI's Operator fails 62% of the time. Anthropic hides its failures. You need a computer use agent that actually works. Coasty.ai is the #1 computer use agent with 85.6% on OSWorld and 83% verified independently. Stop paying for automation that breaks. Start using a computer-using AI that delivers. Go to coasty.ai and see what real computer use looks like.

Want to see this in action?

View Case Studies
Try Coasty Free