You know the pain: a bot that worked for three months suddenly stops on a patch Tuesday, a new app release, or a UI refresh. A developer has to rebuild selectors or object IDs, and the team falls behind on the backlog again. Meanwhile, the business keeps asking for more automation. The real problem is not that RPA is old. It is that RPA assumes a stable UI, which most enterprise apps are not.
Why RPA breaks here
Traditional RPA platforms like UiPath, Automation Anywhere, Blue Prism, and Power Automate rely on selectors, XPath, or object IDs. When a developer builds a bot, they assume the UI layout and element properties will not change. Enterprise software rarely holds that promise. UI changes are constant. A button label, a hidden field, or a layout shift is enough to break the bot. The cost of keeping RPA running shows up in two places. First, developers spend hours rebuilding flows that should have been maintenance-free. Second, business users see a halt whenever a new version lands, forcing a stop-the-line fix or a manual workaround. Industry surveys show that between 40 and 60 percent of RPA effort goes into maintenance, not value creation. Every time a bot breaks, you either pay a developer or you let the process go manual. Neither is a sustainable path.
What changes with computer use agents
- Agents see the screen instead of relying on brittle selectors or object IDs
- When the UI changes, agents adapt without a rebuild
- Agents recover from exceptions instead of halting and alerting a human
- Agents can follow SOPs written in plain English
- Agents work across any application, including legacy systems, Citrix, and virtualized desktops where RPA struggles
Traditional RPA binds to specific elements. Computer use agents bind to the task and adapt to whatever is on the screen.
The selector problem in practice
Imagine a finance team automates invoice matching against SAP. The bot waits for a new email, pulls the attachment, logs into SAP, finds the vendor, and matches the line items. The first version uses a specific XPath for the invoice table and a CSS class for the "Match" button. Three months later, SAP rolls a new theme and changes the class name. The XPath no longer matches. The bot throws an error and alerts a developer. The developer updates the selectors and redeployed. The next month, a new browser extension or a UI refresh changes the table layout again. This cycle repeats every time the app is touched. The more complex the process, the more fragile it becomes. Computer use agents do not need to know the XPath. They see the invoice table on the screen, identify the rows and columns, and act based on the task description. If the table reorders columns, the agent reads the headers and maps the values accordingly. If a button moves, the agent finds it by its purpose and label. No selectors to maintain. No rebuilds.
Handling exceptions like a human
RPA bots are designed to run straight through. If something unexpected happens, they halt and notify the operator. That works for stable, backend-heavy tasks like invoice import or ERP reconciliation. But most enterprise processes are exception-heavy. A human looks at an error, decides what to do, and keeps going. Computer use agents can do the same. When a field is missing, a wrong value appears, or a layout shifts, the agent can evaluate the situation, check a rule or policy, and choose an action. It can retry, ask for clarification, or follow a fallback procedure written into the SOP. The agent recovers instead of crashing. This capability is especially valuable on legacy systems, Citrix, or virtualized environments where the underlying application is not fully accessible via APIs. RPA struggles there because it cannot see the screen. Computer use agents work on top of the visible desktop, so they can automate tasks that RPA simply cannot reach.
Turning SOPs into automation
Most teams already have written SOPs. They are the go-to document for new hires and for troubleshooting. The problem is that SOPs are often too high-level for RPA. A flowchart-based bot needs every step specified, every decision point mapped, and every edge case handled. That is a lot of work before you even start automation. Computer use agents can follow SOPs as written. You do not need to redesign the process into a rigid flow. You describe what the process should accomplish, and the agent figures out the steps on the screen. The agent reads the SOP, sees the current state of the application, and executes the actions. If the agent encounters ambiguity, it can pause and ask for clarification, just like a human would. This reduces the upfront design effort and lets you move faster on the long tail of processes that RPA never touched because they were too messy to automate.
How to move without the risk
You do not need to rip out all your RPA at once. Start with one high-pain process where RPA is breaking often or where the process is too complex for a flowchart bot. Choose a process that has a clear SOP and recurring exceptions. Run a pilot with a computer use agent. Measure how often the agent continues after an exception versus how many times a developer had to intervene. Compare the time to build versus the time to maintain. Once you have confidence, expand to related processes. Keep RPA for high-volume, stable, backend tasks where the UI rarely changes. Use computer use agents for dynamic, exception-heavy, or SOP-driven workflows. This phased approach lets you capture the value of agents while preserving the strengths of traditional automation.
RPA gave you automation, but it also gave you a maintenance treadmill. Computer use agents replace brittle selectors with vision and rigid flows with adaptable, SOP-driven automation. If you are ready to move beyond the rebuild-and-redeploy cycle, book a demo with the Coasty team at https://cal.com/coasty/15min.
Want to see this in action?
View Case Studies