Turn PyAutoGUI Code into Structured Actions with the Free Parse Endpoint
PyAutoGUI works but brittle selectors break when UI changes. The free /v1/parse endpoint converts your PyAutoGUI scripts into structured actions the Coasty computer use API can drive. This lets you reuse existing scripts and ship agents that see and click just like a human.
How it works
Send a POST request to https://coasty.ai/v1/parse with a JSON body containing a pyautogui function and source code. The endpoint returns a structured action JSON you can feed into /v1/sessions or /v1/runs. This pipeline keeps your existing scripts while adding vision-based control.
curl -X POST https://coasty.ai/v1/parse \
-H "X-API-Key: $COASTY_API_KEY" \
-H "Content-Type: application/json" \
-d @- <<'EOF'
{
"source_code": "import pyautogui\npyautogui.moveTo(500, 300)\npyautogui.click()",
"function": "move_and_click"
}
EOFRequest format
- ●POST https://coasty.ai/v1/parse
- ●Header: X-API-Key or Authorization: Bearer
- ●Body JSON with source_code string and optional function name
- ●Returns a structured actions JSON ready for stateful sessions
The /v1/parse endpoint is free, no credits required.
Where this beats brittle automation
PyAutoGUI relies on absolute coordinates that drift with window resizing. By feeding structured actions into /v1/sessions, your agent sees the screen, locates elements with /v1/ground, and acts in real time. This vision-based approach adapts to UI changes without selector updates.
Integrate existing scripts with the free parse endpoint and drive them through stateful sessions. Start building robust computer use agents today at https://coasty.ai/developers.