DefinitionThe loop that makes the product different: screenshot, identify UI elements, issue mouse and keyboard commands, screenshot again. It reaches platforms with no clean API or MCP.
Do not confuse withAn API or connector call, which returns the data in one step. Computer use is slower, more brittle, harder to audit and far more expensive per unit of work.
Aliases
- browser driving
- GUI automation