Beyond the Terminal: goose Controls Your Desktop with Peekaboo

Most AI agents live in the terminal. They can read files, run commands, and write code — but ask them to click a button in a web app or fill out a form, and they're stuck. They can't see what's on screen, and they certainly can't interact with it.
With v1.26, goose broke out of the terminal. The Computer Controller extension was rebuilt from the ground up with Peekaboo, a macOS CLI tool for screen capture and GUI automation. This gives goose eyes and hands for the desktop — it can see annotated screenshots, identify UI elements, click buttons, type text, scroll, drag, and navigate menus across any application on your Mac.




We are excited to share a preview of the new updates coming to goose with goose v1.0 Beta!