Skip to content

Gemini on Mac Can Now Use Your Apps for You, Without Taking Over Your Screen

Gemini for Mac can now click, type and fill out forms in your apps to finish tasks, working in a separate window. What it does, who can use it and what to watch out for.

A woman working on a laptop at a small desk at home, next to a plant and a tablet
Photo: Tranmautritam / Pexels

Google’s Gemini app for Mac can now do work inside your other apps. A new feature called “computer use,” announced on November 19, lets Gemini click, type, open menus and fill out forms across desktop apps and websites to finish multi-step tasks for you. The twist: it does all this in a separate window, so you can keep using your Mac while it works. Here’s what it can do, who can use it and what to keep in mind before you let an AI drive your apps.

What Gemini can do on your Mac

Google says you just describe the task and Gemini handles “the clicking, typing, menus, and forms.” Its examples include:

  • Editing photos in batches, like color-grading a set of pictures in design software.
  • Filling out forms from your files, such as pulling weights, sizes and addresses from PDFs into a shipping quote.
  • Building presentations from data and screenshots on several websites, in Google Slides.
  • Listing items for sale: looking at clothing photos in a folder, researching prices and setting up listings on resale sites.

To start, Android Authority says you type @Computer use in your prompt and describe what you want done.

A MacBook on a stand next to a wireless keyboard, plants and AirPods on a dark desk
Photo: Jean-Daniel Francoeur / Pexels

It works in the background, and you stay in control

Gemini doesn’t borrow your mouse. It runs in an isolated background window, with a live preview of what it’s doing inside your Gemini chat. According to Google, you choose which apps Gemini can access, you can watch every step and pause it at any time, and you approve key actions before they happen.

Who can use it

  • It’s not free. Computer use is for Google AI Plus, Pro and Ultra subscribers, Google says.
  • US and English only for now.
  • Personal Google accounts, 18 and older.
  • An Apple Silicon Mac (M1 or newer) running macOS Sequoia 15.0 or later.

You can download the Gemini app for Mac from gemini.google/mac.

Top view of two people at a round table, one typing on a laptop next to a tablet
Photo: cottonbro studio / Pexels

What this means for you

  • It’s built for boring, repetitive work. If you spend time copying details from PDFs into forms or making the same edits over and over, this is where it can save you real time.
  • Give it only the apps it needs. Since you choose what Gemini can open, allow just the apps for the task in front of you, not everything on your Mac.
  • Watch the first few runs. Use the live preview while you get a feel for how it works, and start with low-stakes tasks before anything involving money or personal accounts.
  • Apple is tightening the rules for AI agents. The Verge notes the launch comes as Apple prepares new restrictions for apps that want “full disk access” on the Mac, because of the risks of AI agents that can use your computer. A preview of those settings arrived in this week’s macOS 27.3 beta. It’s a good time to check which apps have Full Disk Access on your Mac.
  • Google is pushing Gemini to act for you everywhere. Android Authority points out that this comes two days after Google made Gemini Tasks free and let it call businesses for you.

Sources: Google, The Verge, Android Authority

The weekly byte

The week's tech news and the best deals, in one email every Friday.

We'll email you a link to confirm. One email a week, unsubscribe anytime.

GigaGuideTech logo
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.