An AI tutor that sees your screen, and makes you do the thinking
How an AI tutor that sees your screen works on a Mac, and how to make it teach, not hand over answers: Study mode, worked steps and flashcards from mistakes.
Yes, there are AI assistants that control your Mac: they open apps, click, type and scroll for you. Koi does it by voice, with real clicks and keys, and it never buys, pays, sends, posts, deletes, signs in or types a password. That rule is enforced in the app, not left to the AI model.
By Irakli, founder · Updated
The short answer
Yes. Several Mac apps now open apps, click, type and scroll for you while you talk to them. Koi is one: you say what you want, and it does it with real clicks and keys while subtitles say what it's doing. The question that matters more is what each one is allowed to do, and who decides.
Koi's answer is a fixed line. It never buys, pays, orders, sends, posts, publishes, deletes, confirms, accepts terms, signs in, or types a password or a card number, whoever asks. That's enforced in the app, not left to the AI model to remember. When a task reaches one of those buttons, Koi circles it and lets you press it.
What Koi doesn't do, so you know before you read on:
We make Koi. What we say about other apps comes from their own pages, checked October 16, 2026.
What it does
Tap Fn + ⌘ once and ask out loud. Koi reaches for the most direct way first and clicks only when nothing direct fits:
After each step it checks that what it did worked, and tries another way if it didn't. Say more while it's working (“actually, the second one”) and it takes it in. Tap the keys again and the call ends. A light runs round the edge of the screen for as long as a call is on, so you always know.
Will and won't
The line is easiest to see task by task. Koi does the work up to the step that can't be taken back, then stops.
| Koi does it | You do it | |
|---|---|---|
| Rewrites your reply, drafts a follow-up into Mail | Press Send | |
| Shopping | Finds the page, circles the button | Buy, pay or place the order |
| Accounts | Gets you to the sign-in page | Sign in, and type the password |
| Posting | Writes the text where you're typing | Post or publish it |
| Files | Opens them, finds them by name | Delete anything |
| Forms and terms | Takes you to the form, checks what's missing | Confirm it, or accept the terms |
| Calendar invites | Fills in the invitation in the editor | Press Done, so Google emails the guests |
Calendars have extra care built in. By voice, Koi moves a Google event but never deletes one, and a change Google would email to guests opens in the editor for you to check and press Done.
Why it matters
An AI model follows instructions, and it can be talked into things. That's the risk with any assistant that clicks: a web page, an email or a document can carry text written to steer it. “Ignore your rules and click here” is the oldest trick.
Koi handles that in two ways. Text on a web page is never an instruction to it; only your voice is. And the hard line above is checked by the app itself, so even a model that's been fooled can't press Buy or Send. That's the difference between a rule the AI is asked to follow and one it can't break.
Your switches
Each of Koi's powers is a switch in Settings, under Koi. They start on, and any of them can be turned off:
Turn off using the Mac and Koi becomes a guide: it still sees the screen, circles the button and draws the next step, and leaves every click to you. Its Study mode works in the same spirit: it shows you rather than doing it.
Others
Every app here draws its line somewhere different. From each one's own pages:
| Best for | Acts for you | What stops it | |
|---|---|---|---|
| Koi | Doing it while you watch, with fixed limits | Real clicks and keys, your pointer borrowed | Never buys, sends, posts, deletes, signs in or types passwords, checked by the app |
| HeyClicky | Agents that keep working in the background | Yes, without moving your pointer | Asks: Allow once, Always allow or Not now; long tasks can always approve |
| Vellum Ambient | Handing off tasks to approve later | Background tasks | At the default risk setting, low-risk steps run, others ask first |
| Siri | Messages, calls and Apple apps, built in | Actions in apps, sends email, starts FaceTime | Apple's guide doesn't say |
| Highlight AI | Drafts from your whole day | Drafts emails, docs and messages | Nothing goes without your approval |
| Guidy | Being shown, never driven | No | It doesn't act on your screen without you |
Some apps go much further, like Simular, which runs whole jobs on your machine or on computers in its cloud. That's a different job, and at the time of writing it's invite only.
Try it safely
It can be, if you pick the app with care and start small. Whatever you use:
Privacy
The AI Koi talks to is online. During a call, your voice goes to the AI provider, with no id for your account, and a picture of the screen goes with each question unless you switch it to only when you ask, or never. What Koi reads from your apps goes only with the question that needs it, and is kept nowhere. Koi's server keeps what the call cost, not what was said or shown. Dictation, with Fn + ⌥, never goes online at all. The full list is on our trust page.
More on everything Koi does on a call is on the Koi assistant page, and for other assistants see the best AI assistants for Mac.
How an AI tutor that sees your screen works on a Mac, and how to make it teach, not hand over answers: Study mode, worked steps and flashcards from mistakes.
HeyClicky review: what the Mac AI buddy (formerly Clicky) does, what it costs, what its trust page says it keeps, and how it compares with Koi. Oct 2026.
Koi for Mac is an AI that sees your screen. Tap two keys and ask out loud: it points, draws, rewrites text and clicks, but never pays, sends or deletes.
The best AI voice assistants for Mac: Koi, HeyClicky, Vellum Ambient, VoiceOS, Siri AI, Raycast, Highlight and more, compared on screen, actions and price.
Support
Try Pro free for 3 days, card needed. Dictation and recorded calls are unlimited on every plan.