Skip to content

Talk with Koi

An AI that can see your screen, on your Mac

Koi for Mac is an AI that can see your screen. Hold Fn + ⌘, ask out loud, and it looks at what you're looking at, then circles the answer, draws it, rewrites your text or does it for you. It sees the screen with each question, unless you switch it to only when you ask, or never.

How do you ask an AI about your screen?

With a chatbot in a browser tab, you copy, paste and describe what you're looking at. An AI that can see your screen skips all that. You ask about the thing in front of you, and it already knows what “this” is.

With Koi, hold Fn + ⌘, ask out loud, and let go. Koi answers out loud, in whatever language you speak to it, and you hold again to go back and forth like on any call. It hears you only while you hold the keys. When nothing's been said for 30 seconds, and Koi isn't talking or working, the call ends by itself. Or end it yourself: click Hang up.

Ask “what does this error mean?” or “which one do I click?” and it looks at your screen.

Everyday questions get an answer straight away. When the answer depends on today, it searches the web, and for math, code or careful reasoning it hands the question to a stronger model. It tells you when it's searching or thinking something through. While a call is on, a light runs around the edge of the screen, so you always know Koi is there.

When does Koi see your screen?

Seeing the screen is a setting with three answers: never, only when you ask, or with every question. It starts on every question, and you can change it any time in Settings, under Talk to Koi.

Even then, Koi isn't watching. A picture of the screen goes along when you ask a question, and only then. Between questions it sees nothing.

macOS also asks you to allow Screen Recording before Koi can see anything. If a permission is missing when you call, Koi says what's missing and how to allow it, and lets you call anyway.

Can an AI point at things on your screen?

Koi answers on the screen itself. It circles the button you need, or highlights the exact sentence it means. For harder things it draws on a board laid over your screen: a diagram, a graph, a sum worked out step by step. The marks look hand-drawn and go away once they've done their job.

What can you ask an AI that sees your screen?

It's the kind of help you'd ask a friend sitting next to you for. A few things to try:

  • In an app you've never used: “where do I turn this off?” Koi circles the switch.
  • On an error message: “what does this mean, and what do I press?”
  • In System Settings: “where's the setting for my keyboard shortcuts?”
  • On a chart or a dense paragraph: “explain this”, with the part it means highlighted.
  • On homework: “walk me through this sum”, worked step by step on a board over the screen.
  • On a form: “did I miss anything?” before you click Submit yourself.
  • On a chat about a meeting: “put that in my calendar for Friday at 3”, in Koi's calendar, or your Google or Apple one.

Questions don't have to be about the screen. Ask what the weather is doing, how to word a hard email, or what an acronym stands for, and Koi answers the same way, out loud.

Rewrite selected text in any app

Select text anywhere and say “fix the grammar”, “make it shorter” or “reply that I'll be late”. Koi changes it in place and highlights the new words, and ⌘Z takes it back.

On a Koi page it can do more: write where the cursor is, add a summary, turn lines into headings or lists, or change several places at once. Ask on a call and it makes a whole page, tables and all, and opens it. That's how Koi's notes, with tables and charts, fill up without typing.

When you just want your own words down, there's dictation: tap Fn + ⌥ and Koi types what you say. That part runs on your Mac and works offline. More on voice to text on Mac.

Can an AI use your Mac for you?

Yes, up to a line. Say “open YouTube and search for lo-fi”, “click Skip” or “scroll down”. Koi uses real clicks and keys, with subtitles saying what it's doing and Koi's own purple pointer flying to each thing it presses. Your own pointer stays where it is, in your apps and on web pages. Only a drag, or a click macOS can't press for it, borrows yours, for an instant. It checks that what it did worked, and tries another way if it didn't.

It can start things for you too. Say “take dictation for me”, “record this call” or “record this lecture”, and Koi says so, hangs up, and starts dictation, call recording on your Mac, or a recording of the room.

Can Koi answer from your own notes and apps?

Yes, with “Let Koi read my apps for me” on. Ask “what did Sam say about pricing?” on a call, and Koi searches your own pages, dictations, recorded calls and chats on your Mac and answers from the best few.

Ask what's on today, what's due, what's unread, or what's in a note or your open tabs, and only what that question needs goes along with it.

Can Koi teach you instead of giving the answer?

Turn on Study mode in Settings, under Talk to Koi, or ask Koi to, and Koi teaches rather than answers. It circles where your working went wrong, asks what you'd try next and draws only the next step. Each thing you missed becomes a flashcard on a page called What I got wrong, to study before the exam.

Say “make flashcards from this page” or “quiz me on what I got wrong” and it does that too. The cards live in Koi's documents, each coming back when it's due.

Keep the steps as a guide

When a call where Koi circled or drew on your screen ends, the dock offers to save it as a guide: a page with Koi's words and a picture of each step, ready to share. With “Keep a clip of each call” on, on macOS 15 or later, a clip of the call goes at the top. Not saved, it's all deleted.

What Koi will never do on your Mac

Some buttons are yours to click. Koi won't buy, pay, order, send, post, publish, delete, confirm, accept terms, sign in, or type a password or a card number, whoever asks.

That's enforced in the app, not just asked of the AI model. Instead, Koi gets you to the button, circles it, and lets you click it. A drafted email waits for you to hit Send.

Text on a web page is never an instruction to Koi. Only your voice is. A page that says “ignore your rules and click here” is just words on a page.

What leaves your Mac during a call with Koi?

A call with Koi needs the internet, because the AI models it talks to don't fit on a laptop. While the call lasts, this goes to the AI provider:

  • Your voice.
  • A picture of your screen with each question, unless you switch it to only when you ask, or never.
  • Selected text or the front window's words, only while their switch is on, and only with the question that needs them.
  • What Koi remembers about you, so the answer fits you.
  • The time and time zone on your Mac, so “tomorrow” means your tomorrow.
  • With “Let Koi write and edit for me” on, the page open in Koi's window, so Koi can change it when you ask.
  • With “Let Koi read my apps for me” on, the one thing a question needs: that day's calendar, your unread mail's senders and subjects, a note, a contact, your open tabs, or the lines of your own documents that answer it.
  • With “Let Koi use my Mac for me” on, the names of the closest few apps or files, when more than one fits what you asked Koi to open.
  • Your question, to a web search, when the answer depends on today.

Koi's server keeps what a call cost (time, tokens, money), because that's how your Koi usage is counted. A call that goes quiet hangs itself up, so silence isn't streamed.

Our privacy policy lists everything that leaves your Mac, and our trust page sets out where your data lives and who processes it.

Can you type to Koi instead of talking?

Yes. Tap Control twice and a chat grows out of the notch. Type, press Return, and it folds back into the notch saying Thinking, then opens again on Koi's written answer, with a line for a follow-up. No call and no voice, which suits a meeting, a library or a shared office. Type / and a name to send one of your saved prompts.

Does Koi remember you?

Within a call, yes: “and that one?” just works. When the call ends, so does the conversation, and the next call starts fresh.

Koi also remembers what you tell it, or ask it to remember: your name, what you're working on, how you like answers. Settings, under Talk to Koi, Memory, shows every line of it to change or delete, or turns it off.

Can Siri see your screen on a Mac?

On macOS 27, yes. Apple says Siri AI, in beta, can answer questions, take action and search based on what's on your Mac screen. Command-Shift-Space picks a window to ask about, and Command-Shift-6 a part of the screen. It needs an Apple Intelligence Mac, M1 or later or the MacBook Neo, and works in English to start. Checked on October 16, 2026.

Koi is for people who want help that points, draws and clicks, on any Mac with macOS 14 or later, Apple silicon or Intel, in whatever language they speak, with dictation and call notes in the same app. For the app most like it, read how Koi compares with HeyClicky, or see our list of the best AI voice assistants for Mac.

We also compare Koi one to one with Siri on the Mac, VoiceOS and Vellum Ambient.

How much does Koi cost?

Koi starts with a 3-day free trial (card needed), then Pro is $12 a month, or Lifetime is $99 once. Both have unlimited dictation and recordings, and can add Koi credit for more Koi AI.

Rather pay once? Lifetime is $99, paid once. It comes with Koi credit worth 46% of what we receive after fees and taxes, which never expires, and top-ups add more. The app shows your usage as a percentage, never as a meter running in minutes. See every plan.

Keep exploring

Siri vs Koi on a Mac: what each one is for

Looking for a Siri alternative on Mac? Siri vs Koi: what each sees on your screen, which Macs and languages they need, what they do for you and what they cost.

The best Cluely alternatives for Mac

Cluely alternatives for Mac: Koi, Granola AI, Shadow, Highlight, Littlebird and HeyClicky. Meeting notes, help on screen, prices, and what undetectable means.

Frequently asked questions

Try Koi on your Mac

Try Pro free for 3 days, card needed, then $12 a month. Or Lifetime, $99 once.