HeyMate

Screen-aware AI · 3 min read

AI assistants that can see your Mac screen

Compare how HeyMate, ChatGPT, Claude, and Gemini get screen context on Mac, then try one sample task to see which fits your workflow.

Compare what you actually share

Screen awareness can mean an attachment you select, a window you share mid-conversation, or fresh captures as a task progresses. Pick the workflow you want before comparing model names or plans. The HeyMate project publishes this comparison using official product documentation checked November 9, 2026.

Mac appHow you provide screen contextWhen it fits
HeyMateHold Control + Option to ask about what is on screen. A guided walkthrough can capture again between steps. Screen guidanceYou want the assistant to point to a control while you do each step.
ChatGPTTurn on Screen context in Voice settings on Mac and ask ChatGPT to look at the window in front. OpenAI Voice walkthroughYou want a spoken back-and-forth in ChatGPT and have a plan that includes desktop Voice.
Claude DesktopUse quick entry to attach a region or an application window to a message. Optional dictation lets you review the transcript before sending. Claude quick entry guideYou want to choose the visible area yourself and ask about it in Claude.
GeminiUse Gemini for Mac to share context from your current app. Google documents a shortcut using both Command keys. Gemini desktopYou already use Gemini and want to bring the current app into a question quickly.

Try the same question in each app

Open TextEdit and type a few lines of sample text. Bring that window to the front and use each assistant’s documented method to share it. Ask how to export it as a PDF and where to start. Apple’s TextEdit guide gives you an answer to check against.

Try this prompt

I am in TextEdit with a sample document. Help me save a PDF copy. Tell me the first step and where I should look. Wait until I tell you what appeared.

Pay attention to whether you could choose the area shared, whether the answer referred to your actual app, and how easily you got the next step after the menu changed. If you need a pointer, look for an on-screen cue that identifies the control. If you want to keep sharing under manual control, check whether you can select each image before sending.

Check your Mac and your account

HeyMate supports Apple silicon and Intel Macs on macOS 14.2 or later. Screen questions require a vision-capable connection. Claude Code and ChatGPT through Codex use their respective CLI sign-ins. HeyMate provider setup

Google lists Apple silicon and macOS 15 or later for Gemini on Mac. Claude lists macOS 12 for quick entry and macOS 14 for quick-entry dictation. OpenAI lists eligible paid plans for desktop Voice. Check the feature documentation above before changing plans or installing a new app. Gemini for Mac requirements

Choose how much context the task needs

If you only need to identify a toolbar button, one cropped screenshot may be enough. If the interface changes after every click, refreshing context can make the next answer more relevant. Start with sample material and see what screen access can expose. When the job is learning an interface, try a voice walkthrough you can do yourself.

Try it with one small task.

HeyMate is free and open source for macOS 14.2 and later. Bring your own AI; provider limits and optional service fees apply. Builds are Developer ID signed and notarized by Apple.

Set up HeyMate on Mac