Zephyr

(Hands-free control for Mac and Windows)

Point.Pinch.Swipe.and twist.

Zephyr turns the webcam you already have into a controller for your Mac or Windows PC, and for the Roku TV across the room. Gestures change with the app in front, and you can teach it your own.

Free · Mac app for Apple silicon · runs on Windows 10 and 11 · camera video stays on your computer

21points tracked on each hand, every frame
10gestures built in, plus any you record
0frames of camera video leave your computer
1webcam. Nothing else to buy or wear.
(01)

Try it in your browser

The same hand tracking and gesture rules as the desktop app, running in this tab. Your video never leaves your device.

Sample hand

See your hands the way Zephyr does

Runs in this tab. Nothing is uploaded.

  • 21 points per hand, found in this tab
  • The knuckle that steers the pointer
  • Your pinch closing; green means click
  • A ring filling up: palm, fist knob, both palms

Point your index finger up to show the pointer, then pinch thumb and index quickly to click. Pinch and hold to write.

Your screen
Pinch
–

Pointer hidden · clicks 0

(02)

The gestures

Ten built in. Each one is a shape and a movement the camera can't mistake for your hand at rest.

  1. Point

    Index finger up, the others curled.

    The pointer appears and follows your index knuckle.

  2. Pinch

    Tap thumb and index together.

    A click, right where the pointer froze.

  3. Pinch & write

    In Word, or once search is open: pinch and move to draw, let go to end a stroke.

    AI reads it as text. Pinch the preview to accept, swipe to cancel.

  4. Two-finger swipe

    Index and middle up, a quick move sideways.

    Next or previous: slide, track, tab.

  5. Open-hand swipe

    The whole hand, a quick move sideways.

    Switches desktops, on a Mac or in Windows.

  6. Quick fist

    Close your hand and open it, under a third of a second.

    Play or pause.

  7. Fist knob

    Hold a fist for 0.4 seconds, then twist it.

    Right hand turns the volume, left hand the brightness.

  8. Palm held

    An open palm to the camera, still, for 0.8 seconds.

    Opens Spotlight or Windows Search. Write what you're looking for.

  9. Both palms

    Raise both hands together, for a second.

    Turns Zephyr on or pauses it, and locks it to you.

  10. Handshake

    Shake hands with someone in view.

    Your guest gets swipes, play/pause and clicks until you raise both palms.

(03)

Built for work where a mouse doesn't fit

More work happens on screens every year, but not every worker can sit at a desk with a free hand on a mouse. Zephyr lets people run a computer with the hands they are already working with.

Kitchens

Floury hands

Scroll a recipe, start a timer and skip a track without touching the laptop.

Labs and clinics

Gloved, sterile hands

Move through protocols, records and imaging while gloves stay on and clean.

Shop floors and garages

Greasy hands

Page through manuals, parts lists and videos from where the work is.

Classrooms and meetings

Across the room

Teachers and trainers run slides and media while they move, and hand control to a colleague with a handshake.

Accessibility

Big gestures, not fine motion

People with limited hand mobility, RSI or tremors use large, forgiving gestures instead of precise mouse moves, and can record shapes that suit their own hands.

No cost barrier

Any webcam

Free, on the Mac or Windows computer people already have. Nothing to buy, wear or calibrate.

(04)

And the TV across the room

Turn on TV mode from the menu bar (the tray on Windows) and the same gestures drive a Roku TV over your Wi-Fi: the home screen, apps, playback, volume, even typing into search. It talks to the TV the way Roku's own phone app does.

GestureOn the TV
Point and move your handArrow keys
PinchOK
Quick fistPlay / Pause
Two-finger swipe left / rightForward / Rewind
Open-hand swipe left / rightBack / Home
Fist knobVolume
Palm held, then write in the airTyped into search
Your own gestureAny key or app
  1. Put the TV and the computer on the same Wi-Fi.Guest and campus Wi-Fi keep devices apart, so a phone hotspot works best there.
  2. Let apps control the TV.On the TV: Settings › System › Advanced system settings › Control by mobile apps › Network access: Enabled.
  3. Find it from the Zephyr icon.In the menu bar or the Windows tray: Roku TV › Find TV on this Wi-Fi, then Control the TV.

Works with Roku TVs, like the Hisense R6 we demo on. No TV handy? The Zephyr icon can start a TV simulator in your browser that answers the same way.

(05)

What the desktop app adds

The browser can show the hand tracking. On your Mac or PC, Zephyr also runs the actions, knows who is in front of the camera and reads what you write.

Both palms · 1 second

Owner lock

Raise both palms to arm Zephyr. It follows the person who armed it, ignores anyone else's hands, and pauses when you look away from the screen.

Handshake

Share control

Shake hands with someone to hand over swipes, play/pause and clicks. Both palms takes control back.

Two-finger swipe

Gestures that fit the app

The same swipe is the next slide in PowerPoint, the next track in Spotify and the next tab in Chrome.

Any hand shape · 3 seconds

Your own gestures

Record a shape and bind it to a website, an app, a shortcut, text or a TV action. Optional cloud sync brings them to your other computers.

Palm held · pinch and hold

Air writing

Hold up a palm to search, or write in Word: pinch and draw the words in the air, and AI reads your handwriting.

Point and pinch

A pointer that holds still

The pointer follows your index knuckle and freezes as your fingers close, so the click lands where you aimed.

(06)

How it works

  1. Your webcam

    MediaPipe finds 21 points on each hand, on your computer, every frame.

  2. Points become a gesture

    Finger angles decide the pose: open palm, fist, point or two fingers. The palm's path over time makes swipes, holds and the knob.

  3. The app in front decides

    Zephyr checks which app is in front, or the TV, and runs that action, or the one you recorded.

Camera video never leaves your computer. Air writing sends only the strokes you draw, so they can be read as text.

(07)

Install

A download for Mac. On Windows, Zephyr runs from the source in a few commands.

On a Mac

  1. Download Zephyr.dmg and open it.Drag Zephyr into Applications, then open it from there.
  2. Allow it the first time.Zephyr isn't notarized yet, so macOS blocks the first launch. Open System Settings › Privacy & Security, click Open Anyway next to Zephyr and enter your password.
  3. Grant the camera and Accessibility.Allow the camera, then turn on Zephyr under Accessibility so it can move the pointer and press keys.
  4. Raise both palms.Zephyr lives in the menu bar. Arm it with both palms and start pointing.

Get Zephyr

Download for Mac

For Apple silicon Macs (M1 or later) with a webcam.

Prefer to build it yourself? The source and build steps are on GitHub.

On Windows 10 or 11

  1. Install Python 3.11 or 3.12 and get the source.Download the code from GitHub (Code › Download ZIP) and unzip it, or clone it.
  2. Set it up once, in PowerShell.Open PowerShell in the Zephyr folder and run the commands on the right.
  3. Allow the camera.Settings › Privacy & security › Camera › Let desktop apps access your camera. No other permissions are needed.
  4. Raise both palms.Zephyr sits in the tray. Arm it with both palms and start pointing.

Run it on Windows

py -3.11 -m venv .venv
.venv\Scripts\activate
python -m pip install --upgrade pip
python -m pip install -r requirements.txt
python tools/get_models.py
python run.py

Next time, just activate and python run.py.

Windows runs a copy of the engine tuned on laptop webcams:

  • Pinch twice quickly for a right click, in any app.
  • A click counts if you let go within about a second.
  • Play/pause takes a fist held up to two seconds, then opened.
  • Search needs the palm flat to the camera.
  • The knob starts after a 15° twist, and the hand's side is judged by your body.
  • Open-hand swipes move between virtual desktops (make them in Task View, Win+Tab).