controller.
GestureOS turns your webcam into a touch-free control surface. Pinch, point, and swipe to drive your apps, games, and meetings — all tracked on-device, in real time.
- 0
- Tracked hand landmarks
- 0fps
- Real-time inference
- 0%
- On-device, private
- 0ms
- Cloud round-trips
21 landmarks · live
Engineered for real-time, real-world control
Every layer — from the palm detector to the intent filter — is tuned so gestures feel instant and intentional.
21-point hand tracking
A palm detector finds your hand, then a landmark net maps 21 3D joints every frame — the same skeleton you see in the live overlay.
Runs on your device
ONNX models execute locally with DirectML / CUDA acceleration. No frames ever leave your machine. No latency, no cloud, no creep.
Sub-frame responsiveness
A Kalman-filtered tracker plus async inference keeps gestures buttery at 60fps, even while the model crunches in the background.
Context-aware profiles
GestureOS detects the focused app and swaps gesture maps automatically — gaming, meetings, and system control each get their own bindings.
Intent filtering
Temporal voting, hysteresis, and ghost-gesture suppression mean it only fires when you mean it. Wave goodbye to phantom clicks.
Live skeleton overlay
Watch what the engine sees in real time. Every joint, every confidence score, rendered as a glowing skeleton you can trust.
From photons to actions in under a frame
A three-stage pipeline that never touches the cloud.
Capture
Your webcam streams frames into the on-device pipeline. Nothing is uploaded.
Understand
ONNX models detect your palm, map 21 landmarks, and score the gesture.
Act
The context engine routes the gesture to the right action for your active app.
Profiles that switch themselves
GestureOS detects your focused window and loads the right gesture map automatically.
Map gestures to WASD, abilities, and camera control. Lean into a game without ever touching the keyboard.
Mute, raise hand, and toggle camera with a flick. React with emoji gestures your teammates actually see.
Scroll, switch windows, adjust volume, and navigate your desktop hands-free — perfect for presentations and accessibility.
A gesture for every move
Intuitive, ergonomic, and fully remappable on Pro.
Questions, answered
Does GestureOS send my camera feed to the cloud?+
Never. All hand tracking runs locally with on-device ONNX models. Frames are processed in memory and discarded — nothing is uploaded or stored.
What hardware do I need?+
Any webcam and a reasonably modern PC. GestureOS uses DirectML or CUDA when available, and falls back to CPU inference otherwise.
Which platforms are supported?+
Windows is available today as a public beta. macOS and Linux builds are on the Q3 2026 roadmap.
Can I create my own gestures?+
Custom gesture bindings ship with Pro, and a full gesture recorder is planned for Q4 2026.