AI product Open source

barehands

barehands is an open-source, webcam-powered hand-tracked interface for AI assistants. It runs in Chrome with a webcam and overlays notes, images, and 3D models as cards over the camera feed; users manipulate them with gestures such as pinching, throwing, stretching, force-pulling, and two-finger dragging.

View repository Mentioned in 2 videos ↓

Overview

The interface uses a local Python server and loads Google MediaPipe for hand tracking and three.js for 3D rendering. Markdown folders, including Obsidian vaults, can serve as note sources, while configured media folders provide images, transparent props, and 3D models. An AI assistant can control the interface through local files and shell scripts: state files drive the on-screen ring's status, and the board protocol presents content on the stage. The repository states that it can be used, modified, and built on commercially within a business, with redistributed versions remaining under the same license.

What barehands is used for

2 uses taken from transcripts — each links to the moment in the video.

  • Turns a webcam into a hand-tracked board. Pinching moves cards, flicking throws them, and a claw gesture can drag an item across the screen into the user's hand.

  • A webcam-powered interface that turns hand gestures into controls for an AI assistant. Users can pinch, throw, stretch, and manipulate notes, images, and 3D models as cards over a camera feed, with local files serving as note sources.

Videos mentioning barehands

2 in the library.