AI product Open source
Finger Frame AI is a browser app and Python CLI pipeline by Sophia Yang that places an AI-generated world inside a two-hand finger-frame gesture. It sends an uploaded video to Gemini Omni Flash for video-to-video restyling using a selected style or custom prompt, with alignment instructions intended to preserve framing, facial positions, expressions, blinks, gaze, and motion. MediaPipe Hand Landmarker then tracks both hands and the finger-frame quadrilateral frame by frame; the tracking pipeline uses anatomical corner ordering, spread and area gates with hysteresis, teleport rejection, velocity-adaptive smoothing, dropout holding, and presence fading. The compositor reveals the restyled video through the tracked quadrilateral and adds a dashed outline with pulsing corner markers.
The browser app exports MP4 where browser recording supports it and otherwise WebM. The CLI separates restyling and compositing into `stylize.py` and `composite.py`, accepts formats readable by FFmpeg or OpenCV, and can produce H.264 MP4 while retaining the original audio track when present. Users provide their own Gemini API key; the app keeps it in the browser and sends it only to Google's API. Generation is billed per video, and the app recommends keeping uploads under about 15 MB. A no-key placeholder mode runs the tracking, compositing, and export pipeline with a hue-shifted stand-in.
2 uses taken from transcripts — each links to the moment in the video.
A free browser-based tool that turns a video of the finger-frame gesture into a clip containing an AI-generated world inside the frame. It restyles the video while preserving motion and can also run through a Python CLI.
Uses a two-hand framing gesture to create a window showing an AI-generated, video-to-video version of the same clip while preserving motion and facial alignment.
2 in the library.