AI product Open source
prompt2rig is an open-source browser application that turns a text motion prompt into a rigged 3D character performance. It sends the prompt to a video model on fal, uses MediaPipe for an immediate live preview, and uses a local GPU pipeline with GVHMR to recover 3D body motion and WiLoR to track wrists and fingers. The recovered motion is retargeted to Mixamo characters, with support for loading Mixamo FBX or GLB files, streaming chained performances, and exporting animated GLB files for Blender or Unity.
The high-quality pass runs through a local worker built around GVHMR and produces SMPL rotations and a root path; WiLoR runs in parallel for hand and finger tracking, with MediaPipe Hands as a fallback. The repository also includes Blender rendering and off-screen browser-capture tools. The web application requires Node 18+ and a fal API key; the optional high-quality path is documented for Windows with an NVIDIA GPU, CUDA PyTorch, ffmpeg, and separately obtained SMPL-X and MANO model files.
The project's own code is licensed under Apache-2.0, while several high-quality motion and hand-tracking components have educational, research, non-commercial, or other separate licensing restrictions.
1 use taken from transcripts — each links to the moment in the video.
A tool that converts a text prompt into a rigged 3D character acting out motion, extracting motion from a fast video model and mapping it onto a Mixamo skeleton in the browser.
1 in the library.