Tool
The Web Audio API is an audio-programming API used to generate sound for procedural videos.
Mentioned in 1 video ↓
On this page
1 use taken from transcripts — each links to the moment in the video.
Generates the sound for procedural videos.
An open-source web application for generating procedural interface sounds live in the browser rather than using prerecorded audio files. Users choose a category, generate variations, audition sounds in UI context, and export selected results as WAV files or JavaScript recipes. Its sound library is hand-curated, while generators draw from and remix the library; curator keep/delete decisions adjust each generator's future output. The project is in early beta, with a local workbench for library curation, recipe editing, calibration, deduplication, and generation. It runs as a Next.js, React, Tailwind, and TypeScript application and is seeking contributors.
AssemblyAI's Voice Agent API is an API for building real-time voice agents. It connects speech-to-text, an LLM, and text-to-speech through a single WebSocket, with built-in turn detection and interruption handling.
AVAL is an open-source web format and runtime for short prerendered motion with continuous loops, named application states, authored triggers, bounded transitions, reversals, frame-accurate timing, and packed-alpha transparency. It packages a logical animation as codec-specific .avl files containing motion units and a state graph; the browser selects a decodable candidate from an AV1, VP9, H.265/HEVC, and H.264 ladder, while graph routes handle state changes rather than timestamp seeking. Projects are compiled from a motion.json file with the @pixel-point/aval-compiler package, producing a directory containing the .avl output and build metadata. AVAL requires the integrating application to handle unsupported browsers and fatal playback errors and does not itself create or reveal fallback video, image, text, or other content.
procedural-film is an agent skill that turns a topic into a 30-second vertical film. It uses vanilla JavaScript to draw every pixel on a canvas and Web Audio to synthesize every sound, producing a self-contained HTML player and MP4 exports without media assets. An agent plans the film, dispatches parallel subagents to write shot scene files, and runs critic reviews across the shots. The repository includes a shot-type index, scene and music guides, planning templates, a rendering engine, and a monarch-butterfly reference film. It requires Node.js 20 or newer, ffmpeg, and Chromium for Playwright; the project is licensed under MIT.
Whiteboard Animator is a CPU-only Python package and command-line tool that converts a finished whiteboard-style image into a hand-drawn reveal video. It can write detected text word by word, trace outlines, fill shapes with brush strokes, and decompose branched line art into sequential pen paths; narration audio can pace the drawing, and multiple scenes can be concatenated into one MP4. It is the render engine behind the Whiteboard format at Kinoslide. The engine identifies connected non-white pixel components and uses a bundled CRAFT text detector to distinguish text from drawn shapes. It orders components using relationships such as containers before contents, shapes before labels, reading order for text, and attachment of small dots to glyphs. It assigns reveal times based on component area or a region plan, then follows skeletons and outlines with reveal fronts, brush strokes, or sequential paths before streaming frames to FFmpeg. Rendering requires no GPU, API key, training, or model beyond the bundled text detector; an optional Gemini-based region-detection feature requires a Gemini extra and GOOGLE_API_KEY. The package provides the `whiteboard-animate` CLI and a Python API, requires Python 3.10 or later plus FFmpeg and ffprobe, and is distributed under the MIT license. It is intended for clean marker-style drawings on white backgrounds rather than photos, gradients, or textured backgrounds.
1 in the library.