Procedural Sounds

The Web Audio API is an audio-programming API used to generate sound for procedural videos.

Procedura is an open-source agentic 3D-modeling tool from SpatiaOS that converts text prompts into editable procedural assemblies rather than point clouds or triangle meshes. It generates OpenSCAD source with named parts and typed mates, plans and builds parts incrementally, and can use reference images and optional Blender render feedback during refinement. Optional passes assign per-part PBR materials and plan articulation, exporting motion to OpenUSD and URDF with Isaac-based validation. It runs locally as a Bun/TypeScript pipeline using a configurable OpenAI-compatible, Gemini, or local model endpoint; it does not provide hosted inference or API keys. The pipeline uses a Manifold-capable OpenSCAD build to compile the generated programs and Blender for renders, and includes a web Studio for composing runs and inspecting intermediate artifacts. The repository is MIT-licensed.

procedural-film is an agent skill that turns a topic into a 30-second vertical film. It uses vanilla JavaScript to draw every pixel on a canvas and Web Audio to synthesize every sound, producing a self-contained HTML player and MP4 exports without media assets. An agent plans the film, dispatches parallel subagents to write shot scene files, and runs critic reviews across the shots. The repository includes a shot-type index, scene and music guides, planning templates, a rendering engine, and a monarch-butterfly reference film. It requires Node.js 20 or newer, ffmpeg, and Chromium for Playwright; the project is licensed under MIT.

Design Studio AI is an open-source, agent-first design workspace for humans and AI agents. It supports web interfaces, slides, reports, wireframes, 3D scenes, and timeline videos; users start from a brief or template, inspect a preview, revise through chat or a manual editor, and work together on the same versioned document. The workspace provides structured flex/grid layouts, reusable design systems, 2D character motion, editable 3D scenes, BYOK text/image/speech/music/video generation, and exports including JSON, HTML, SVG, PNG, PDF, PowerPoint, WebM, GLB/glTF, React prototype ZIPs, and authorized Google Slides. It exposes REST, authenticated MCP, experimental WebMCP, and a CLI for agent access, and can run on Cloudflare or be self-hosted with Docker and persistent SQLite/files. The repository is distributed under the MIT license.

ReScript is an open-source, transcript-based video and audio editor that runs in the browser or as a desktop application. It processes media locally on the device, transcribes audio with Whisper using word-level timestamps, and assigns speaker labels with pyannote; users edit the media by deleting words from the transcript, which creates cut ranges that the preview and timeline apply to the original recording. The editor supports imported SRT, VTT, and JSON transcripts, filler-word and silence removal, speaker-grouped transcripts, waveform and word-level timeline editing, split and trim operations, and adjustable word timings. It exports video, audio, transcripts, subtitles, and NLE timelines for DaVinci Resolve, Premiere, Final Cut Pro, Pro Tools, and Logic. The web and desktop versions use ffmpeg.wasm for on-device media extraction and export. Desktop builds are distributed for macOS, Windows, and Linux through Electron, while the browser app is available at app.getrescript.com.