← All transcripts

GitHub Trending Weekly #43: Cloudflare Computer, waku-agent, querysplat, findphone, Soup, morphicons Transcript, AI Summary & Key Points

Github Awesome · 10 days ago · Science & Technology · 15:41 · EN-US

🧠 AI Summary

GitHub Trending Weekly #43 covers 35 open-source projects spanning agent architectures, document conversion, 3D reconstruction, local model inference, media creation, developer infrastructure, browser engines, virtual machines, games, and experimental hardware projects. Recurring themes include local-first storage, reproducibility, preservation of source formats, explicit technical limitations, resource-aware AI, and safety guardrails.

🔑 Key Points

  • Cloudflare Computer stores an agent's authoritative file system in a durable-object SQLite database and projects it into containers, shells, or ECMAScript workers.
  • Waku-agent uses a roughly 95-line Python loop and a retrieval gate that decides whether memory is needed, because irrelevant memories can bias answers.
  • Anydoc converts Word, PowerPoint, Excel, Open Document, RTF, EPUB, CSV, and PDF files to Markdown through a shared document model and serializer.
  • Cargo Frisk checks the contents of the package Cargo actually ships, detects secrets in packaged files, and compares the package against Git LS files.
  • Swiftlet runs 35B and 80B Qwen mixture-of-experts models on Apple devices by streaming routed experts from SSD; the maintainer reports about 2.5 GB of RAM and roughly one token per second for the 35B model on an iPhone 17.
  • RealReplicaBench contains 107 tasks for testing AI agents on long business workflows across browser work, command-line tools, files, and API or MCP operations.
  • MAGI-2-preview generates 10-second videos with synchronized sound using 114 billion parameters, six active per token, and requires eight Hopper GPUs and 307 GB of weights.
  • DeepSeek V4 Flash is described as a 304-billion-parameter model running on one AMD MI300X without extra quantization, with bugs involving FP8 format assumptions and MoE routing bounds.

✅ Actionable items

  • Use a retrieval gate to determine whether a turn actually needs memory before injecting stored memories.
  • Compare the files included in a built Cargo package with the files tracked by Git.
  • Run secret-leak detection against packaged artifacts, using entropy and path context to reduce false positives from test fixtures.
  • Preserve unchanged document XML and archive entries byte-for-byte when editing structured office files.
  • Treat Bluetooth signal strength as an approximate proximity indicator rather than a precise distance measurement.
  • Keep application secrets in the macOS keychain instead of a local dot file.
  • Keep unauthenticated dashboards restricted to a trusted home network.
  • Separate measured hardware results from estimates when evaluating local LLM deployment capacity.
  • Mark failed document pages explicitly and retry only those pages while preserving successful output.
  • Start each agent benchmark attempt in a fresh container and retain artifacts, logs, and verifier results for inspection.
  • Use process separation and a persistent PTY helper so terminal sessions survive application crashes.
  • Check hardware, memory, and model-weight requirements before attempting large-scale video generation.

🧰 Tools & AI usage

AI is used for

  • Agent file-system execution — Cloudflare Computer gives an agent a durable SQLite-backed file system projected into containers, shells, or ECMAScript workers.00:10
  • Personal assistant memory retrieval — Waku-agent demonstrates an agent harness, loop, memory, and evaluation structure while deciding whether each turn needs memory.00:36
  • 3D scene reconstruction — QuerySplat predicts 3D Gaussian splats, cameras, depth point clouds, and appearance from a handful of photos.01:02
  • Video-to-video generation — Finger Frame AI regenerates a video while preserving the subject's movement and facial alignment.02:21
  • Model-driven office editing — Gen Office embeds model-driven editing into document, spreadsheet, presentation, and PDF workspaces.02:47
  • Local LLM fine-tuning — Soup fine-tunes LLMs locally with QLoRA and includes reward-hack mitigation for GRPO runs.03:38
  • Large-model inference on Apple devices — Swiftlet runs 35B and 80B Qwen mixture-of-experts models by streaming routed experts from SSD.05:29
  • Video captioning and transcription — Captivo generates captions on-device through whisper.cpp, while Open Edit transcribes video and designs stylized subtitles.05:32
  • Document visual understanding — Doc7 renders document pages and sends them to a vision model to preserve charts, diagrams, relationships, and visible UI state in Markdown.09:22
  • Video generation — MAGI-2-preview generates 10-second videos with synchronized audio from prompts or prompts plus still images.13:24
  • AI-agent workflow evaluation — RealReplicaBench tests whether agents can complete 107 long business workflows in reproducible service replicas.12:31
  • Video-generation acceleration — ComfyUI-Spectrum-MiniMax-H3 forecasts intermediate hidden features to avoid running the transformer on every step.10:45
  • PDF retrieval — Token-Saver uses local BM25 and embedding search to send only relevant passages with page citations to Claude Desktop.11:08

🔗 Links mentioned

📄 Transcript

Searchable transcript of GitHub Trending Weekly #43: Cloudflare Computer, waku-agent, querysplat, findphone, Soup, morphicons — Github Awesome (15:41). Search for a phrase, then click its timestamp to jump straight to that moment in the video.

Captions sourced from the original video on YouTube, published by Github Awesome. The video, its captions and all related intellectual property remain the property of their respective owners; AINotes claims no ownership. Provided for research, accessibility and search — see the Transcript Notice and Copyright Policy.

00:00 Welcome back to GitHub Awesome. This is GitHub trending weekly number 43. 35 trending open source projects on GitHub right now. Let's go. Cloudflare computer gives an agent a file system whose authoritative copy lives in a durable object SQLite, then projects it into whichever execution surface you pick. A container mounts it as a real fuse file system with a full Linux userland and real binaries.

00:26 Lighter backends run a shell or ECMAScript in a dynamic worker hitting the same store over RPC with no sync round trip. Waku agent is a personal assistant you read rather than install, built to show the four parts of any real agent: harness, loop, memory, and a val. The loop is about 95 lines of plain Python with no framework hiding it. The interesting piece is a retrieval gate that first asks whether a turn needs memory at all, since irrelevant memories bias answers.

00:58 Memory is one SQLite file you can open. Query splat predicts 3D Gaussian splats from a handful of photos of one scene, and the paper's idea is separating the geometry representation from the appearance one, rather than learning both in the same tangle. The release runs feed forward or with test time optimization for a short refinement pass. It exports Gaussian ply files at your chosen opacity thresholds, plus predicted cameras and depth point clouds.

01:29 Any dot converts Word, PowerPoint, Excel, Open Document, RTF, EPUB, CSV, and PDF into markdown, written in Rust with Node and Python bindings. Every format parses into one shared document model and renders through one serializer, so a table escaping fix for docx fixes RTF and ODT at the same time. Format detection reads the bytes rather than the extension, so mislabeled files still convert.

01:54 Cargo Frisk checks what Cargo actually ships, rather than what Git tracks, and those differ. Cargo package includes untracked but yet ignored files. So, a stray .env invisible to your secret scanner still lands in the tarball on crates.io permanently. It diffs the built crate against Git LS files, then runs Git leaks derived rules over the packaged files.

02:16 An entropy gate and path context stop test fixtures failing your build. Finger Frame AI turns the two-hand framing gesture into a window onto an AI-generated version of the same video. A video-to-video model regenerates the whole clip. So, the animated version blinks and moves exactly as you did. And every prompt gets a strict alignment suffix appended.

02:38 No zoom or re-centering. Facial features at the same screen coordinates. So, it lines up behind the frame. Gen Office puts document, spreadsheet, presentation, and PDF editors into one desktop suite with model-driven editing built into each workspace. Its most interesting detail is file preservation. .docx saves regenerate only changed paragraphs, while untouched XML and archive entries remain byte-for-byte intact.

03:04 Sheets uses a Rust import and export sidecar, and Slides has its own PPTX renderer. Find Phone locates a nearby Bluetooth device from the macOS command line for when Find My is switched off. Run it with a name, and it tracks signal strength with an optional click that speeds up as you close in. So, you sweep a room by ear. The author is careful about what the number means, saying plainly that a phone in a filing cabinet 2 m away reads like 1 15 m off.

03:38 Soup fine-tunes LLMs from one YAML file and one command, handling batch size, GPU detection, and quantization for you, running locally on your own card with QLoRA. The interesting new piece is reward hack mitigation for GRPO runs. When multiple signals agree, the model is gaming the reward. It raises the KL coefficient, then rolls back to the last good checkpoint if that fails.

04:02 Morphicons morphs any stroke icon into any other, and the trick is that rotations are never declared by hand. It solves the optimal similarity between the two shapes in closed form, then interpolates rotation, scale, and residual, each in its own space. So, arrow right to arrow down comes out as a clean 90° turn because the math found it. Corners are anchored as exact sample points, so a check mark doesn't round off in transit.

04:31 Backchannel is a user script that puts the hacker news and Reddit threads about whatever you're reading in a sidebar on the article itself. Quotes in the comments get matched back into the page and highlighted where they sit, so clicking a highlight filters the thread to people arguing about that exact passage. You can vote and reply through your existing HN session.

04:53 Reddit is read-only and off by default, since enabling it sends your browsing to Reddit. VPhone Workstation is a native macOS app for running virtual iPhones, wrapping locker 233's VPhone client in a real library window. Every VM with its live state, iOS and Cloud OS build, CPU, memory, and UDID at a glance, plus clone, rename, and export. The create wizard streams progress step-by-step and hands you an exportable log.

05:19 It checks host readiness first, since these research VMs need SIP research guests allowed and AMFI bypassed. Swiftlet runs 35B and 80B Qwen mixture-of-experts models on Apple devices by keeping the dense core in memory and streaming routed experts from SSD. QPack files turn each expert fetch into one read, while caching in metal kernels handle inference.

05:43 The maintainer reports the 35B model using about 2.5 GB of RAM on an iPhone 17 at roughly one token per second. Captivo is a screen recorder for demo videos, the kind where the camera follows your cursor and clicks trigger zooms. Open a fresh recording and it suggests zoom fragments from where you actually clicked. Capture runs native per platform, screen capture kit, Windows graphics capture, and pipewire into hardware H.264 with a crash-safe fragmented MP4.

06:18 Captions run on device through whisper.cpp. Shitty is a terminal emulator that keeps all its state on the CPU and hands rendering to a single Vulcan compute shader, drawing only the cells that actually changed. It's a hard fork and rewrite of zedity. Coverage is deep for the parts people hit daily, kitty keyboard protocol, five mouse protocols, scroll back that reflows on resize, OSC8 hyperlinks, no sixel, and no bidirectional text, which the readme states plainly.

06:49 Bind with sizes an on-prem LLM deployment by finding the constraint that actually stops it, rather than guessing from model size alone. It calculates memory for the KV cache, shared prefill, and decode capacity, and the runtime session ceiling, then identifies which limit binds. Hardware profiles distinguish measured results from estimates, and scenarios export as markdown or JSON.

07:14 Open edit burns stylized subtitles into a video from your coding agent. Point Claude code or code x at a file, and it transcribes, designs captions to match the clip, renders through FFmpeg, and opens a preview, then takes plain language corrections like moving the text up or emphasizing one word. Transcription uploads your video to Veed and spends credits from a free account you have to create.

07:40 .hali backs up the DeviantArt art you follow to a local folder, and the whole tool is Python standard library with zero runtime dependencies. A SQLite index means a rerun costs one API call when nothing new is posted, so a daily launch job is nearly free. Secrets go to the macOS keychain rather than a dot file, and a diagnose command tells you when a scheduled run has been quietly failing.

08:06 Virtual Mac on iPad runs macOS in a hardware virtualized VM on an M1 iPad, and the hard part was the frameworks. Apple's hypervisor and virtualization libraries live only inside macOS's dylb shared cache, and pulling them out is lossy. A script walks the cache's slide information, separates rebases from cross-image binds, relays out the segments, and emits new chained fix-ups with pointer authentication intact.

08:33 Jungle Trail is a first-person walk through a procedural jungle in 3js with no art files at all. Every texture is a GLSL function rendered into a target, and normal maps come from Sobel sampling that same function, so the normal can never disagree with the albedo. The canopy is left out of the shadow map entirely, and replaced with an analytic transmittance term.

08:57 Desko turns an old phone into a desk dashboard, pushed from your PC over websocket to one browser tab, no app, and no cloud. Five scenes rotate: clock and weather, now playing with time-synced lyrics, you can tap to seek, live CPU and GPU stats, Git and editor state, and a Pomodoro timer that lives server-side, so reloads don't reset it. There's no authentication, so keep it on your home network.

09:22 Doc 7 converts documents to markdown by rendering each page and handing it to your own vision model, rather than extracting a text layer. That means charts arrive as labels, values and trends, diagrams keep their ordering and relationships, and a screenshot's visible UI state survives. A failed page is marked failed rather than written as truncated markdown.

09:46 And resume retries just those pages while leaving the good ones byte identical. King's Gambit is a 3D chess game where the pieces are rigged characters with idle, attack, and death animations. And captures play as a cinematic. The camera punches in, the strike lands on the hit frame, and the loser burns away from the souls upward through a shader dissolve.

10:06 The rules core never imports 3.js, so logic stays testable headlessly. Search runs in a web worker, so the render loop never blocks. Outreacher is a fundraising CRM that keeps everything in a SQLite vault you own with secrets in the OS keychain rather than the database. The interesting part is where the guardrails live. Duplicate sends, daily and hourly caps, per domain cool-downs, and suppression lists are enforced by database triggers before anything reaches Gmail or Outlook.

10:40 Security-relevant activity is append-only and hash-chained. This node speeds up Minimax H3 video generation in ComfyUI by not running the transformer on every step. It fits a Chebyshev ridge model to the hidden features after the final block, forecasts them for intermediate steps, and runs the real output heads regardless. Ancestral samplers stay native because injected noise breaks the smooth trajectory it fits.

11:08 Token saver is a Claude desktop extension that keeps big PDFs out of the context window entirely. Local hybrid search, BM25 blended with a local embedding model, finds the passages that answer your question and sends only those with page citations. Below about 20 pages, it's not worth it, and the authors say so. They also publicly walked back their own earlier recall numbers after their retrieval changes made them stop reproducing.

11:37 Falco is a browser engine in about 36,000 lines of rust with nothing borrowed from Chromium or Gecko, down to a handwritten PNG encoder and its own JavaScript VM with a bytecode interpreter and a jit. Point it at a URL and it writes a real PNG or opens a window you can scroll and fill forms in. The readme is the best part, a section separating what actually runs from what merely compiles.

12:04 Stickman video director is a Codex skill that does the directing before you spend generation credits. Paste your copy, pick an aspect ratio and a light or dark theme and it returns a 16 proposal with narration, camera moves, transitions and sound. Approve it and you get six standalone prompts, each repeating the character, line weight and palette locks so separately generated clips still stitch into 1 minute.

12:31 Real replica bench tests whether AI agents can finish long business workflows inside reproducible replicas of online services. It's 107 tasks span browser work, command line tools, files and API or MCP operations including product publishing and freight booking. Each attempt starts in a fresh container, changes state in local mock services and leaves artifacts, logs and verifier results for inspection.

12:58 Deary runs several coding agents side by side on Mac OS, each in its own git work tree or on a remote host. The design choice worth stealing is process separation. A headless Swift Damon owns the PTYs and outlives the app with a separate tiny helper holding the PTY master so sessions survive a Damon crash. Closing the window kills nothing. Adding a new agent is a JSON manifest rather than code.

13:24 Mag Ii preview generates 10-second video with its own soundtrack from a prompt or a prompt plus a still. It's 114 billion parameters that activate six per token and it runs in two passes. One denoising at low resolution and a refiner taking that to 1080p. Audio is generated alongside the picture and muxed in. The requirement is eight Hopper GPUs and 307 GB of weights.

13:46 So, this is cluster work. Can I Vibe Code It? helps you judge whether a paid SaaS subscription can be replaced by a personal app built with a coding agent. Each listing gives a yes, kind of, or not really verdict. An exact build prompt and the tradeoffs you inherit by leaving. Contributions are plain JSON files submitted through pull requests. Network effects, proprietary data, and expensive infrastructure still count as genuine motes.

14:19 Creek Work 12 reads your laptop's lid angle sensor and turns the hinge into a creaky wooden door. Pitch follows the angle, volume follows how fast you move it, so slamming the lid sounds different from easing it shut. It's a Rust port of lid angle sensor to the Framework 12 and the filtering is tuned to that specific hinge stiffness. So, other laptops are untested.

14:41 The stated reason for building it is that it's funny. Chapter TGZ is a tar.gz that lets you jump straight to a group of entries without decompressing everything before it and read different chapters on different threads at once. The trick is where the boundary markers live. They're encoded as valid but empty gzip blocks with unusual Huffman alphabets.

15:04 So, every existing tool still reads the file as an ordinary archive and ignores them completely. This repo runs DeepSeek V4 Flash, 304 billion parameters, on one AMD MI300X with no extra quantization and it's really a bug hunt right up. The card uses AMD's own FP8 variant rather than the standard one. So, a kernel assuming the wrong format is off by a factor of two. A MOE routing kernel masked its padding lanes against the wrong bound, quietly corrupting tool names under load. >> [music]