← All transcripts

Let's Open Source the World — Brandon Thomas, ArtCraft Transcript, AI Summary & Key Points

AI Engineer · yesterday · Science & Technology · 19:56 · EN

Watch on YouTube

AI Summary

ArtCraft has open-sourced AI-built clones of Adobe Photoshop, InDesign, Premiere, Flash, Animate and other creative apps, plus the core Microsoft Office apps, Google Docs, Figma (including the collaboration server), CAD tools, digital audio workstations and PDF Craft. The Photoshop approximation took about 24 hours to build with large prompts, starts 10 times faster than the original, and has passed 60% parity toward a 99.99% goal. The project went viral after leaking on Reddit, drawing a New York Times interview request, over 300,000 GitHub stars, 4,000 contributors and 1.7 million downloads a day, with a quarter of users on Linux. Everything is MCP and CLI first-class, built in Rust for native performance, and deployed to Linux, NetBSD, tablets and the web via Wasm. The talk traces the closed, extractive turn of the web — removed APIs, gatekept distribution, Adobe's up-to-$200 subscription cancellation fee — and argues AI agents now make it possible to rebuild all software as open source and turn platforms back into protocols. Autocraft, a forthcoming open-source autonomous software factory, ingests and triages issues, runs agentic development, and post-trains models on all of its decisions.

Key Points

  • Open sourcing the world — AI gives developers a chance to take the web back; Linux has always been a second-class citizen and users have been pulled into platforms without ownership
  • The open web before closed platforms — the '90s and early 2000s had open protocols like IRC you could self-host and automate, websites with data exports and APIs (Reddit, Flickr, Twitter mashups), MP3 ownership, customizable MySpace pages, and creative communities around Flash and PHPBB
  • Subscriptions, gatekeepers and lost ownership — Web 2.0 replaced protocols with platforms, APIs were taken away, distribution became gatekept (no freely distributable phone ecosystem like desktop), and streaming subscriptions turned Netflix back into cable; Adobe charges up to $200 to cancel a monthly plan before the 12- or 18-month term, in the small print
  • ArtCraft and artists coding their workflows — ArtCraft started as a professionally minded Higgsfield alternative, with a desktop tool keeping files next to the editor; artists began vibe coding their own workflows on top of it, including micro-drama studios doing $30,000-$50,000 of order fulfillment a month with in-house Claude Code users
  • A Photoshop approximation in 24 hours — large prompts laid out the app shape, separated UI/UX, made everything MCP and CLI compatible, and planned every tool, data structure and file format importer; the result was functional, familiar, and started 10 times faster than the original Photoshop
  • Parity progress — not at 100% parity yet: it was at 50%, has just passed 60%, and the Pareto principle could take it to 99.99%; the interface deliberately matches Adobe's to fulfill artists' muscle memory as a proving function, with more agentic net-new interfaces planned later
  • Viral growth and artists embracing AI — after leaking on Reddit, the New York Times requested an interview and the Discord grew from 3,000 people to more than Suno's or Higgsfield's; anti-AI artists have turned around, started using the apps and filed feature requests and bug reports
  • Beyond Adobe: office, CAD and collaboration — clones cover CAD, Flash, digital audio workstations, the core Microsoft Office apps, Google Docs, and Figma including the server component with raft/paxos-style multi-user collaboration; Solid Craft, a community project led by engineers, has an open engineering kernel and does 3D printing projects quickly through MCP

AI in practice

Used for

Agents

  • Autocraft — A forthcoming open source autonomous software factory: ingest issues, triage them, do agentic development, and use all decisions as training data for evals and post-training on the decision trees. 2 held 18:09

Tools & resources

5 items

ANo. 5356
AIAINotes.us AI product

ArtCraft

Open source · storytold/artcraft

ArtCraft is a desktop IDE for interactive AI image and video creation, developed by Storytold. It lets artists compose in 2D, stage scenes in 3D, and select models for image, video, music, sound, 3D-mesh, and world generation. Its visual tools include 2D and 3D compositing, image-to-location scene planning, image-to-3D mesh conversion, character posing and identity transfer, kitbashing, background removal, canvas editing, masking, inpainting, prompted image editing, text-to-image generation, and image-to-video animation. The project supports integrations including ArtCraft's catalog, Grok, Midjourney, Sora, and World Labs, and is distributed through stable Windows and macOS releases; Linux users can build it from source.

Mentioned in
4 videos
Kind
AI
ANo. 7923
AIAINotes.us AI product

AutoCraft

In the AINotes directory

AutoCraft is an autonomous software factory that Artcraft plans to open source. It is designed to ingest and triage software issues, perform agentic development, and post-train on the decisions it makes; those decisions are also retained as evaluation and training data.

Mentioned in
2 videos
Kind
AI
DNo. 0521
AIAINotes.us Tool

Discord

discord.com

Discord is a communication platform developed by Discord, Inc. that provides voice, video, and text chat for communities, groups, and gamers. It is available as a web service and native apps for Windows, macOS, Linux, iOS, and Android and was first released in 2015.

Mentioned in
8 videos
Kind
Other
MNo. 0415
AIAINotes.us AI product

Model Context Protocol (MCP)

Open source · modelcontextprotocol/modelcontextprotocol

Model Context Protocol (MCP) is an open, standardized protocol layer for connecting large language models and AI agents with external data sources, hosted infrastructure tools, and other contextual data. It defines formats, metadata, protocol schemas, and APIs for sharing information and tools, attaching, referencing, and validating context such as documents, embeddings, and provenance, while supporting scoped authentication and permissions. MCP translates JSON requests from an agent into calls to service APIs, including CRM, container-management, and GKE capabilities, and can provide design-system context and related tools for generating consistent applications. The official project publishes its specification, documentation, and protocol schema; the schema is defined first in TypeScript and also provided as JSON Schema for broader compatibility. The protocol was created by David Soria Parra and Justin Spahr-Summers, is hosted at modelcontextprotocol.io, and is licensed under the MIT License.

Mentioned in
33 videos
Kind
AI
RNo. 0706
AIAINotes.us Tool

Rust

Open source · rust-lang/rust

Rust is a systems programming language and toolchain developed by the Rust project. Its compiler, standard library, documentation, package manager and build tool Cargo, formatter rustfmt, linter Clippy, and editor support are maintained in the main repository. The language uses a rich type system and ownership model to enforce memory and thread safety at compile time, while targeting fast, memory-efficient software for critical services, embedded devices, and integration with other languages. Rust is primarily distributed under the MIT and Apache 2.0 licenses, with portions under BSD-like licenses.

Mentioned in
16 videos
Kind
Other

Links mentioned

🔒 Full analysis locked

Unlock more videos and the full analysis

A credit unlocks one video's full analysis for good — the build steps, the tools and how each was used, the methods behind every use case. Pro opens the whole library instead, and raises how many videos you can analyse a day.

Unlock full analysis — free

Transcript

Searchable transcript of Let's Open Source the World — Brandon Thomas, ArtCraft — AI Engineer (19:56). Search for a phrase, then click its timestamp to jump straight to that moment in the video.

Captions sourced from the original video on YouTube, published by AI Engineer. The video, its captions and all related intellectual property remain the property of their respective owners; AINotes claims no ownership. Provided for research, accessibility and search — see the Transcript Notice and Copyright Policy.

00:01 [music] >> Hey everybody. Thanks for attending my talk. I had to put this together late last night. I've been in a whirlwind after this project went viral of unblocking thousands of open source developers. We've had VC's approaching us. I've been in constant meetings. Like this has been a sleepless month of activity since this happened. So if you're not familiar, I kind of cloned Adobe Photoshop and a bunch of other apps and that went super viral.

00:40 My phone, my inbox, everything has just been absolutely lit up and so I I I apologize for the structure of the the the the talk. This was thrown together as quickly as I can, but I've got a lot of really exciting stuff to talk about and I think it talks about the future of not only the industry, but just technology as a whole. So we're going to open source the entire world.

01:03 Like why not? It's it's something that I've always wanted to do as a developer. That's something that a lot of us in the open source community are interested in. Open source powers a lot of the you know, technology that we're familiar with, but it's never been at the forefront. Like Linux has always been like a second class citizen. We've been pulled into a whole bunch of platforms where we don't really have ownership and AI kind of gives us a chance to take the web back, if you will.

01:33 So I might have to do this manually. Cool. So a little bit about myself. I've been an engineer for about 15 years. I spent eight years at Square doing heavy hitting infra. So online payments, the the authentication stack, basically anything that could take down the company my team was kind of in charge of and it was you know, eight years of carrying the pager, a lot of really heavy hitting infrastructure Um and then I've spent seven years doing startups, and that's a whole different world.

02:03 It's a lot of risk, a lot of learning like what the market needs, a lot of correcting your own assumptions. And I've also been um I'm based in Atlanta. It's a big film film state. I've been very big in the arts. So out of college, made lots of films, built laser projectors that play video games on the side of skyscrapers, that kind of thing. And those are the sort of customers that our startups or the startups that I built have have catered to, creatives, artists, filmmakers, and so forth.

02:32 Um I want to transport everybody back in time, back to the very beginnings of the web and the internet, the '90s, the the the early 2000s. So for us millennials, we're going to feel old. And for um everybody that's that's younger, this is just let me kind of set the stage for what the internet was like. Um we had a bunch of chat applications that were completely open.

02:53 So IRC is like Discord, but you could spin up your own servers that you actually own. You can use whatever programs to automate them and interrogate them without rules. All of the commercial messaging apps were basically they didn't care if you used third-party tools to connect to them. Every website had data exports. They had APIs. You could literally build really cool mashups with Reddit and Flickr and Twitter.

03:18 And these were like trending on slashdot before Hacker News was a thing. And then, you know, in in the more modern times, these kind of trickle down to a much slower pace because the APIs got got removed. There was a bunch of file sharing. So not not just file sharing, you could actually buy MP3s and feel a sense of ownership in in everything that you were doing on the web.

03:41 And now it's more licensing. Um there was so much open creativity because largely the people on the internet were technical. They were early adopters. So Flash kids were making all kinds of animations. There were diffuse communities with PHP PHPBB and Envision and just just a ton of creativity that was happening at that time. Wikipedia got started sort of in this ethos, and we don't really see this kind of stuff anymore in the current era and incarnation of tech.

04:14 Websites were highly customizable, like MySpace at the time. You could actually change the HTML and CSS and make it look however you want. So this was a totally different alien time compared to what we have today. When Web 2.0 happened, broadband, smartphones, it brought everybody into the fold. So the technical people got sort of pushed to the sidelines.

04:35 And it's not a bad thing. Like we needed our, you know, our parents and our grandparents to be able to use these products. But we sort of we rounded the edges on things. We took away all the technical pieces. We made everything easy for people to adapt because they couldn't contribute from a technical footing. They didn't want to unpackaged things. They didn't know what APIs were.

04:55 And so the platforms and the the the protocol like protocols got replaced by platforms. And they sort of grabbed as many users as they could. And sort of the diffuse, experimental early web started to disappear. The APIs got taken away from us. And then we started seeing distribution being gatekept by the big providers. Like we never once had a phone ecosystem where we could freely distribute to like like we could on the desktop.

05:25 Things started to cost more and more as as startups began to like win market share. They realized that they had pricing power and suddenly your Netflix actually became cable once you started subscribing to all the streaming services. And then they started to get very extractive. For companies that maybe maybe hit the limits of their growth, they started coming up with crazy crazy gotchas.

05:47 So the one that got me is Adobe has this you can subscribe to a monthly plan and they don't tell you this. It's in like the very small print. If you cancel your monthly plan before the 12 months or 18 months, they actually charge you up to like $200 to unsubscribe, which is really inconvenient If you're going to a film festival like once a year, making a short film, and then suddenly you've got an extra $200 bill for an application that you were just using over a weekend.

06:14 And that's that's hit so many people and it's really frustrating that the web that was once really really promising and open and free has turned into this extractive owned rented rent-seeking world. So it it used to be a very special place in the '90s in the 2000s and more and more has been extracted. This is a term that's commonly used in shitification.

06:45 I think that aptly describes everything that happened. Our company started with the ethos of let's build everything open source. Like the applications that we built in the AI space were 100% open, not only the desktop apps but the actual infrastructure as well. So Artcraft originally started as sort of like a professionally minded Higuysfield. So all of the the filmmakers that I know and that I've I've I've grown up with, we were making a product for them to use rather than a UGC centered approach like like Higuysfield

07:16 or or Open Art or so forth have. And that enabled us to give them a desktop tool that lived on their machine where all the files that they were generating lived right next to their editor. And one of the things that we observed and my advisors thought I was absolutely crazy that artists, you know, they don't know what open source is. They don't they don't need it.

07:36 They don't talk about it. You know, isn't really used by artists. We actually observed artists vibe coding their own workflows on top of the software that we gave them. And that is something that like was brand new to all of us. Like there were micro drama studios that were doing order fulfillment for some of the top micro drama startups. They would do 30 to 50 grand of fulfillment every single month and they had big teams and no product out there fits their needs.

08:03 Like nobody's going to go and workshop and build that specifically for the type of delivery that they need. Yet they in house have people that know cloud code and they can take the APIs and they can generate an interface that's like that. So we started experimenting with completely open source, giving it to our customers, and they really responded to that.

08:20 And then we thought, what if we could turn back time on everything? Like all of these things that they're consuming and building would be much more friendly and and and give them way more capacity to create if all of the infrastructure was open source, if all of the application shapes that they wanted to leverage were open source. Like they use Premiere, they use Adobe.

08:44 Like what could what could we do to give them something that they could actually take away all of the surface area that they don't use and constrain the apps to their specific workflow? What would it look like if they could do that, you know, five or 10 times for each different artist on their team that's doing a particular part of that workflow? And so we wanted to kind of undo what had happened during Web 2.0 and everything became owned and and consolidated and and gate kept and just give people back their

09:13 applications. And AI really is the means for us to do that. So we took a stab at the Adobe Creative Suite. We looked at Photoshop first. We basically prompted, you know, this is the basic shape of a photo editing app. You you've consumed and trained on all of the tutorials about what Photoshop is. That's in your training data. We we laid out a large large prompt to say let's let's build out the the application.

09:42 Let's separate the UI UX from that. Let's make everything MCP and CLI compatible. Let's build out plans for every single tool, how all of those work. Let's talk about the data structures, the file format importers. We basically built these large prompts and within 24 hours we were looking at a pretty good approximation of what Photoshop was. And it it kind of blew our minds away.

10:06 It was functional. It was very familiar to us. It started 10 times than the original Photoshop. Now we didn't like actually cover the entire surface area of Photoshop. There's a lot of work. We're still not at 100% parity, but we're measuring ourselves against what has what needs to be done and we're getting closer and closer. We were at 50%. We've just passed 60% and in the fullness of time like Pareto principle, we could reach 99.99% parity.

10:32 Um I'm going to take a little bit of a sort of a diatribe. Our team has talked about whether we take this further now or whether we just go for parity. And right now we're just we want to have we want to fulfill the muscle memory of all the artists that use Adobe. So we are going for Adobe like their sort of interface and look and feel directly. In the fullness of time we will build net new apps that have new interfaces that are more agentic.

10:54 Um but we wanted to do that also as sort of like a proving function that we have actually accomplished something real completely agentically. Uh so we did Photoshop. We did um basically all of their apps. We did InDesign. We did Premiere. Um and uh this I I did not expect this to go viral. I was withholding posting it on Hacker News. It got out on Reddit and then like two days later like the like New York Times was asking me for an interview and our Discord went from 3,000 people to It's now got more people in our

11:26 Discord than Jev, Suno, Higgfield. It I I'm still struggling to bear with what has happened. This was a It struck a nerve with people. Uh they've felt sort of maligned by Adobe and other tech companies and uh what we've built has has really resonated with them and it's sort of built up sort of this mission to build more. Uh so all of the anti-AI artists who have been pushing back against AI all of this time have you know they've sort of turned around and they're like we actually love what you're doing.

11:56 They've started using these apps. They've started giving us like feature requests and bug reports and we're engaging them and I think we're going to be able to teach them this is what an MCP is. This is how you agentically create things and maybe we'll start pulling away some of these bloated interfaces and giving them things that are faster and more fluid, and let them do their work faster.

12:13 Um, so we didn't stop with those apps. We've done all kinds of stuff. We've done CAD, we've done um uh uh uh uh Flash, we've done uh a bunch of digital audio workstations. It's not just us, it's the community doing these things as well. And there's really no limit in terms of what can be done. Uh so we've done the entire Microsoft well the core apps within the Microsoft Office suite.

12:36 There's been Google Docs. We have uh companies and universities and all sorts of people approaching us wanting to use these things. And we're we're basically trying to fulfill all of these different asks. Um they're being used on Linux where they've never been used before. Um PDF Craft is probably the best app. You should all go download it right now.

12:56 You'll never have to use Acrobat again. This is like really fast, really smooth. [laughter] It works on Linux, it works on NetBSD. It's it's brilliant. Like this one's ready to go. So go ahead and get this one. Um we did Figma. We've actually done the server component for this too and you can basically have your team collaborate on on documents. It's got like the raft paxos like multi-user setup.

13:23 So we're starting to go into infrastructure too. And you know I the entire infrastructure and data model all of it is open source. We're not keeping any of it proprietary. Um there's a community that's working on Solid Craft that's led by engineers. They've actually got uh an open uh engineering kernel that manages all of this. Uh and it's it's really solid.

13:44 Like the MCP you can actually do 3D printing projects really quickly with Solid Craft. Um we've had so so much happen. We've got over 3,000 300,000 uh GitHub stars. 4,000 different people have been contributing to this project and it's picking up. It's it's it's actually become sort of a movement if you will. And we're we're trying to adapt to how much influx of of people trying to contribute to this.

14:08 I'm going to pick up the pace cuz I've been kind of lagging on this. But um uh we're We're about 1.7 million downloads a day and this is accelerating. We've got a launcher app that puts us on the desktop, and like you can you can basically manage everything here. It works on all operating systems. A quarter of our users are on Linux, which is really fascinating.

14:26 Like Linux has been historically really, really underserved, and now they have super high quality professional apps for creative and and office work, which is it's really nice. So we've you know, we we love and respect all of the work that's been done there in the past, but people are really excited to use the apps that they didn't have access to. All of these things are MCP and CLI like first class.

14:53 You can totally command these, and you can watch them build and assemble creative projects right in front of you. They've been localized into languages that were never like officially supported by Adobe or Microsoft. Like we were told that Arabic was not supported in InDesign. We've also supported these apps past their support lifecycle. Like Adobe Animate was being end of life or it was being like put on life support.

15:18 We've we've picked that up. We've had basically animation studios come to us saying, we use this for our jobs. Like this is important. Please please support this. So a lot of a lot of really fascinating things are happening where we're getting this into more places than they've ever been before. It's it's definitely not me. Like I I started this and now we've got a community of like 4,000 developers.

15:38 This is taken on a life of its own. They are doing everything from CI/CD. It's it's incredible. This this is way bigger than just me. I really got to pick up the pace here. I've made way too much content. So there are 300 apps being developed by the community. We've developed an app where non-technical people can start contributing and use the basis of the apps that we've created like the UI/UX libraries.

16:00 We're decomposing this into all of the the components and primitives so that you can reuse them. So you'll have nice 3D libraries, nice 2D libraries. It's all great. I'll get into the technical stuff. So Rust was probably essential in this product's product success. We'd seen people doing it in Electron before, but for high-quality creative apps, you really need something that's native.

16:20 Um, there's just a lot of really, really good quality things about Rust. Google had papers about like the low defect rate. It starts really fast. It's it's the best language for this. Uh, yeah. Um, it supports all all different platforms and operating systems. We've got this on NetBSD. We've got this on tablets. It natively deploys to the web via Wasm, so it can get anywhere and everywhere.

16:50 Um, do you need to know Rust to start using Rust today as an engineer? Uh, definitely not. Uh, I've been using Rust since pre-1.0 times, but everybody on the team uh it's a mix of people that have never experienced the language before. Your agents will drive it just fine. You're not going to have any trouble. It is a fantastic language. The one big thing you're going to run into is compile times.

17:08 Um, is it GUI yet? There's this famous website or series of websites in the Rust Rust world. Does it support like modern features? Yes. You can build GUI rich GUI apps in in Rust, UI UX. Uh, we've run into a lot of gotchas like permissions, GitHub, scaling, CI. A lot of people have talked about that. I'm going to just speed through this cuz I'm kind of running out of time.

17:26 Uh, CI is like falling over. [laughter] We've been spinning up our own. We found a good place to get RAM on co-located servers. We're made of that. Um, this is a good one. So like agentic develop versus human uh review. If you're doing backend work or things that require schema migrations, API design, let your humans do that, but for like desktop apps and games and anything that's basically immutable, throw your agents at it and give them like full confidence.

17:50 You don't need to be human in the loop fully. Like the upstream like directing where things go, just just let it run. Tell it to build things. Somebody in our community is is building Uh, they've got 40 machines rebuilding Unreal Engine in Rust. So you you don't even have to mind these things. Um, Autocraft is a completely autonomous software factory that we're going to open source.

18:11 It ingests issues, it triages them, it does agentic development, it post-trains any vowels on all of the decisions. This will be open source soon. Um, basically we've got an entire app factory that's designed in code. You can express this. We'll open source this soon. I'm just going to have to hurry cuz I'm overtime. Uh injustice issues. This is open source code rabbit open source all the things.

18:33 We're we're doing a lot here and I I thought I would save more time for the technical, but this is really good and please please look out for this. Um it will support all of your agentic development. It supports all of the sort of crafting and curating how you uh approach a project. It keeps your engineers on task. Um again fully open source. All of the decisions made by it are training data that we're going to use for evals and post training on the decision trees.

18:56 Um let's take back the entire internet. Let's rebuild everything. All software, all platforms. We can we can turn all of these things into proper protocols. Um we can open source the entire world. Let's own our apps, our infra, our protocols, our models, all of it. Um we are hiring. So if anybody is interested and wants to work on 100% open source, none of our code is closed source.

19:27 All of it is in the open. Um uh you get time to work on your own projects. Just reach out to me at hello at storyteller.ai and thank you so much everybody.