Searchable transcript of I love you so jevving much — Diogo Almeida, TypeSafe AI — AI Engineer (23:20). Search for a phrase, then click its timestamp to jump straight to that moment in the video.
Captions sourced from the original video on YouTube, published by AI Engineer. The video, its captions and all related intellectual property remain the property of their respective owners; AINotes claims no ownership. Provided for research, accessibility and search — see the Transcript Notice and Copyright Policy.
00:01 [music] >> I'm Diego Almeida, and this talk is I Love You So Jev Much. Um, Glass Animals reference. We're not just weird. Um, like I said, I'm Diego Almeida. I'm known as the Jev guy, sometimes Jev pink man. Um, also co-created ChatGPT, RLHF, and InstructGPT, but I assume that for the crowd today, y'all know who I am, at least mostly. [snorts] Um, I have like a bunch of AI-specific stuff I want to get to, but I like going into my favorite topics in AI.
00:42 First one is what the [ __ ] is actually going on and where is all the automation? If you've heard me say this before, I'm sorry, but it's such an important thing to beat into the field cuz people still do not get it, and I need to yell this until everyone really understands what the [ __ ] is going on. And if you're in AI, you should have a really good answer about why AI can do so many awesome things and yet still be so useless for a bunch of other ones.
01:10 My relationship to ChatGPT is somewhat unique, one of the few people who hates on ChatGPT, who made it. I don't hate ChatGPT, to be clear. I love using agents. I love using coding agents. I love chatbots. They're just quite limited. And in particular, I think it's a little tragic how much they've bifurcated the field into overpromise, underdeliver. Really, really terrible stuff for the world in my opinion.
01:34 And I like to talk about like the two cults in AI and how we can resolve the cognitive dissonance that everyone I think should be having unless they have a very good answer. There's cult one, which is you know, the cult of like EAs. They look at all the benchmarks and they say like not only are LMs surpassing human level on basically every benchmark, they have been for two years.
01:55 We've been announcing AGI three months away for two years now. Even since like the '03 days. Do people remember that? No one even care-cares about that model anymore and it it was that that was like peak internal to OpenAI AGI hype. And on the other hand, you look at the non-benchmarks and you look at the reality and you see the rest of the world, especially if you guys go outside and leave San Francisco, a lot of the world is like really unchanged despite AI being so [ __ ] cool.
02:20 And I think AI is transformative. It's it's a rare point of view to actually think AI is cool and transformative and also like underwhelming the world right now. And the tricky part is this is the same field and we are all seeing the same facts. So what gives? You know, why is AI jagged, so to speak? Like why can it be so good at some things and so not good at other things?
02:43 And what is the Occam's razor explanation for that? Um I will be blasting through my slides fast. I'm sorry. Maybe I could slow down for people taking pictures. Um but uh I I'm noticing that uh this is going to go fast is all I'm saying. So I think that we as a field should have an Occam's razor explanation for why are there some things that are just not just good, they are unbelievably good, superhuman, like millennium prize problems in math.
03:10 But on the other hand, they're not just bad, they're so useless, they can't even be used to touch accounting. That sounds way easier than million prize problems in math, right? I could do the latter. I definitely could not do the former and I was a math athlete. So what gives here? What is the reason for this? And I normally love this as an interactive thing, but I will instead just tell you my answer.
03:29 Sorry for the power dynamic. Um everything on the left side is intrinsically a human in the loop task. Like deep research, I could not do better than deep research. The models are so [ __ ] good at that. But if gun to my head or gun to your head, you had to pick between me and deep research and the answer had to be correct, not well written, you'd probably pick me every time.
03:49 And that's the distinction between like optimizing for automation, which tends to be a lot easier and a lot simpler, yet AI keeps failing at this. Every year there's like an infamous failure of AI failing to even automate drive-throughs. And that should be kind of shocking to people. And my claim is actually for these tasks pleasing a human is nothing to do with doing the task.
04:11 What you want to do is basically be an abstraction away. You want the decision to be made and then you want to get back into doing automation and code is the language of automation. Therefore you need to integrate with code. This is a lot but I will summarize it again. I get the irony that uh you know I co-created RLHF and I do believe RLHF is part of the problem and RLHF in particular is why all AI today does require a human in the loop with an asterisk unless the task is like very trivially verifiable and can run on
04:42 its own but still requires a human in the loop to verify it afterwards. It is because we literally put it in. That is what the HF is in RLHF and my claim is that there's a better way. You know my summary of the state is 100% of LMs today are optimized for assistance. You might talk about RLVR but the RLVR models are very bad to interact with if they've not been RLHFed.
05:03 The result is LMs become too good to be true at assistance. They are just so [ __ ] good like you should never pick me over ChatGPT for your ChatGPT queries. But for actually doing like you know run in the background cognitive work you should not trust LMs at all because they've not been optimized for that which is why they're so bad at the tasks of automation and I would also guess that automation is a lot more valuable than assistance because you can do way cooler deeper I'm going to get into this later but I think
05:29 there's going to be so much stuff that we can do and we are just scratching the surface of that right now and that's the tragic thing about AI uh the state of AI for me. Let's talk about the Jevolution. Um I I can't tell if this is appropriate but it's too late. Um oh god don't take pictures of this one. Um cool. Oh I'm getting a thumbs up. Yeah excellent.
05:53 So we're we instead of doing RLHF we just have to do something else. We need to think from first principles. How do we optimize for machine native AI? You guys hopefully know the interface of Jev and that is what we are doing. More important than optimizing for its interface, we are uh rethinking how AI should be done because this is what we did again for RLHF.
06:13 For Sutton's bitter lesson, I'm going to loosely paraphrase to make my point easier to say, is that scaling um and compute matters more than algorithms. This is why people become like scaling pill geronimous and I would argue that there's an even bitterer lesson than that, which is data always matters more than compute. We are learning that quite a bit in the field now, but it has been obvious since the beginning of time.
06:35 I'll tell you when the this is the one you should be photographing. I would argue that the the bitterest lesson is doing the right task. And doing the right task is like a weird thing to think about, especially for ML people, cuz they like algorithms. They want number goes down or up or whichever is good direction. They don't want to think about the real world.
06:52 But this is always how you make gigantic gains in performance. This is how the big breakthroughs happen. 100% of the time it comes from this. And this is true for classical RL games. This is why Sutton had his bitter lesson, it which is data is derived by compute when you're doing rollouts. Like there's there's why would you need off policy data when playing chess or something like that?
07:13 And doing the right task is defined by the rules. So actually when you're doing RL, you don't even need to think about the right task. For pre-training, we actually as a field had to do a lot of thinking about the right task. I don't know if people remember the Bert days with um masked language modeling, but it took a while and it was very unclear to figure out that next pro token prediction was super [ __ ] cool, not because it was better at masked language modeling.
07:37 You know, the objectives on their own aren't special. It's about what you can do with them afterwards. And it turns out next token prediction is incredible at generating strings, which is what these pre-trained models were so good at. So no level of masked language modeling, even if you had today's compute and algorithms, would make it as interesting as GPT-3 was because it was just doing a different task.
07:56 And data, you know, the internet is obviously a giant bottleneck. Now we're like, you know, burning books or whatever in order to get more data, but data obviously matters a lot more than compute and people keep like rediscovering this and figuring this out. It's extra true for making LLMs useful. Um, before RLHF even existed, the data for RLHF didn't exist and you could uh like it was night and day.
08:18 I'll just show you the next slide. This is the probably the relevant part. This is what this was the work in the RLHF paper. And the high level was that even with the dumbest algorithms in the world, even with a GPT-2 sized model, you got something like GPT-9 level performance, like real GPT-9, not today's like fake GPT numbers. Like the numbers used to mean like a 100x scaling in effective compute for pre-training and they've given up on that because it just can't scale anymore.
08:43 And still even with that it would take something like GPT-7 to 9 to match GPT-2, the model from like 2018 or whatever it was, at the task of instruction following. That is kind of wild because you think big LLMs are so important for this and they are, but that is not the most important thing compared to even the gigantic jump of doing the right task.
09:04 And spoilers, this is what we did for Jev, right? Like we made this gigantic leap in the field that no one could realized could be coming because we were optimizing for a task and very few people think about the right task. Um, this is why Jev has the je ne sais quoi. Um, that's a really smart pun I think. Um, that that little bit of a pity laugh, but thank you.
09:27 Um, you get what you optimize for. I'm looking for a better word than reliable, so if you guys have suggestions let me know. But there's if there's this reliability of intelligence that's really missing in LLMs. I often call it you get Einstein 95% of the time, but Mr. Bean 5% of the time. And if you can't tell which is which, how the [ __ ] are you going to automate anything?
09:47 And instead instead of like focusing on like sometimes occasional smarts that you can then verify, what if you focused on extreme extreme narrow focused reliability so you can get that smarts every time? And this doesn't show up on benchmarks. It is the reason why people love Jev. And this is also I realize in hindsight we obviously didn't prepare for a chat GPT moment for developers, but it happened because people in the AI space just overpromise, underdeliver so [ __ ] much that having a model that actually didn't do
10:14 that was a surprise. And it is not the speed, cost, or even interface. This is something that, you know, my team tells me I shouldn't be telling people so that we can have a long-term advantage, and I just care too much. Like it's a reliable intelligence. Make sick models, please, even if we, you know, if it doesn't involve our models. Um we see that Jev is like a foundation for smart software.
10:36 I'm going to skip all over this, but I think software is going to be so [ __ ] back. I think the narrative of SaaS apocalypse is obviously not going to happen, but I think that even calling it a SaaS apocalpyse is like an understatement, and I'll get into that a bit, and you guys ideally are the perfect crowd for this. I'm I'm so excited for this part because that's the part that's new to me.
10:53 Um I want to make a distinction between smart software and just-in-time software. The the crazy part is AI is so transformative, and yet somehow despite AI being so awesome, software has essentially unchanged in the last decade except being cheaper to write. Isn't that what weird? Isn't the it weird that the best we can do in software is having a chatbot to the side that sometimes interacts with the software but cannot take expensive decisions for you?
11:20 That is kind of like a weird thing if AI was really that transformative, and I think the problem is we're focusing too much on coding agents and not enough about putting the intelligence into the inner loop, which I'm going to get more into a bit. And people are jeving. There's been tons of successes. We don't need to flex this. There's so many cool things, but my AI E secret is going to be that the field isn't jeving hard enough.
11:43 And this is what Swix said that I can make a call to action for you guys that's unique, and hopefully I have enough time for this. I think the world still has LLM Stockholm syndrome. We are still thinking from a really LLM-filled place, which is I think tragic, you know? Like I I I love the software saying the tools you use change the way you think, and I think that it's changed the way we think way too much, and we're not really rethinking software like I think the field needs.
12:08 I think that we could just just doing so much more. Hopefully I can try to do my best for my remaining time to convince you guys of that. Um, so let's jump to the future. Um, I an analogy I love, bear with me, is about LEDs. Before there was a blue LED, there was red and green LEDs. These were really limited in capability, and they were used for like simple indicators and you know like clocks and stuff like that.
12:34 And when the blue LED was made discovered, I actually don't really know how things outside of computer science work. Um, but when it existed, I guess, um, it enabled not just like 50% more use cases, which what you'd expect about like changing colors from two to three, it enabled so many more. Like now LEDs could be used for white light. It could be used for like the displays that we all use right now, and it created a revolution in lighting.
12:56 And it's it's it's unfathomable how much bigger the capabilities of LEDs were just you know adding a new primitive that composes together with the old primitives. You can see where I'm going here maybe. And I think it's a similar story for software. Software is so [ __ ] incredible. Ignore AI for the last you know half decade, but software's done so many insanely cool things.
13:20 We've done a lot of stuff you know like do I love using SAS? Not really, but does it solve problems? Abso [ __ ] lutely. And it's incredible how much we've done with three [clears throat] fundamental logic gates. You know like we are doing this with like simple binary operations that can do things like greater than, less than, equal. It's kind of nuts how much software has been built from such simple primitives.
13:43 And my claim is that what we are doing with AI now and we're making it our intelligence machine native, this is kind of conceptually adding a fourth semantic logic gate. What if we can program with common sense, with intention, with human understanding? Like do we still need regexes with like crazy things or can we just say like we want a Gmail email address or a real looking one?
14:04 There's so much that we can do that we are going to need to push the you know push the frontiers of cheap, smart, fast in order to get done. But I think there's going to be like so many things here, And I think just like the blue LED, it's going to be way bigger than just increasing the representational ability of software by 33 % cuz it's adding effectively another kind of sort of logic gate.
14:25 And this sci-fi is the stuff that I think will be impossible to predict. Just like who could predict how powerful the internet would have been because it requires it's like much more grassroots and decentralized and it requires people to be empowered to do insane stuff. Um I call this software research. Um that's not a joke. Um but uh I I think that there's going to be like an explosion of what software can do and we will want people to be exploring those boundaries of software, not necessarily because it's valuable,
14:56 but because they can, because we have like new frontiers to explore. And this is what the early internet was like. Should all of those websites existed? Probably not, but like it was very cool and we found a lot of awesome stuff from that and I think we we you know we have another opportunity for that. So we should not just keep living in this little you know fish tank that we are the victims of open AI and Anthropic on whatever they ship and we just have to be like LLM rappers.
15:20 So I'm going to pitch software research as a direction here. The theme is going to be real software engineering, not just vibe coding. There's it's going to be like the kind of stuff that everyone has known if you've been a software engineer. Decomposition, breaking tasks down. We need to think about stages, ideally ones that can be verified so we have real encapsulation.
15:39 And we all need to actually do state management instead of assuming everything is global state within a KV cache. And the theme is just going to be like real [ __ ] engineering by people who care a lot about the end result. It doesn't have to be valuable. Ideally it's sick as [ __ ] Um and you know we should be pushing the limits. I'm going to go into a couple of like my favorite ideas and I want to figure out how to encourage these in the world.
16:02 So this is my first step at this. I'm just going to talk about it. We have raised a bunch of money so I would like to figure out how to fund this, but we don't have the operations help to do that. But here are just some ideas out there. Um I think agents are they're cool, but like they're they're so inflexible in their design because of the tyranny of the KV cache.
16:24 I don't have the time for this if this timer is to be believed, but believe me that there's so much that people have tried to do but failed at because it ends up becoming inefficient because it fights against the KV cache. But I think there's a lot more to do. Why is memory O of N, right? Like why can't we have all of our history of coding agents always included in every new call?
16:41 That is how continual learning works, right? And we have the memory available. It's just that we don't have the smarts to map reduce over the memory to find out like what you should what you should remember, what should you shouldn't. Um I think there's many ways to do login or even better lookups. Why when you're making many agents at once, why can't they not share state?
17:01 Why do they need to rediscover the same patterns of the codebase over and over and over again? And why can't non-naive routing in sub agents work? Like even naive routing doesn't work. But like why can't we do these things? And why just like the you know the the big labs keep going back and forth on whether or not sub agents work? Um I think that like from an engineering perspective, there's elegance to it, but they fight against the KV cache.
17:22 And I think that if we design agents around that, we could do so much more. This one's the probably the most vague of my directions, but I feel very strongly about it. Um the world is full of principal agent problems. This is when you have like you know ulterior motives between this is not a coding agent, but like any agent. The the classic example is citizens versus elected officials.
17:42 And I don't want to make a too political claim here, but like there's misalignment in all levels of society. And this results in like waste, fraud, bad things, and it it results in for a society that wants fairness, you need to over emphasize the letter over the spirit, which then results in loopholes and pay pay to win dynamics in the world. And I think the root of that problem is we can't encode the spirit.
18:06 Just like with software, we're constrained to encoding bits instead of what we actually meant in that situation. And I think so many organizations, society could be transformed by really encoding the spirit all over the place. Obviously real-time intelligence security, can we prevent the OpenAI hugging face sandbox, blah blah blah? Um, why did why couldn't they prevent it?
18:27 It is not because they didn't have the intelligence. I would argue it's a lot easier to figure out they're doing a naughty thing than to actually do the naughty thing. It is because it was not fast, cheap, and reliable enough to actually run real-time. And what happens when every corporation has their own real-time security that's actually smart? How cool would that [ __ ] be?
18:48 I can't talk about generative UIs because people are going to be talking about it afterwards. I don't want to steal their thunder, but it's cool as [ __ ] trust me. Um, like semantic dependent typing. Why can't the we have like a type system that actually is semantic, right? Like why can't we like declare what local properties we want so we don't have to read a chain of dependencies deep down?
19:11 These all should be possible. And imagine if you could like run a JEP-like model in your lint checker to check if your it's all type-safe and it could you know uphold semantic properties. It would be so [ __ ] cool. There's there was a great Twitter video on um like a voice interface. In general, I think new interfaces are so exciting. This is to me the return of like this is going to show by agent software like do what I mean.
19:34 This used to be like a popular thing, but it never really worked because you it was it was too many hard-coded rules to really figure out what I mean. Um, the stopping slop obviously a big theme of here, but like we definitely believe this. This is my props I have to We have a stop Gen AI baseball bat for type-safe. It is very very awesome. I want to talk about the root of slop.
19:56 Um, the the root of slop is that AI is unreliable. Therefore, you as a company or you as you know like someone who's doing stuff, it can't be used for decisions that costs you stuff. But it's actually totally fine to push the costs into other people, which is horrible, you know externalized costs. And then this is what ends up becoming slop. You know if people actually read this stuff and filter it and like care about the quality, it becomes not slop.
20:18 But now the world is full of this because there's an asymmetric advantage for people who are like bad actors and don't give a [ __ ] So, I think that we can save the world from at least inbound hell among many other things and that would be very cool. Um, and even something I think is super sick is cursed software. Like why? If you guys ever seen the subreddit bad UI battles, it is so [ __ ] cool even though they make the horrible interfaces like this whole game of like would you like to delete your account becomes,
20:46 you know, a a random thing. And I actually think doing things because we can is what software engineering is about cuz who knows maybe 1% of these ideas actually lead to something super awesome. And I think like really cultivating even bad ideas is kind of what being like this, you know, playful hacker is all about. And generally just automating everything, this is what the follow-up this is this is a flop image but uh so our logo's a little bit wrong but don't stare at that that's a little weird.
21:15 Um, this is what a lot of the follow-up talks are going to be about. Thank you. Um, and and if you're a software engineer, you almost certainly think in the world of bits. If you know anything about software uh and you've interacted with software, you know that there are things software can do and software cannot do because that is just only obvious, right?
21:37 Like there's some things that you know you need to do because that is not compatible with software. But what if those constraints were no longer true? Maybe not today but maybe in like 6 months or a year, what couldn't we automate? And that's kind of where I want to leave this whole thing because I think there is very likely to be a future where it's not a question of whether or not we can automate something, it's going to be a question of like how much work is it which is how it is right now for the stuff that can be
22:02 automated and that would be cool as [ __ ] So, hell yeah. Thank you. Um, I'm super overtime but thank you to the early believers. You know, we had no idea so many people would resonate with this. We thought we were the insane ones but it turns out like we were actually the majority of the world who realized AI could be so much more. Thank you to like the people who are like realistic about reliability.
22:25 Everyone knows I hate benchmarks and a lot of other people are really screaming out like benchmarks [ __ ] suck. They're actually they hurt the people who do not have time for anything other than benchmarks most. It's tragic. And for the people who are pushing the limits of software, like [ __ ] yes. And we want to be there with you helping you all do that.
22:42 The the dreamers and the people who don't want to be limited by everything that has happened so far, we want to really fight for you and we want this to be as reliable as a fourth logic gate. And that is a very high bar and we have like a lot of work to do. So thank you, thank you.