← All transcripts

Decagon’s Playbook for Building Enterprise AI Applications Transcript, AI Summary & Key Points

a16z · 23 hours ago · Science & Technology · 01:20:16 · EN

📄 Transcript

Searchable transcript of Decagon’s Playbook for Building Enterprise AI Applications — a16z (01:20:16). Search for a phrase, then click its timestamp to jump straight to that moment in the video.

Captions sourced from the original video on YouTube, published by a16z. The video, its captions and all related intellectual property remain the property of their respective owners; AINotes claims no ownership. Provided for research, accessibility and search — see the Transcript Notice and Copyright Policy.

00:00 An AI agent should just be the front door of your business. And every interaction, whether it's like reactive or proactive with a customer, should be handled by AI. >> This narrative dominated the first half of 2026, which is that anthropic open AAI. They're the last startups. They're going to take over everything. >> Even once you have AGI, agents are going to need somewhere to store work and pull information from and reason about things.

00:22 I don't think software as a whole in any meaningful way is going away. Unfortunately, the Frontier Labs, they do have small models, but you can't really control them in the way that you want. So, today 90% of our workflow is on open source >> on the specific task we want them to do. They actually outperform the large smart state-of-the-art model. >> The thing that we built was not an agent that does customer support well, but rather an agent that follows business process.

00:48 Well, >> instead of us having to write these AOPs, do just does all of that. Let's say like we hit AGI and the models can do all sorts of things we can't even imagine today. What's Decagon's emote and like why does Decagon like 10 years from now still have a right to exist? >> Hey guys, welcome back to the studio. >> Thanks for having us. >> Yeah, good to see you.

01:11 >> Thank you for being here. Before we get into customer support, um I actually wanted to widen out a bit. Um, and uh, Jesse, I'm going to actually um, mention a piece that you wrote recently that went pretty viral because it's right in the middle of the zeitgeist of conversation right now on open source versus closed source models. then thinking machines um Kimk 3 you know some of some very interesting open source models came out sort of right after um and there's this really interesting debate going on around what

01:42 does it mean to own your destiny when it comes to AI especially in the enterprise um and what does that evolution look like by use case um so actually since that's a pretty live topic right now why don't we start there >> sounds good um so I'm gonna talk about our journey first uh just to make it very concrete for people so when we started the any uh the goal was just to get something working, right?

02:02 So if when you get something when you're the goal is to get something working, of course you're just going to use the frontier models because you want to get something out there and have actually deliver value. And so we were using opening anthropic at that time they were kind of like one uping each other in terms of how the how the models performed.

02:16 And then at some point as we got to larger scale and we started working with larger and larger companies and they had you know millions of customers and then we we also have uh we also launched our voice agent right so a big factor became latency so it wasn't just like can you deliver good responses you have to deliver them really fast and uh the only way to get latency down um but also kind of you make our agent operate the way we want it to is to use smaller models and when you want to go to smaller models

02:47 unfortunately the the Frontier labs, they do have small models, but you you can't really control them in the way the way that you want and most small models out of the box are not going to be good enough at the task that we want them to do. So, you have to fine-tune them, you have to change them. And so, that's when we started looking at open source.

03:01 So, this was about year plus ago. And um it worked really well because if you think about it in the agent, right? So, in our agent, our agent's job is to have conversations. So, it needs to do a lot of things at once, right? And like one one the first step it might do is like hm what topic is this person talking about or and something else it might do is oh is this person a bad actor that's coming in and trying to mess things up.

03:26 There's all these like tasks it has to do. Each individual task doesn't need all of the intelligence of a big model. So you know all the frontier models are obviously very smart but they can do a bunch of different things. Like they can do math they can do coding. Like you just need them to be good at that one task. And so that's why you can use a smaller model and if you fine-tune it to be really good at that task and can be just as good or better than the big models, right?

03:48 So that was that was step one for us. You know, about a year ago, we were like, okay, let's start using these open source models. Uh we we we took the small ones and then um you know, that's why we have now a uh a research team and it's a very expensive team, but it's we we have it because, you know, we need people that are really good at taking these open source models and and tuning them and and so on.

04:06 So today 90% of our workflow is on open source and um you know again the main reason was for latency to really optimize our voice agents and um I think we've just over the last year we've seen tremendous improvement in like how how it sounds how it feels and but still also like keeping the accuracy high um and then the remaining 10% of course we're still using the uh the closed source models and the frontier models for a lot of you know new new projects or new products and uh I think that's just where the industry is

04:35 moving to. So if you kind of were to generalize this every model you can kind of evaluate along three dimensions. It's you know cost intelligence and latency and depending on what you need you want to kind of be at the limit of those three and sometimes you can trade off right so in our case we knew that we actually pull back on intelligence because we all had to do was that one task but now we get these latency advantages.

04:58 I want to push a tiny bit on that point actually because um often times you know when you see these debates being had on Twitter the the trade-off tends to be oh do we want uh you know the smartest model that is very expensive or can we like dumb it down a little bit and get it cheaper. I actually think that is a false trade-off, >> right? Because what we've seen in practice is even if you have a quote dumber model, you can get it, and we've seen this in practice, you can get it to higher performance on that specific

05:31 task. So when we fine-tune smaller, dumber models, it's that they're just not as general purpose, but on the specific task we want them to do, they actually outperform the large, smart, state-of-the-art models, >> right? So we end up getting all three things. It is better at the toss. It is cheaper and it is faster. >> And so do you feel like today like you need the most Frontier models for really anything at Decagon because your performance is very good already.

05:57 So >> we we do and we often need them we often end up needing them for auxiliary tasks, right? Where when you have uh when you sort of have auxiliary models to our sort of primary conversational flow, right? you have an agent and it's helping a customer with their rebooking or it's helping them with a process in healthcare then these are like well-defined pots.

06:21 So we have smart bos models to do that but we've for instance recently launched do autopilot right which is our agent that improves the core conversational agent. Now, for something like autopilot, it is doing a very complicated job, right? It's saying, I'm going to go and review a million conversations that just happened. I'm going to try and find trends.

06:41 I'm going to create variants of the primary model and see which of those variants does better. So, now this is a much more broad open-ended exploratory task. So, we think for jobs like that, frontier models that are very smart, that can try out a lot of things make a lot of sense. H do you think that um I mean you guys obviously and you referenced it um Jesse that you have a research team right you guys launched Decagon Labs but even before the formal launch it's always been a part of your culture um do you think that

07:09 enterprises will get there as well on post training open source models oh okay interesting what's the timeline >> yeah I think I think they'll get there but it'll probably take longer than people think because you know even with our team fine-tuning these models is non-trivial it's not just like oh you And it's like all right, we made the decision to use open source.

07:28 Like let's just use open source. Like you have to get the data. And then more importantly, you have to like have good eval. Um and if you think about our evals, right, our evals are very specific to us. You can't just like use some public eval set and like that that just does the job. It's like we're testing it on our task and so we have to generate our own benchmarks and evals.

07:46 Uh but I think the point is that um at a certain point it's strictly better to use open source models because when your use case is solidified and you're in production at scale and you're pretty sure this is the the sort of shape of the agent then there's no reason not to use open source because you you get these latency benefits and at the same time you get the cost benefits.

08:08 I mean again we didn't do these for cost benefits but that's like a nice side effect right >> and once you're there it's like why why use Frontier for that? But for everything that's new and sort of experimental or you're as Asha was saying what or like kind of these products where you really need the intelligence you're still going to use frontier models and it's just so much easier to use frontier models you know they're worrying about the infra you just like like they just um you just use the APIs and I think that's

08:31 why in enterprises right now even though there's there's a lot of hype for open source the sort of share of of open source inference is actually going down right now because people are spinning up all these new use cases and if you're spinning up new use caseas is of course you're going to use the frontier models until until they're working. >> Yeah.

08:48 >> But of those use cases, you know, some might die off, but like some might like the enterprises are like, "Okay, great. We want to keep shipping this and like roll it out." >> Once it's at that point, they're heavily incentivized to use open source. It's way cheaper and faster. >> At that point, they'll maybe they can do it in house or maybe they'll need help uh from people to to help them fine-tune it.

09:06 But that that will eventually happen. I just think it'll be kind of slow. Even right now in our experience >> like enterprises have a lot of desire to move but they can only do so many use cases at once. You know they there is inertia there and they have to you have to go through all the you know model risk governance and all the security things and so um I think it'll take time but it will get there.

09:26 >> Yeah. the the the other reason I think it makes a lot of sense for uh enterprises to kind of build their you know cool bundle of labs is that the shape of these models is changing constantly right we don't just build our set of open source models and then you know it's done we can move on to our next thing and maybe we'll revisit this in two years >> you often need to train new models all the time >> because >> as the frontier changes as the capability of the models changes you come up with new use cases for them.

09:59 You find new places where you're like, "Oh, this task seems to be getting repeated a lot because now I have this totally new like, you know, frontier model or open source model that now has this capability that they didn't have before, right? So we find ourselves constantly training net new models and deprecating old ones that are no longer relevant because you know maybe the frontier has advanced a lot.

10:19 The open source frontier has advanced a lot and you know the model out of the box can do a lot of things that it couldn't do before. So we >> because the model landscape is changing so quickly. >> Uh Dagon Labs is in a way a model factory of sorts, right? We really built it to um like uh compress the time between new model coming out and you know useful fine-tuned to our task model kind of popping out the other end.

10:47 >> Yeah. >> Just because happens all the time. >> How do you guys think about what to inhouse from a talent perspective versus there's also a pretty broad ecosystem right now that is you know could be RL as a service eval etc. like how do you guys what's your framework for hey this is mission critical and we need to do this best versus yes it'd be great to you know outsource this.

11:11 Um you know in practice we've seen that so many things uh relevant to model training are so tightly coupled to the use case that we have >> right that we find that we end up needing to build a lot of tooling internally when we have um open-source uh open source models that we want to fine-tune we find that if we can clearly tailor our eval to customer outcomes it's way better than just looking at like loss curves over time right we're not just saying oh can I do this one specific task.

11:43 We're measuring the entire system end to end. We're not just saying is this model good at this task. We're saying is this model working in concert with all these other models delivering the end customer outcome that we care about. And because that is so unique to our setup, we've found that in practice, we've needed to build a lot of uh a lot of the infrastructure that we need to train these models and evaluate them.

12:05 Now, for other things like getting labeled data and measuring the diversity of our data sets, we're like, "Yep, these are tasks that are common across fossil companies." In which case, we want to buy things from other vendors because that'll just help us get those models to production faster. Ultimately, the only thing that we care about is how can we get the best model to production as quickly as we can.

12:25 >> And so, it sounds like, you know, there's a lot of talk right now about like tokconomics and how expensive it is to actually run a lot of these models. Based on this conversation, it doesn't sound like you guys spend that much time actually thinking about the cost of these models. Is that correct? It's really about the performance for you. >> Performance uh latency and accuracy is definitely the driver factor for most of this, right?

12:47 Cost is a nice benefit in that, you know, uh surprisingly this is one of the few like tasks where you kind of get all the things for free, right? like we we don't actually have to trade off cost and latency and performance and so just by optimizing for the driver is actually latency and performance and we just get cost as a nice side benefit >> and do you think that's like something that's unique to the way Decagon is run or do you think there's something about like this conversation about tokconomics that for some

13:14 reason just doesn't affect you guys in the same way? No, I think if you're a growth stage company, then you're honestly like obviously we have to be responsible with our costs, but that's not the highest priority, right? The highest priority is just growing. And when you're talking to a customer, they don't really care what your costs are. They just care about how well your agent performs.

13:35 >> So that's um that that's the main thing. So actually, if you look at like our unit of output of our agent, which is in our case a conversation, um that's really what our customers care about. They don't really care about how much that conversation costs to us or how many tokens are in it. And actually over time, the number of tokens we're using per conversation has gone up because we're actually doing more model calls to make the quality better, to do more checks, to um paralyze more things.

13:56 And that's just the stage we're in right now. Like eventually, you know, if we've won the market, then like that's when it's like, okay, yeah, you know, now it's time to look at our cost and see if we can optimize further. But it's just not the top priority. >> Yeah. I also think we as a company are at a different stage than a lot of people that are talking about tokconomics uh on on on X right because the tokconomic debate really is around uh hey I'm on a frontier model today should I like how do I analyze my cost and

14:31 should I move to open source right and there I actually think it makes complete sense if we ran our entire business exclusively on frontier models I would care a lot about cost and I would think a lot about that but once you're already once you've already made the jump to saying okay now now we know how to think about open source models and we know how to decompose a problem we know how to uh build train and deploy these models very very quickly all of a sudden that the cost aspect becomes a lot less pressing um but if

14:59 you're still in the world where you're using frontier models for everything then I do thinking about toolics makes makes a lot of sense >> I just want to make this meta observation that a lot of the conversation even just now has in about things like training models, right? Uh we're talking about reinforcement learning and um it really does blow away what I think is, you know, a lingering misperception about what an AI application is.

15:24 Um and just to get into that debate a little bit because I think it's sort of this narrative that dominated the first half of 2026, which is that anthropic open AI, they're the last startups. They're going to take over everything. applications, their thin UIs with FTEEs, you know, with implementation attached to it. Um, you know, we talked a little bit about Deck Gun Labs, but can you guys just share what is your like how do you think about this potentially false dichotomy of app versus infrastructure company?

15:55 Um, clearly you guys are so much more than the UI or the implementation. Um and uh you know does agent lab you know popular uh description um floating around the last couple of weeks like does that describe it like how do you guys think of decagon? >> Um so I'll give a quick perspective just like from the from the POV of like an enterprise and then maybe we can talk about like broader the industry.

16:19 So let's say I'm like a Fortune 100 company, right? and I'm looking out there on all my use cases and I have a choice of partnering with an application company or uh sort of using the labs and building from scratch. Um I think there is a lot of merit to partnering with the labs in certain cases. I think if you look at our case right like we we just talked about all this fine-tuning stuff.

16:42 I think a common misconception that people have is you know fine-tuning is is a way to like customize it for that customer. In fact, most of the fine tetuning we do is like customizing it for our use case, like the customer service use case. >> Yeah. >> And it's worth it for us to do it because that's all we do, right? We do these agents across all of these different customers.

17:00 And so it is worth it for us to put in a ton of time and research into like how do you tune this one model to be good at selecting customer service topics. But if you're the enterprise, is it really worth your valuable research resources to like tune a model for these like customer service behaviors? Probably not, right? So that that's like that's one reason why people um partner with applications.

17:20 Another reason is >> let's say I do put in the engineering effort to build like a some agent myself using the frontier models. Um and you know to my earlier point you know I'm not fine-tuning for behavior but I'm I'm sort of teaching the AI my own procedures. And again that doesn't happen through finetuning that that happens like in context because if you were to fine-tune on that you would have to reverse it every single time you you change your procedures which doesn't make sense.

17:46 And so you kind of build out your logic and you're building your business logic in well then you launch the agent and then the second day you look at your conversations and you're like oh well actually I need to change these three things >> and now it's more engineering effort to do that and it's like constantly engineering effort. I think people will partner with applications when the use case calls for a broader platform where there's a lot of value in using you know the stuff that we've fine-tuned and using the the

18:09 software stack we've built on top of the models to capture business logic and that stuff has nothing to do with the models right like how how the business logic gets captured by this AI like how do you handle someone calling in because you know their flight was canceled and they need to rebook three people at once it's like that is business logic that the AI needs to and you're encoding that, but that has nothing to do with the models themselves.

18:32 And so that that has to exist in the application layer. I think that's where applications will still shine because you still need the application there and it's not so much the models. And the labs themselves will have more application capabilities, but those will be fairly general. Like they're you can maybe build general agents that can do this thing or that thing.

18:52 But >> for a lot of these like core verticals like ours, our our our thesis is that, you know, you're going to need something that's like very deep and has all the integrations, has all the ability to capture business logic, has the ability to run, you know, tests and experiments and then review the conversations and run QA and like, you know, have tooling for your compliance team to monitor like what's happening.

19:10 So that that's our thesis on it. And so it's kind of it's it's not black and white like there will be some use cases where it does make sense to use the the frontier models but there will be these like core verticals where going super deep makes sense. >> Yeah. I also think you know everyone is kind of bleeding into everybody else's space a little bit right like >> that's a convergence >> all the all the labs are building applications on top of it because rightly so they're saying this is how the enterprises do us more

19:38 right and this is how the enterprises see ROI from using our products uh us on the application layer we're realizing that hey we can squeeze out a lot more performance and latency and cost for the use cases that we care about by building our own models, right? Which and and I think this uh this split this kind of bleed over makes sense and I think it'll continue.

20:01 I'm not as bought into the the labs are less startup view of the world though and I think this is true both for SAS companies and for the new AI startups because in a way we human beings are kind of AGI right and human beings have needed to use software for lots of things you know you need databases to put stuff in you need CRM to track things and I think even once you have AGI all our AGI agents are going to need somewhere to store work and pull information from and reason about things.

20:34 So I think you know a certain class of SAS companies that were solely built for people to do work might face a bit of heat but I I don't think software as a whole in any meaningful way is going away and I still think you know on the application layer >> there's so many different kinds of work that that need to be done that can be done faster more efficiently more cheaply uh so I think there will always be a space for application layer companies maybe in the long term application layer companies just become labs for

21:06 specific verticals, you know, because your primary product ends up being the models that are just really good at doing those specific tasks. But I think the application layer is probably here to stay. >> Uh I also want to kind of pick on another thing that you kind of said in tossing. >> Yeah, please. >> And maybe this is like a a spicier take of oh are application layer companies just for deployed companies that are kind of doing the last mile of work.

21:30 >> Yes. Right. Well, well, I was saying that's a misperception, but I think it is a common one. Yeah, >> I think it's a really hot thing. Also, again, not to pick on tech Twitter to be like, oh, like, you know, we need to bring back the four deployed engineer and you know, every company is hiring tons of four deployed engineers. Uh, I think this is a trap >> actually.

21:49 >> Oh, same more. Okay. My my view on this is that for deployed engineers are necessary or newly necessary for early stage AI companies because the workflows are new, right? If you're building a SAS company 5 years ago, most SAS products are pretty well explored, right? like you roughly know what the user is trying to do and your job is maybe come with a slightly cleaner workflows but broadly you know what the user is trying to do with a design app or a CRM or something like that because those workflows have been

22:23 explored with AI products nobody knows what the workflows are because nobody's used these things before so a for deployed engineer in this case is honestly just embedding with the customer to learn the workflow for the first time as the customer learns the workflow for the first time and they're kind you know, kind of paving the road like you they're kind of laying out the track as they see which way the train is going in a way.

22:48 >> Uh but long term, I think they should just be building product, right? Like once you know what the workflow is, you should not be relying on four deployed engineers anymore because once you know what the workflow is, if you can productize it, you should productize it and then become, you know, typical company with these scaling properties of a tech company.

23:08 >> Yeah. And if you can't do that, then you're just building a glorified consulting truck. >> Well, I'd love to dig into this more because I know when we started working together, probably almost exactly three years ago, and you guys landed on this idea, there were two things that were relatively contrarian that now feel kind of standard. The first was when you started an AI customer service, a lot of people were like, that's a G GPT rapper.

23:28 And we talked a lot about like why that's not the case. And then the second thing you did was say like, hey, we actually want to do the work ourselves, like we don't want to just be a software platform. And now we have the term for that. That's like AI agents and everything. and you've popularized agent PMs and forward deployed as a new type of role or more common type of role um in Silicon Valley, but your like agent PM/forward deployed team has actually evolved a lot since you first got started to now and so would

23:51 love to talk about that like in the early days what did it actually look like and then as you started to learn about these workflows and were able to productize them better um how has that function actually evolved for you guys? Yeah, if you look at a lot of our four deployed teams, they are building product in one way or another, right? So all of our for deployed engineers for instance build core product, right?

24:16 Their job is to go in and understand as we're working with an enterprise, what are the things that they need that the product does not do today, but the output of that is not a one-off thing that is just built for that customer. It is something that is contributed to core product in a way that the next 10 customers that ask about the same thing get it for free.

24:38 >> Right? Uh similarly our agent PMs are working with our customers to understand you know how is the product broken today? How can this actually be deployable within an enterprise? What are the new things that we need to build to our core product to make it deployable within an enterprise? Uh so at the end of the day all of this boils out boils down into product improvements either through actual product improvements or through honestly process improvements right like we work with very very large enterprises and we

25:08 help them through the journey to go from okay this is what your or looks like today here is how we can take you through changing your processes through implementing new technology into this world where AI agents are doing a lot of work for you. So a lot of their product work is also processizing a lot of you know how we make that how we help a company through that transition.

25:32 >> And also you used to be a deployment strategist at Palunteer. So you're very familiar with the forward deployed model that Palunteer popularized. How different is that at what you did at Palanteer versus the way you conceptualize this role at Deagon. So I do think people use the term FD very loosely at Silicon Valley. >> Yeah. And I think it's it's dangerous to mix the two of free consulting work versus actually doing product.

25:52 Uh you know Sham um who's the CTF founder today had had a phrase um internal I think now it's been written about a ton. He would say uh forward deployed engineers eat pain and excrete product. No, that was kind of >> Yeah, I think it's a it's like a massive misconception because people are like, "Oh, Palunteer is such a hot company and like they're doing so well and like this is like a cool take on how to implement stuff."

26:18 But first of all, very few companies, if any, can do what Palanteer does, which is like close massive deals off the bat and like it's kind of worth it to spend all that effort. So I think a lot of the uh you know people that are doing this like super forward deployed strategy and like hey we'll do any AI use case for you um they will eventually have to reckon with like okay can we find a product that's scalable otherwise you are just building like a a modern like accent or something which yeah could be could be good if

26:49 if that's what you want to do but I think people kind of conflate the two it's like hey I'm building a hot like software company and you know we also have FTEES and like that's our big strategy So that's something that we've generally been very mindful about from the beginning is that we really view ourselves uh in our core it's a it's a productled company right um in in the sense of you know we're building a a core product that everyone can use and we're not just here to even though we have a large team now just like

27:14 build whatever use case that pops up because you know ultimately everything has to go into the core product otherwise you can't scale essentially >> um at the same time of course you know I should say we also kind of salesled in sense of like the product is informed by sales. So we're not sitting there and just you know coming up with product to build and so you kind of have this system where as a was saying we have all these people that are you know for deployed in the sense of they work very closely with our

27:40 customers but their job isn't just to spin up like random new use cases here and there and like just doing whatever the customer wants because in the short term that it could actually lead to like larger contracts and you can kind of hunt for wherever the the pain is but then long term it's just very difficult to scale. So their job is to kind of compile all of those learnings from sales into a core product.

27:59 And the goal at the end of the day is like we should have the best product out there and like be able to iterate on that faster than anyone else. And that's in our space at least our our vision of like hey the the winner in this space is going to be very product driven. >> I actually want to pull on this thread of you know that you talked about where your FDs are actually approving the product.

28:20 You know Decon is a very product driven company. Um, so just to kick off with a very small seemingly unrelated anecdote, but um I was just trying to convince uh someone on the broader team to not leave a 16Z for a Frontier Lab. And one of my arguments was that there was a good long-term career here. And the response uh that this person gave me was we'll have AGI, we don't need careers in the long term.

28:46 Um, and it really hit me because I thought I was AGI pill, but I had really not thought about from that perspective. Um, and I'm curious, you know, we talk about the product improving, right? Can you make that concrete for us? Like what are some of the oh moments as you improve your product for your customer either from your end or your customer's end if you can share on like, oh my god, I didn't realize AI could do that.

29:12 And then of course I'm going to ask you your thoughts on AGI and what that timeline looks like because you're in the nitty-gritty trenches of the enterprises using AI. So you may have a different perspective than you know we do. >> The first thing I want to say is uh I'm like certain there will be careers after agi. The reason for that is >> like most of our jobs >> for sure are for jobs are kind of like made up to begin.

29:37 Most jobs are made selfless. A very real job >> unless you're like building infrastructure or like growing food or something. It's like like most jobs are kind of like layers of abstraction built on top of like other stuff, right? And that that isn't to say like the jobs aren't valuable. It's just they're kind of made up. So when AGI is here, like it'll change people's jobs, but every people sell jobs because you're still going to do things for other humans and and whatever.

30:02 So I I don't really believe that careers will be gone after AGI. I don't think people are just going to be sitting around. I'll say one observation which is like for me it was definitely um duet so early days when we're building the product right like the the core problem we're solving again being back to salesled is we talked to a bunch of customers and they're like yeah the value we want to get out of what you're building for us is that we can put it in front of customers they can have conversations and it's giving

30:24 them much better experience and also it's like you know way easier for us operationally right it's like you're saving cost and you're making customers happier so that's that's like the first agent that we built and that was like the core agent we we worked on for the first like year year to two years and the agent on our end when we were building it consisted of a ton of stuff like we would have to um you know write these procedures and we kind of create our own format of procedures we call them agent operating

30:52 procedures that teach the AI how to do things we had to write these tools that the procedures can use to access systems and pull APIs and whatever and then after that we need to like create all these tests to make sure that this thing is working well and that you can kind of simulate all these different sit situations and afterwards once they're in production like we would manually be reading conversations, right?

31:11 There's like a ton of work that goes into it even though the core product we're building is is itself an agent. And so what duet is is it's kind of a separate agent. It's like a second agent that's much bigger, much slower, but its job is to do all the tasks I just described. So now instead of us having to write these AOPs and write these integrations and tools into their systems and write these tests and monitor the conversations, do just does all of that, right?

31:37 So it's like a it's a second agent that is smart enough to do all these things and um it's it just feels very magical because you can just literally tell it like hey I've nothing built yet so far, but here's a bunch of transcripts I have and here's some documentation. like you go figure out the best way to like do these all these procedures I want >> and it'll go do it and then of its own accord it'll also write the tests and simulations that go along with those and once you're done with that and you actually put in

32:05 front of customers it'll be the one that's monitoring all the conversations and it'll flag things where things are going well or poorly and it'll say like yeah I read you know these thousand conversations and actually there's this one topic that we do really poorly on >> and I've noticed that and I've also drafted these improvements for you so it's like >> wow It's like one agent that can do all of that.

32:23 And so that that's very magical because well first of all it was not possible when we first started the company. It only became possible when all the reasoning models got better and of course anthropic open are making these reasoning models mostly for like the cloud codes of the world but they are also really good for like duet for example and that was kind of like a moment where it's like oh wow like first of all you can just see the improvement over time of the models.

32:50 Yeah. >> And two, it can do all these tasks where it just would not be able we would not have expected AI to be able to do all these tasks at once, but it can do them very well. And um I think that's that was like a very visceral moment of like, okay, wow, the models are getting a lot better and they're becoming like very generalized, you know, like they can do all these things.

33:10 Like clearly the models were not trained on like our specific task, which is you writing these procedures and and writing these tests, but they're still good at it. And also um to your other question of how you know how did we come up with all of this and how how did the product improve every single thing that Jesse just talked about was the result of four deployed people doing things and us figuring out how to productize it right so for instance um we realized that hey when we go into a new customer we need to spend

33:39 all this time writing up the AOPs manually and we're like wow this is quite a lot of time how do we productize this and we built that into duet and then the Second part which we called duet autopilot was uh once we built duet you know people were using duet to write things up and then we're like oh wow there's still a lot of time that goes into iterating upon the agent right once it goes live like reviewing conversations figuring out how to improve it and we're like great let's productize that as det autopilot in fact

34:05 AOPs themselves were a result of this exact scenario because before AOPS >> you would have to write all these procedures in code >> and then we found that oh it's taking a lot of for deployed engineering work to write all these things in code. Wow, wouldn't it be so much easier and efficient if we could productize it by writing it in plain text, >> right?

34:25 >> So the way we think about like product improvements for deployed engineering investment, everything is built around what can we productize from forward deployed work so that engineers and any kind of customerf facing resources on our team don't need to be kind of as heavily involved. H can I ask you as like kind of a blunt question on this line of thinking?

34:47 So I know we've already talked about like why open Aan anthropic won't be the last startups and you've talked about like why there's room to have like much more specific use cases and specific companies but you know you you you've also got had like oh moments where you're like these labs are getting so much better and the models are getting so much better.

35:02 Um and so long term let's say like we we hit AGI and the LA the models can do all sorts of things we can't even imagine today. What's decagon's moat at the end of the day after all of that and like why does decagon like 10 years from now still have a right to exist? I think in the short term actually it is the ability to work with enterprise resources and what I mean by this is that the capability of models today is far greater than they are being used for within the enterprise right by which you can't just take a

35:37 model and say I'm just going to give this model access to everything within the enterprise and I'll it'll just figure everything out right like that's practically not how these things So to make models like this deployable within the enterprise, right? Like let's assume that every model is like just perfect and makes no mistakes. But to make something like this deployable within the enterprise, you need to say, okay, I need a way to be able to tell the model what it can and cannot do and make sure that it cannot do

36:04 anything like catastrophically wrong. Then I need a way to make sure that, you know, hundreds of people within the enterprise can collaborate to make sure that the agent is behaving as expected in the use cases in which they are experts. Then I need a way to be able to test this model and make sure that it doesn't cross any like regulatory lines that I have and test it, make sure it works well.

36:24 Then I need a way to, you know, look over the, you know, millions of conversations that happen for me to extract insights for the rest of my teams, right? Right. So there's a lot of just infrastructure and software that you need to build around these models to make them deployable within an enterprise to make them be uh work with all the legacy systems that these companies have.

36:45 And so I think for the next few years that's probably going to be a you know the primary thing that these models need to be able to work. uh now once that gets commoditized because the agents can build that on the fly that I don't know and we'll figure out in three years from now >> by the way I think just listening to you guys it's very clear that you guys deeply understand how to sell AI to the enterprise and I don't just mean you know mid-market newly IPOed companies I'm talking about some of the largest companies

37:16 in the world um and I think this is particularly interesting because you you both are very very technical but also go to market animals Um, so I want to talk a little bit about that. Um, but you know, it just feels like you've turned what maybe started as feeling more like a David and Goliath with multiple Goliaths. Um, uh, market dynamic to really a two- horse race between you and Sierra.

37:40 Um, so share a little bit more about why some of the largest enterprises in the world are buying from you guys. And I think what's really remarkable to us as people have, you know, studied application software for, you know, over a decade, the sales cycles are crazy fast. I mean, I'm sure you guys with urgency want them to be faster, but like usually you don't sell contracts that big to enterprises that big, right?

38:03 That takes two years sometimes. So, um, maybe just share a little bit more on this is a long question, but like how did you grow that commercial? did you come with that into founding the business and what's resonating with these large companies that enables you to get in and move so quickly? >> Yeah, I mean we we have a lot of respect for for Sierra and also just you know other folks in the space generally the big platforms like they all I think the platforms themselves move a bit slower but I think that we've we met a

38:29 lot of those teams they're very competent teams they're optimizing for a lot of different things at once. uh Decon versus Sierra. I mean our our most recent customer actually uh turned off of Sierra to come to Dekagon and sort of the reasoning if when we asked them was um it was this kind of goes back to this like deployment model. It's like you know when when they worked with Sierra it was mostly FDES and it just felt like a black box where you know the the FDs were good but they had to go through the FDS for

38:56 everything. So to build new journeys or to uh even get like a deeper understanding of what was happening in the conversations and then over time that that kind of just created a lot of drag on how quickly they could move right so in the initial deployment that was good but then over time maybe the FDES were staffed other things and it just took them a while uh to get insight into what was happening and then build out new journeys right so over over the course of the year they maybe built out uh I think they said three

39:23 >> um and so the reason they came to us is because they they had that frustration and they wanted to kind of have a different model where it was a lot more productized, right? Back to us being like very product driven in our vision. It's they should have a a core product that even if we're there helping them, even if we are forward deployed, it is like a in in service of helping them build a product that they can use themselves and iterate really fast and and kind of have everything in their control, right?

39:48 So, we we like to call this like a glass box approach instead of a black box. And uh and yeah, so within a basically a month they spun up like seven new journeys on Ducky. Wow. Yeah. Mostly >> and it had taken three a year to get three. >> Yeah. >> Okay. Interesting. So it's just kind of the speed of iteration like some teams will really like this like hey we have control of it.

40:10 We our teams especially our non-technical people can come in and do things and they understand what's happening in the in the conversations. And maybe there's other teams out there that actually do like the like, hey, you guys do everything for us and uh that approach. But that that's kind of the difference in the approaches and that's why we've been I would say having a lot of success there.

40:29 And then zooming out just selling to the enterprise. Yeah. I mean this is something that uh you know Asha and I have never sold to the enterprise before and I think it just so happens that both of us um find sales exciting >> and the enterprise it was kind of like a quick learning curve for us. So, I don't think I think a lot of it honestly came kind of naturally just cuz our space is so hot and like generally in these conversations we're not really having to convince people to like invest in this space.

40:57 It's like more of hey, we're the right approach for you. So, like you partner with us and uh yeah, with the enterprises it's it's really just about like navigating the orgs and really having empathy for what they value and what they're afraid of. Um, so yeah, I mean we we just back to being salesled, right? Like we we always from the beginning were like, hey, we're going to be like extremely strong on the go to market side and that's going to inform the product even though we have this product driven philosophy like we

41:24 don't want to just be dreaming up random products to build. Um, so we always had that DNA and then in the early days we were just yeah pushing really hard and I think I also want to say I think we got kind of blessed with a a really strong early sales team >> and we have a lot of really talented people in that group and that helped us really get leverage as we were talking to you know the big enterprises >> some of whom cold applied to you guys in the early days I remember.

41:48 >> Yes. Yeah. Yeah. >> Yeah. Cold cold applied. Um >> cuz I think they were working in the in the space already and they they were seeing from afar like what Decagon was starting to do. >> Yeah. >> Yeah. So some of them had like non traditional sales backgrounds, you know. So they had nontraditional sales backgrounds. They're coming into sales. The other profile we had a lot of in the early days were just like like Ivy League athletes, I guess.

42:09 And >> those profiles were kind of a good foundation for the group. And you know, we've had to scale that team really fast, which is never easy. So there are things that we're still trying to catch up on in terms of enablement and and or structure, but um because we've always had that intensity on the sales side and the whole company knows that like you know everything starts with sales and it kind of propagates back um you know we've always had that focus.

42:35 the, you know, the other thing I think that helped us a lot, um, you know, to your earlier point about how did you get some of these large deals closed so quickly was, uh, I think we were very curious about how we could productize parts of it within the enterprise, >> right? By which I mean, >> we aren't a company that just says, "Hey, here's a product.

42:57 We'll throw it over the wall and, you know, you get it a year later." Because within a lot of these enterprises, the question they have internally in addition to will this product work for me is can I actually get this live? Right? And within a lot of these enterprises, it's actually complicated, especially if you're in financial services and you're regulated for instance.

43:16 So we actually spent a lot of time sort of uh mapping out that part of the journey very well. So that when we walk in to one of these enterprises, we can walk them through in very granular detail, how we go from this first meeting today to going live at 100%. >> So yeah, >> you know, at this stage for a company like you, uh this is what your model risk process is likely to be.

43:42 This is how uh your testing process should look like. This is how we should do the initial roll out. This is how we should catch any issues that come up and how we're going to fix them and how we'll ensure that they don't happen again. So the product and technology part of what we sell is important, but for these large companies, equally important is us uh helping them think through the process to actually get this deployed and at scale because I think that is something that often gets overlooked by by tech companies

44:12 selling into enterprise. >> Yeah, for sure. And um by the way, I can also personally attest to the strength of your early go to market team, having met a bunch of them. Um, that being said, I don't want to underplay how many times a decision maker has told me that one of the reasons of many, right, that they're going with Decagon is they want to make a bet on you guys.

44:32 They're they'll literally say, "We think the founding team of Decagon is going to move the fastest. This is a very fast-paced market. it's changing on a weekly if not daily basis and we think that you guys are going to look at the chess pieces and make the right moves because it's not sort of like a oh everything's going to be the same in you know a year or even six months type of market.

44:54 Um so I'm curious I mean don't give up too much alpha here but how much time do you guys spend on sales as founders and how has that evolved over time? >> Uh I probably spend most of my time like 80% maybe. >> Yeah. Okay. Um, and yeah, I think a lot of it is just pushing speed. So, some of it is like, hey, like as one of the founders, you just have to be in calls and like, you know, people want to meet the founders, but also it's just how can I be the sort of the main force that's pushing our team to go faster, but

45:26 also just like the the partnership to move faster. One of the things with that is like you know now we work with you know several of the largest you know banks in the world and airlines and and telos and no matter how fast you go like there's all there it's those are still like massive organizations and it will take time and so one of the things that we really try to do is you know kind of take the project and piece meal it so we're not just deploying across every surface area every use case at once that's really just

45:56 pick you know one or two of the top use cases and just get a win And >> I would say that's that's been helpful, right? If you navigate like a big bank like it's not going to be like a quick like, you know, you just close a big deal, >> right? At least for us it's not maybe some people can do it but um it's yeah it's still a lot of effort and it's it takes time and so you have to figure out ways to you know design things from a process perspective and an oracle perspective and in a product perspective as well that like

46:24 just keep shortening that and like finding clever tactics and uh that kind of takes founder involvement. um you you wouldn't really expect a like a a sales team to just like constantly be coming up with new configurations there because you know they're not responsible for the product. They're not responsible for you know the end to end you know process that the company runs.

46:47 >> So having the founder involved there is very important I would say and then the sales people their job is to kind of execute on the sales side like build champions and navigate the org and so on. The other reason um to also spend a ton of time with both sales prospects and existing customers is also because the market is changing so quickly being able to really quickly understand >> what are the things that we are not doing today that we should be >> doing very quickly right because model capabilities are changing

47:15 all the time as models roll out people are seeing other things that happen and they're like oh wow this is really cool and like I'm seeing this here and you guys aren't doing that as well. Um so being able to like stay really really close to that feedback loop because um that's something we never want to never want to let go of. >> Yeah. Do you want to talk about how that like informs product roadmap?

47:32 Meaning >> probably like two two years ago or so uh most of Decagon's customers were focused purely on customer support and nowadays I would say that's that's actually not true. You guys have broadened your vision to mostly like to be like an AI concierge for your customers. Do you want to talk about what the distinction between those two actually is and in practice like what that means for both your sales teams and your product teams?

47:55 >> So you know all the when we launched the original set of use cases that we sold were in customer support. Um and the reason was because one that was one of the biggest challenges that a lot of our early customers were facing and two that was where the capabilities of the models ended at the time right like that is all that is the pretty much the limit of what they were capable of doing.

48:18 Now, however, as models have gotten better and our customers have realized, well, why would I have one set of models that just learns about my customers when they have another when they have a problem and something else when they come to me to buy something, right? And so, we had a customer that we originally went live with them for customer support.

48:37 Uh, and then they realized they were like, well, you know a lot about our product now. You know about the capabilities that it has because you need to do that for customer support. you know how we like talking to our customers and our brand. Um, can you help us with inbound sales, right? When someone comes in, answer questions about us, do some discovery and then, you know, assign it to the right uh uh enterprise rep if it's, you know, a deal of large enough value.

49:02 We had another customer that um started using us for a lot of operational workflows, right? So uh we are able to now proactively reach out to them once we start seeing um any kind of issues on on that on that customer's account. Um because ultimately at the end of the day the thing that we built and we kind of built this intentionally from the start was not an agent that does customer support well but rather an agent that follows business process well right and executing on operational workflows doing sales lead

49:36 qualifications on certain customer support questions at the end of the day is just an agent following a business process. And we kind of built it flexibly enough to kind of do all these things because we realized that hey at a certain points the models are going to get better and they have. >> And what do they specifically get better at that allows you to do that?

49:55 >> It is specifically the ability to follow instructions. Well, right. So when you had um models, you know, let's say a few years ago, you'd have to give it very very tight guidance, very specific instructions that you didn't want it to deviate from. And as the models got smarter, you could kind of give it broader and broader guidance, bigger and bigger instructions, and just trust that the models have good enough sense to interpreted like a human would and kind of fill in any missing gaps, right?

50:26 Because for again for customer support, you can have a very tight path that the model should follow. And that's all you really need. Whereas for sales qualifications, you kind of want to ask open-ended discovery questions. The conversation is going to kind of bob and weave. And so you need the model to kind of fill in with reasonable things. So that's specifically kind of what the what the models got better at over the years.

50:47 >> Yeah. Um I think if if you think about you know what is the like 12 month product road map because things are moving so fast like the answer the real answer to that is like we kind of like see how it evolves and we obviously know what we're working on now but I think realistically in in today's AI world it's very difficult to have like a a 12-month road map to a tea.

51:07 you maybe know have like some themes of what you want to build but ideally if you have those things you just build it like right now because it's so so fast to build things now so um I would say that that is that is one element but then the sort of long-term vision is still very clear to us now right which is we use the term concierge but really it just means like hey an AI agent should just be the front door of your business or your brand and every interaction whether it's like reactive or proactive with a customer uh

51:33 should be handled by by AI and we've already seen that AI is very good at that right customer service is like a huge pillar of that where it's all these inbound interactions but why not have also be able to do all these other things. So over time again we're we're not trying to figure out on our own what these things are. We kind of have now have a lot of customers that will give us signal on the things that they care about and those will be the things that we built.

51:58 >> We we've talked a lot about how the models are getting better and you know obviously your capabilities are are moving along even you know ahead of that progress. Um, what are some of the bottlenecks right now that you're seeing? Um, whether that's on the capability side. Um, I don't it could also be, you know, around persistent memory. I don't know if you guys feel like that's kind of up to snuff on where you would like it or um could be other bottlenecks, but curious like what would you like to see and what's kind

52:23 of holding you back? >> Hiring. >> Got it. So, it's less on the AI side. It's actually like we are we are voracious consumers of tokens but we would always love more great people. I think there's so much to build these days that it's uh you know >> and why can't you hire >> AI agents to do the things that you're doing? >> Yeah, we we are voracious consumers of of of token really like our our token bills are very very large.

52:50 Um but uh uh you know there are still things I I don't quite yet think we're at the point where we can have the AI agents uh make decisions on what to build and kind of have that >> uh the taste of is this done yet >> right so we can outsource a lot of specific execution steps but uh I I don't yet think they're at the point where they can make the call on what to build what to exclude things like that.

53:23 >> So the model's improving, have they since like you found it three years ago, has it changed your hiring needs at all? Because a lot of people are like, "Oh, you can build like oneperson unicorns, you know, like >> Yeah, you know, I I I think, you know, this argument does get tossed around a lot, but I think the the uh an easy counter example to this is all the uh the AI coding startups are hiring like crazy."

53:47 you know, they're like the most sophisticated users presumably of these models and they are hiring like crazy. I think the reason is just because >> um >> everybody has access to these tools and so if our competitors are going to use them and build more things, we need to build more things, right? If somebody else said, "Oh, here's our road map and now we can get through it in, you know, a third of the time."

54:10 And then they just stop hiring. We would just take that to mean, "Wow, we can get through it in a third of the time. Great. that's built three times as much stuff and turns out everybody, you know, does the same calculus. So, everybody both needs to keep hiring more and shifts more. So, it is great for consumers of these models. Um, but I don't think it has materially changed our our hiring plan.

54:32 >> It's so funny. I thought you were going to say something like, I don't know, latency of voice models or something like that, but it seems like on the technological bottleneck side, it's >> Yeah, there's still stuff that we're waiting for, right? like um you know voicetovoice models is an interesting frontier that there's still research happening on >> um you know the getting smaller models to be smarter smarter out of the box right so there's there are going to be still developments that we are watching closely that

54:58 we care about >> but from a business perspective it's less on the model side and more on the just like can you build the company fast >> yeah um actually maybe since we're on the topic of hiring um and you know I feel like grind slop has become this theme on on X. Uh, and it's so funny because, you know, as a as a VC, like I I'll admit, you know, when I I mean, you guys are famously in the office six, seven days a week.

55:27 I hope this doesn't get marked as grind slop now, but um, you know, I think constantly hustling for your teams and your customers. And it's so funny to see that kind of turned on its head. Um, and so I'm just curious, what is your what are your thoughts on the narrative out there and like um, grind slop is such a general term, but like you know you guys grind, but there's also a lot of camaraderie and excitement in the office.

55:50 So like just you know say more about that and like how you're building the culture. >> Yeah, I mean grinds is a funny term. We so we have never posted grind slot because we kind of view that like working hard is just like I don't I don't think people are like working hard to grind. It's just like oh there's a lot of stuff to do. Like >> we kind of people spend time there mostly because like >> hey it's you know this is like a fun time of our life.

56:17 Like we want to take advantage of our talent and sort of potential so that it's not wasted. I think that's that's the main reason and it's a very sort of like it's like many orders from like the main goal which is like can you build a good product and can you win in a space and but it's like one of the effects of that is that people work harder and >> even from from the beginning like we yes we have an office culture but like we're never mandating people to come in on the weekends.

56:44 We don't really care how long there are they are in the office. It's just people are in the office just so that like we can maximize communication and that's how we view it. Um like I don't view ourselves as like you know abnormally grindy or am abnormally ambitious. I think like we're I think we just like I have a lot of ambitious people around me like us and all these people that so it kind of just become normal and like everyone works hard so it's just kind of like normal.

57:15 >> Um so I don't think it's like something that we view as you know something like super special. >> Yeah. And we kind of also view a lot of what we do very much as a team sport, >> right? Where we very rarely have lines between our orgs in that uh you will very commonly see engineers on early stage sales calls. You will see salespeople like debugging parts of the product.

57:40 You will see our APN team in absolutely both ends of the spectrum. Um, and so I think being able to have teams that are so kind of uh disperate from like a function perspective all working together kind of uh one kind of needs people in the office because everybody's kind of >> jamming on ideas together but two it also makes it >> fun in a way because you know everyone is like working together towards some very specific outcome right it's either um getting this uh building this thing for this customer in time for the

58:14 deal to close or launching this new thing. And because it's so many different teams working together, it's kind of a it's kind of a we're all in this together to get this across the line. >> Yeah. Well, and how does that scale as you know, you you've launched a lot of new offices recently. You have a new Australia office, London office, your New York office is growing like crazy.

58:33 How do you maintain that culture when you guys are both in San Francisco? >> I don't know. I mean, >> yeah, I don't I don't think it's a solved problem for us. like we're constantly working on it and like every single time the company gets to the next phase there's like new things we have to institute to just make sure that everyone understands the culture and there's like very high accountability and um you know there there is pressure because there should be and so that's something that we're constantly adding on

58:59 because in the first 100 people it doesn't really matter because everyone kind of knows each other and like everyone's but like as you grow people might not have no one's communicated the vision to them or communicated the culture to them And um yeah, I know like Ben was talking to us about the A16Z culture, right? It's like how it's very like actionoriented and you can't just like put put like fluffy stuff on there.

59:22 And so >> um yeah, it's all these things that we're trying to do a better job of as we grow. Uh the other thing is also we um we bring everybody that we hire out to San Francisco for a couple weeks when they start so they're kind of immersed in the kind of uh the original kind of soup of of culture. Uh, and then for every new office, right, at this point, New York and London, all these offices are big enough that they have the original decagon culture there anyway, but for brand new offices, we actually have people

59:54 from one of these hubs go out and spend a few months there really until the office becomes big enough and has its own kind of culture um, so that it doesn't kind of become too different from what kind of the original decagon culture was. Actually on the topic of international we're um so we brought on uh Ragu um Ragnaram last year obviously former CEO of VMware um and in addition to investing he's helping us build out a ton of our international capabilities um and I think one of the things that we've seen is that our

01:00:29 AI companies are just getting pulled internationally way earlier like for you to have an Australia office it seems premature except for the fact that you have customer poll your scale is quite large for you know how long ago you were founded. Um but maybe say more about that like does that translate like does your product translate well to these other geos um are there more enterprise concerns uh or fewer or is it kind of just comparable to the US market?

01:01:01 >> Yeah, I think there's two trends. uh one is that AI is just such a phenomenon that every buyer out there has you know tried chat GBT or whatever and so there is a lot of just top down pressure from boards and sees to just get moving on something and if you think about a lot of these businesses they're like hm how do we adopt AI well it's you know let's do some coding agents and like let's do customer service because those are like the obvious ones and so there is a lot of pull uh to to your points >> and then the

01:01:27 other trend is that language is a lot easier with AI. So >> yeah, >> in the past maybe a blocker would be, oh, my language just doesn't work in or my app just doesn't work in German or >> right, >> pick your language, right? But now it's a lot easier is to adapt your app. So >> I think for those reasons, international has been a lot faster. Like at the same time, right, like we also want to make sure that we're not getting spread too thin.

01:01:53 And so it's kind of this balance where >> it's like very unclear what the perfect answer is, but you know, we've kind of made a determination of like which markets we're >> um okay with really investing in and if we're going to invest, we're going to, you know, really invest. And generally those markets are ones where we've already just like naturally picked up some customers out of the US office or something.

01:02:13 >> Yeah. >> And then now it's like time to deploy people. Um because yeah even though these there are these trends that make it easier to go internationally like you know there's also other things that you don't really think about right like you have to have data residency there's all these things where and there's like local competitors which are just know the market a lot better and so you have to navigate that well.

01:02:35 >> Yeah absolutely. Um >> do you think there is a like a space for like local competitors to the large categories that we know about? I mean there is space for them. I think the question is like long-term is there consolidation and it's it's you you could say that for both um geographies but also verticals and then also market segments, right? So like there are going to be people that find their niche in different places.

01:03:03 Like our view the reason why we've kind of built so horizontally is that we believe that in our space the winners are going to be horizontal. there's just not that much that is like super verticalized that where like you could see a a pure vertical solution surviving and historically that's just been true in our space right like Salesforce very horizontal Zenness very horizontal like all these solutions are very horizontal because you just gain more from having that scale and having a very robust and deep product than

01:03:30 you do from like having very vertical specific features and over time we're also going to build you know vertical features into it but our view is that like from a vertical and sort of market point of view there will be consolidation. >> Um just sort of on related to consolidation but maybe not just geographic um consolidation. I'm curious if AI concierge becomes really the interface between the business and its customers.

01:03:58 Do you see what like how does CRM and all of these you know sort of traditional data very important systems of record right for the end customer um how do those evolve in this new world and do you see any consolidation >> there in terms of your own role >> yeah I don't um I don't think it's necessarily an either or >> right because ultimately what we're what we're doing here is trying to democratize uh access or availability of these concatives, right?

01:04:33 Which is if you were going to a business where you were spending $100,000 a year, you would get the most personalized treatment. They would know exactly who you are, what your preferences were. They want to help you, you know, shop, for instance. They'll shut the whole store down for you. >> Actually, I don't know if they do that for, >> but you get the general, right?

01:04:55 >> You've never you've never tried that before. >> I've never tried those. Um, however, if you're at a business where you're spending $10, they can't do this for you because they can't make it economical, >> right? It is not a lack of desire to do this for their customers. It is just that the unit economics don't support that. >> And so, effectively, all we're doing here is saying, okay, if you could give them that experience for >> 10 cents, all of a sudden it is economical and they'd want to do that.

01:05:24 Now to the point of does that mean CRM go away? I mean my answer is no because if you had u you know if you have a company today where the con your concierge is a human being >> they still write your info in a CRM so they can track it for later. So, and I think when we have these AI agents, they will need somewhere to put that information. >> Um, so I don't necessarily think those kind of auxiliary pieces of software go away >> because um for us as we're building these concurries, our goal really is how do we create

01:05:58 that great experience? We will still need places to put that data somewhere, >> right? >> Yeah. Um, I actually think CRM could do quite well. um they'll they'll be slightly different in the sense of like CRM are kind of databases in a way and >> you know the frustration people have with them sometimes is that the interfaces are really difficult to use etc but in the future maybe the agents are just using the interfaces and you don't you don't even have graphical interfaces or whatever and so the CRM are still very

01:06:30 valuable because they they hold the source of truth and you know then the agents they're just kind of getting pinged a lot more because the agents are are using them so that is one possible world that's that's kind of bullish on CRM and >> for us personally like so far with Zechon there's like we have zero desire to build a CRM because we think there's so much to do in the agentic layer >> and that's where we want to focus >> yeah okay so SAS is not dead >> cool maybe um last thing is we were chatting right before we

01:06:59 we started recording that you guys have done some little AI experimentation on your own as you just figure out how to you know make your own life more productive and effective and also it sounds like you've done something kind of interesting. >> Yeah. Um, you know, I think the models have gotten very smart uh over the last several years and you know the two of us will often use it to brainstorm ideas, right?

01:07:24 Because they are genuinely very smart at at coming up with great ideas. However, the bottleneck I realize at least for a lot of the work that I do is business context, right? there's a lot of context for every idea around okay the constraints that we have the goals that we're going for and things like that that is difficult to reexlain to the agents every time and so I actually spent a while building agents for myself to capture all the business context well so it just kind of looks over my shoulder all the time and is

01:07:55 constantly compiling context on oh here are the people that we've hired here are the people that we need to hire here are the deals that we're working on here's here are the problems. Here are the current challenges that we have. So that later on I can just go to it and say, "Hey, there's this new person that we're thinking of hiring. What do you think?"

01:08:13 And now it's able to automatically reasonable, well, we had two candidates that were very similar and you know, these candidates had these kind of uh drawbacks or skills that they didn't have. And so if we hire this person, it's going to be another person that has those, you know, kind of exact same things. So we need someone complimentary. So this is probably not the best person to have or >> you know in this deal we're barreling down a very similar path because you know we didn't validate these things early enough so

01:08:39 this time we should validate them uh uh slightly earlier. So it's really all about how do you capture context well because then you know my job is making decisions with lots of context. So if I can outsource that more and more to a model maybe I can put myself out of job quicker. >> Sounds like you created Jesse. There we go. >> I do think um like one of the big struggles of being a solo founder is you don't have anyone to bounce ideas off of.

01:09:06 So you just arrive at conclusions a lot slower. >> You guys were both solo founders in the past, right? >> Yeah. So like us working together, I think the reason it was so much easier is that we could, you know, iterate on things much faster. You kind of just talk something out >> and uh yeah, now you've talked to Fable or whatever. It's like it's pretty good, honestly.

01:09:25 seem like very original >> because in the past it's just like they just kind of are kind of sick fence, right? Where they just agree with you. Oh, that's a good idea. But now they're like, "No, that's a bad idea. >> Don't do that." I actually uh for a while Mark at one point had uh uh posted the prompt that he used for Claude where it's like, you know, disagree with me, be very direct, things like that.

01:09:50 So, um I actually used that for one. It was great. And the the funny story on this was I really enjoyed it because it would agree with me very aggressively. It would disagree with me very aggressively. And um I took it to my wife and I was like, "Ah, this is great. You should use it." She put it on and then, you know, a day later she was like, "Wow, Claude was being so mean to me all day.

01:10:10 I had to turn it off." Like he just kept telling me, "Yeah, it was just disagreeing with me so aggressively." >> Amazing. Um well, since we're on this topic of f founders using AI to do things, um I have to bring up the whole uh AI slop um fiasco maybe is a strong word that Brian Chesy just went through. Um and I want to bring it up because um you both have grown your profile a lot over these last few years.

01:10:39 And you know, you know, I sort of mentioned Jess, you had these pieces that were just hitting the zeitgeist of the discussion that everyone wanted to have and came in with a very differentiated take. Um, and uh, you know, that's the kind of stuff that we see exactly hit on. You know, you're hitting the conversation right at the, you know, right message, right time.

01:10:58 Uh, unique message, right time. Um, do you use AI for writing? Um, and separately, um, this is a more of a meta question, but how important is X and like the sentiment on X to you? >> Uh, so yeah, for most of our early days, it was mostly LinkedIn with the reasoning of like, hey, our customers are on LinkedIn. You know, we're not going to get someone seeing us on Twitter and then coming as a customer probably.

01:11:27 But I think the the sort of learning we had with X is or at least I was kind of reflecting on it. X is kind of like like the timeline that people talk about. >> And most of that timeline is not really about your company. Like if you're if you're very like >> just like promoting yourself on X like it's going to get no traction whatsoever. >> Totally.

01:11:48 >> But it is sort of like a single timeline that everyone reads. So it kind of like it kind of like mind controls everyone to be thinking about the same thing. >> Yes. And that's where it's valuable to have some say in it. And uh who was this guy listening to? There's like there's this guy like Jeremy GeFon or something who's on Patrick Ashanti's podcast who I like and he was like doing he like made some claim about how like you know it used to be that >> like the the the big status symbols in the world is like

01:12:19 everyone wants to be a billionaire cuz like he calls it like the priest class or whatever. So it's like billionaires are the priest class but nowadays actually it's when people become billionaires now they want to become ex influencers because like those people hold the real power because they can like influence what the whole world's thinking about.

01:12:35 >> Um so that's like one reason to have some presence on X I suppose >> and when we now when I post on X I don't really post about like Decon specifically it's more more about you know our thoughts on what is happening. So, I think that's that's like a good good way to do it. And but it is very different. >> You write it all yourself, right? >> Yeah.

01:12:56 Um I mean AI is good for um sort of helping you brainstorm like what topics to write about. I think that's that's pretty good. >> But I think that was that's kind of like a learning that like LinkedIn and X work very differently. You can't just like come up with something cool >> and >> like post the same thing on both >> because like very few things like do well on both.

01:13:16 >> Yeah. So like LinkedIn's really good for you know classic stuff. You're making announcements and um talking about your product and you know fund raise or whatever. I guess you can do fundraising on X as well but X is a lot more about kind of like placing yourself on top of that single timeline that everyone's on. >> And is that so is it too much of a simple you know simplification to say X for hiring especially you know AI research talent etc.

01:13:41 um maybe ecosystem as well and then LinkedIn more for enterprise customers or are you actually seeing enterprise CIOS pay attention to X? Hard attribution is hard obviously. Yeah, it's hard because you know I think you could say like oh well you know I I I made a post on X and then you know the people on all in podcast were talking about it and like CIOS definitely that I saw that so it's like a >> like indirectly I'm sure we got like some eyeballs from CIOS like is the CIO themselves like scrolling X all day maybe not

01:14:16 >> but if you are part of that major timeline then you have there's always these like secondary effects and then and then like reporters will reach out to like from like mainstream media and then if they write about you then like Ashan was on the New York Times recently you know it's like if they write about you then those for sure get eyeballs so >> you were >> Mhm.

01:14:37 But it was just open source stuff. >> Oh, Kimberly's only on X. So, >> you didn't put the next article. I didn't see it. >> Um, I guess maybe a last uh question would be just since we touched on like hot button X topics. um one and this is kind of a serious one actually but it sort of re-entered the narrative I think with um you know the anthropic video and it's just sort of maybe never left the narrative but it's on this concept as progress gets better around jobs um and the messaging around that um it's a sensitive

01:15:10 topic obviously but it's interesting because I really think customer support was maybe the first endto-end use case where you could really take an entire job um or sorry do an entire job I should say take is the wrong word um versus coding was always you know pair programming to start with um how has that you know we we sort of joked before but I you know we weren't really joking that um AI is actually creating jobs I'm curious how do you turn that narrative on its head that folks are just losing their jobs right like

01:15:46 do you see the upleveling of folks folks with AI where you know maybe they were doing this job and now they're doing something else. >> Yeah. I mean we we we see this all the time. Uh because uh if you recall earlier on when we were talking about okay what are we truly doing? Um, we found that in a for a lot of our customers, there's actually just more demand for things like customer support than there's supply, >> right?

01:16:14 >> Where companies realize that they're like, okay, if our cost of doing customer support drops by 30%. Most of them are not just immediately saying, okay, now what I will do is, you know, let go of 60% of my team. They're saying okay now that this thing which is clearly valuable for my customers is much cheaper let me do more of it >> so that my customers retain for longer so that you know they don't turn off as much so that they activate sooner things like that >> you know we had a customer in the early days um they

01:16:45 and this was you know probably two and a half years ago at this point um where they said you know our ticket volume you know the amount of customer support inquiries that we get uh per month was I I think I think it was like 50,000 a month or something based on uh you know the existing surfaces that they had. Once they started using us they said wow turns out our customers have a lot of problems they said let us make support more easily accessible right so instead of it just being in one part like buried within a

01:17:18 support panel. They're like let's put support on every page and let's make it more prominent in places where people are more likely to get stuck. Let's allow immediate support for even free users rather than only paying users. Right. So because of this kind of >> there's more kind of latent demand for support. Yeah. >> Uh than there is supply. So >> automating things doesn't necessarily result in just kind of people laying off their entire teams.

01:17:44 >> That may be the best example of Jeban's paradox in real life that I've heard. So it's exciting. >> Yeah. I think it's like uh AI will uh kill jobs but not careers in a way because like those jobs that are being done currently should not be done by humans. Like they're very mundane and menial. It's like it's like a super high volume use case and people are just like kind of picking up the phone.

01:18:03 I was like, "Okay, let me click here, click here, and like, okay, here's the answer, right?" And that should be done by AI. But there is actually like a near infinite amount of things that people could be doing to make their customers happier and, you know, take care of them more. And so people will end up doing those things and more and more of the mundane repeatable things will get eaten up by AI.

01:18:23 So that that's that's what we think will happen. Jesse, I think on a podcast, maybe Patrick Oshanosy's podcast a couple months ago, you had mentioned that even your customers when they've been using BPOS for customer support instead, you haven't actually seen like layoffs at the BO. It just turns out that those employees have gone and done other things instead.

01:18:41 Is that still true? >> Oh, uh, I mean, it's it's it really depends on the situation. So, there are definitely scenarios where people use their BPOS a lot less or don't need the BO anymore. There are other situations where they are not in cost cutting mode whatsoever and their goal is to either their business is growing so quickly that they don't want to scale their operations along with their growth and so with Dakon they can kind of like keep it flat or whatnot or it's yeah actually we still need people but now

01:19:13 there's all these other things they could be doing and it could be more re revenue generating things. um you know as that's like a big area for for us even is like as the AI matures you first start with these cost cutting use cases because those are easy but then like revenue generating use cases should also be able to be done through this conversational interface so yeah there's it really depends on the customer but um you know we definitely have customers that have made massive changes >> actually I'd like to end it

01:19:41 on that uplifting note um and just to repeat what Jesse said it may kill jobs but not careers I love that um thank you so for joining us, guys. A pleasure to have you. >> Thanks for having us.

💡 Answer

Build enterprise AI applications by starting with frontier models, then fine-tuning smaller open-source models for stable, high-volume tasks; productize customer workflow insights into a deep enterprise application with business logic, integrations, testing, monitoring, compliance, and deployment support.

🧠 AI Summary

Enterprise AI applications should combine frontier models for new, complex, and exploratory work with fine-tuned open-source models for stable, narrow tasks where latency and performance matter. Decagon’s approach is to build deeply into enterprise workflows, encode business logic, provide testing, monitoring, compliance, integrations, and productize lessons from forward-deployed work. Enterprise applications remain valuable because agents still need software, data stores, business processes, controls, and systems of record. Forward-deployed teams should discover workflows, then turn repeatable solutions into core product rather than ongoing consulting. Decagon’s long-term vision is an AI concierge that handles reactive and proactive customer interactions across support, sales, and operations.

🔑 Key Points

  • Model selection should optimize for cost, intelligence, and latency according to the task.
  • Fine-tuned smaller models can be better than frontier models for narrow, well-defined tasks.
  • Frontier models remain useful for new products, auxiliary tasks, and broad exploratory work such as reviewing millions of conversations.
  • Production open-source model work requires task-specific data, benchmarks, evaluations, and ongoing retraining as the model landscape changes.
  • Enterprise AI applications need business logic, integrations, testing, compliance, monitoring, collaboration, and legacy-system support around the models.
  • Forward-deployed work should be converted into core product improvements that benefit future customers.
  • Customer support can expand into sales qualification and proactive operational workflows when models improve at following broader instructions.
  • AI applications and software remain valuable because agents need places to store information, retrieve data, execute processes, and interact with systems of record.

✅ Actionable items

  • Start new or experimental use cases with frontier-model APIs, then evaluate whether stable production tasks should move to fine-tuned open-source models.
  • Decompose an agent into narrow tasks and fine-tune smaller models for those tasks.
  • Build task-specific benchmarks and end-to-end evaluations tied to customer outcomes.
  • Use forward-deployed teams to discover customer workflows and convert recurring needs into core product features.
  • Pilot enterprise deployments with one or two high-priority use cases before expanding across every surface area.
  • Map the full path from initial enterprise meeting to production, including model-risk review, testing, rollout, issue handling, and prevention.
  • Use customer conversations and feedback as an ongoing product-roadmap signal.
  • Have a larger agent generate procedures, integrations, tests, simulations, and monitoring workflows from transcripts and documentation.
  • Capture business context continuously so AI agents can use information about hiring, deals, problems, goals, and constraints in later decisions.
  • Use LinkedIn for company, product, and fundraising announcements and use X for broader industry perspectives rather than directly promoting the company.

💡 Business ideas

Enterprise AI deployment and workflow platform35:00

Provide specialized agents and surrounding software that encode business logic and make AI deployable inside large enterprises.

For
Large enterprises with complex workflows, legacy systems, compliance requirements, and many customer interactions.
Solves
General-purpose models do not provide the integrations, controls, testing, monitoring, and business-process logic required for reliable enterprise deployment.
Validate by
Pilot one or two high-priority enterprise use cases, measure customer outcomes, review conversations, and turn repeated deployment work into product features.
  • Customer support
  • Inbound sales qualification
  • Operational workflows
  • Proactive customer outreach
Context-compiling personal business agent01:06:46

An agent continuously captures business context so it can later support decisions about people, deals, problems, goals, and constraints.

For
Founders and business leaders who make decisions requiring substantial ongoing context.
Solves
Repeatedly explaining business context to an AI agent limits the usefulness of its brainstorming and decision support.
Validate by
Continuously collect business information, then test whether the agent produces more context-aware recommendations.
  • Evaluating a potential hire against previous candidates.
  • Identifying repeated mistakes in a deal process.

🏗️ Business models

Product-led enterprise AI application23:36

Build a reusable core product for enterprise workflows while using customer-facing teams to inform product development.

  1. Work closely with enterprise customers to discover workflows.
  2. Identify recurring needs and gaps in the product.
  3. Convert those needs into reusable core product features.
  4. Give customers control to configure, monitor, test, and iterate.
  5. Scale the product across additional customers.
  • Decagon's forward-deployed engineers contribute features to core product.
  • A customer created seven new journeys in one month.
Hybrid frontier and open-source model deployment01:56

Use frontier models for experimental or broad tasks and fine-tuned open-source models for stable, narrow production tasks.

  1. Use frontier models to get an initial use case working.
  2. Identify repeated, well-defined tasks where latency matters.
  3. Fine-tune smaller open-source models for those tasks.
  4. Use frontier models for new, complex, or exploratory work.
  5. Continuously train new models and deprecate obsolete ones.
  • 90% of Decagon's workflow runs on open-source models.
  • Duet Autopilot reviews conversations and creates model variants.

📣 Marketing

Sales

  • Explain the granular process from first meeting to full production deployment.
  • Start with one or two priority use cases to create an initial win.
  • Combine product capabilities with deployment, risk, testing, rollout, and compliance guidance.

Branding

  • Position the product as a transparent glass box rather than a black box.
  • Use LinkedIn for product and company announcements.
  • Use X to contribute perspectives to the broader AI conversation rather than simply promoting the company.

Distribution

  • Deploy through enterprise sales and structured implementation processes.
  • Expand from initial customer support use cases into sales and operational workflows.
  • Open international offices where customer demand already exists.

Customer acquisition

  • Use a sales-led approach in which customer conversations inform the product roadmap.
  • Navigate enterprise organizations by understanding what decision-makers value and fear.
  • Use founder involvement to accelerate large enterprise partnerships.
  • Build champions and use a strong early sales team.

🔍 SEO & discoverability

Mistakes

  • Posting the same content on LinkedIn and X is ineffective because the platforms work differently.
  • Directly promoting the company on X is unlikely to gain traction.

Other channels

  • Mainstream media coverage can create secondary visibility with enterprise decision-makers.
  • X can indirectly generate attention from reporters and enterprise executives.

Content strategy

  • Publish differentiated perspectives on timely AI industry debates.
  • Use X to participate in a shared industry conversation.
  • Use LinkedIn for announcements, product communication, and fundraising communication.

🧭 Frameworks

Cost-intelligence-latency model selection04:24
  1. Evaluate the task's required intelligence.
  2. Evaluate latency requirements.
  3. Evaluate cost considerations.
  4. Choose the model or trade-off that fits the task.
Forward-deployed productization loop22:03
  1. Embed with customers to learn new workflows.
  2. Identify repeated manual work or product gaps.
  3. Build the solution into the core product.
  4. Make the improvement reusable for future customers.
  5. Reduce reliance on customer-facing engineering work.
Enterprise deployment process43:26
  1. Assess the enterprise's model-risk requirements.
  2. Design testing and initial rollout.
  3. Launch in a controlled way.
  4. Catch and fix issues.
  5. Ensure issues do not recur.
  6. Expand deployment to scale.

🧰 Tools & AI usage

  • Duet — Create procedures, integrations, tests, simulations, and conversation monitoring for customer-facing agents.30:10
  • Duet Autopilot — Review conversations, find trends, create model variants, and improve the core conversational agent.06:27
  • Claude — Provide direct, disagreement-oriented feedback using a customized prompt.01:09:42

AI is used for

  • Fine-tuning narrow production tasks — Improve task-specific performance while reducing latency and obtaining cost benefits.02:00
  • Reviewing conversations and improving agents — Find trends, generate model variants, run comparisons, and identify areas for improvement.06:27
  • Generating agent procedures, integrations, tests, and monitoring — Automate the operational work required to build and maintain customer-facing agents.30:10
  • Capturing business context — Support better decisions by maintaining information about people, deals, problems, goals, and constraints.01:06:46
  • Brainstorming — Generate ideas and provide a counterpart for exploring decisions.01:11:17

📊 Numbers mentioned

Costs

  • 90% of Decagon's workflow is on open-source models.
  • Decagon's token bills are described as very large.
  • A 30% reduction in customer-support cost is given as an example of a change that could increase demand.

Growth

  • A customer built seven new journeys in one month after switching to Decagon, compared with three journeys over a year previously.
  • One customer had approximately 50,000 customer-support inquiries per month before expanding access to support.

⚖️ Advantages, risks & lessons

Advantages

  • Task-specific fine-tuned models can be faster, cheaper, and more accurate than large general-purpose models.
  • Deep enterprise integrations and business-process knowledge are difficult to replace with general models.
  • A productized glass-box approach gives customers more control and faster iteration.
  • Customer feedback directly informs product development.
  • A strong enterprise deployment process can shorten the path from purchase to production.
  • An application can combine specialized models, business logic, testing, monitoring, and compliance.

Risks

  • Fine-tuning requires high-quality data, task-specific evaluations, and specialized expertise.
  • Enterprise adoption is slowed by model-risk governance, security requirements, organizational inertia, and limited capacity for simultaneous use cases.
  • The rapidly changing model landscape requires continuous retraining and deprecation of older models.
  • Forward-deployed strategies can become unscalable consulting if customer work is not converted into product.
  • International expansion adds data-residency requirements and local competition.
  • AI agents are not yet trusted to decide what a company should build or exclude.

Lessons

  • Optimize for customer outcomes rather than isolated model metrics.
  • Use frontier models where flexibility and exploration matter, and specialized models where the task is stable.
  • Treat forward deployment as a way to discover and productize workflows.
  • Enterprise AI requires much more than access to a capable model.
  • Start enterprise rollouts narrowly and expand after proving a use case.
  • Rapidly changing model capabilities make rigid 12-month product roadmaps difficult.
  • AI can increase demand for support and other services when lower costs make broader access economical.
  • Founders should stay close to customers and sales to maintain a fast feedback loop.

💬 Quotes

An AI agent should just be the front door of your business.

Captures Decagon's long-term vision for AI-mediated customer interactions.00:00

The thing that we built was not an agent that does customer support well, but rather an agent that follows business process.

Summarizes the broader product thesis beyond customer support.48:55

Forward deployed engineers eat pain and excrete product.

Defines the intended role of customer-embedded engineering teams.37:05

AI will kill jobs but not careers.

Summarizes the view that AI replaces mundane work while people move toward higher-value activities.01:57:48

👤 People & companies

Jesse

Decagon co-founder who discussed model strategy, enterprise applications, hiring, sales, and AI usage.

01:56
Asha

Decagon co-founder who discussed product, forward deployment, enterprise sales, and international growth.

06:58
Ragu Ragnaram

Former CEO of VMware who joined Decagon and helps build international capabilities.

01:00:16
Mark

Person credited with posting a direct, disagreement-oriented prompt for Claude.

01:09:42
Brian Chesy

Person mentioned in connection with an AI slop controversy.

01:10:18
Patrick Ashan

Podcast host referenced in discussions about AI and X.

01:12:42
Jeremy GeFon

Person referenced as a guest on Patrick Ashan's podcast in a discussion about influence and X.

01:12:06
Ben

Person referenced in a discussion about A16Z culture.

59:13
Decagon

Enterprise AI application company building customer-facing agents, model-training infrastructure, and an AI concierge.

00:00
Decagon Labs

Decagon research team and model factory focused on fine-tuning and rapidly deploying task-specific models.

06:06
Anthropic

Frontier model company referenced as a provider of closed-source and reasoning models.

02:12
OpenAI

Frontier model company referenced as a provider of closed-source and reasoning models.

02:12
Thinking Machines

Company referenced in discussion of open-source models.

01:30
Sierra

Enterprise AI company described as a competitor to Decagon.

37:43
Palantir

Company associated with popularizing the forward-deployed model.

35:34
VMware

Company whose former CEO Ragu Ragnaram joined Decagon.

01:00:16
Salesforce

Example of a horizontally oriented software company.

01:02:37
Zendesk

Example of a horizontally oriented software company.

01:02:47
A16Z

Organization referenced in discussions about culture and hiring.

59:13
The New York Times

Publication mentioned as a source of additional visibility after media coverage.

01:14:30