AI Studio is a platform for creating, testing, and beginning to use managed agents, including applications that showcase agent capabilities. The videos describe it as a place to build applications such as a stock-research app using managed agents that run in cloud sandboxes.
Antigravity is the built-in harness and base framework for Gemini Managed Agents, providing the execution platform and sandbox environment that manages an agent's infrastructure, built-in capabilities, and tool calls. It is one of the managed-agent building blocks alongside environments, uploaded skills, credentials, triggers, tools, MCP servers, and file mounts.
Google's developer API for building applications with Gemini large language models. It provides access to models like Gemini 2.0 Flash and 2.5 Pro, and also supports Gemma open models. Developers use it for tasks such as custom model testing, retrieval, memory, and tool-calling systems.
Gemini Managed Agents is a Google DeepMind cloud-agent service in which coding, research, and analysis agents run in managed cloud sandboxes rather than on a user's local machine. Agents are launched through a single API call using the Interactions API and are assembled from a harness, an execution environment, uploaded skills or AGENTS.md files, tools such as MCP servers and file mounts, credential proxies, and scheduled triggers. Multiple agents can share environments and pass work between one another, supporting workflows such as sending SEC-filing research to a quantitative-analysis agent and producing a report. The service is presented as accessible through AI Studio and supports choosing among Gemini models.
The Interactions API is a stateful Google DeepMind API for working with models and agents. Applications can chain interactions by passing a previous interaction ID, allowing context such as characters and visual style to persist across generations.
Searchable transcript of Build Your Own Team of Managed Agents - Jack Wotherspoon, Google DeepMind — AI Engineer (19:44). Search for a phrase, then click its timestamp to jump straight to that moment in the video.
Captions sourced from the original video on YouTube, published by AI Engineer. The video, its captions and all related intellectual property remain the property of their respective owners; AINotes claims no ownership. Provided for research, accessibility and search — see the Transcript Notice and Copyright Policy.
00:01 [music] Hi everybody. Thank you so much for coming. My name is Jack Witherspoon and I am a DevEx engineer at Google DeepMind and today we're going to talk about managed or cloud agents. So raise your hands here, who all has heard of either cloud or managed agents or has used them? Okay. I'm starting off on the right foot. So you might have heard of them if you for those who haven't, cloud or managed agents are essentially a way of instead of running a harness and running coding agent on your own machine, you can
00:45 actually just run them in the cloud on a sandbox. So let's first start by why the heck would you even want to do that? Well, sandboxes are really powerful for a number of reasons. Number one, they're not running on your own machine. So you can, you know, spawn a cloud agent. It can go and write code. It can reason. It can do research, search the web.
01:07 It can go ahead and write tests, run tests, verify and actually come back with verified kind of answers. And that's a really strong thing. If you've ever like tried to run verification either on your own laptop, you know, sometimes it steals the browser. It starts to run things for you. You start getting pop-ups and things like that. So running this all in the cloud takes away that pain.
01:32 And the other reason is that your laptop doesn't scale. You might start to have specific setups like agent skills or you maybe have customized your personal coding agent on your machine. But then how do you go and share that with a colleague or how do you integrate that into your app, right? You don't want your app that you're deploying to customers to be running with your own kind of subscription or things like that, right?
01:56 So, we want to be able to scale this up and doing so. And managed agents or cloud agents are a great great way to do that. So close, the sign almost stayed up. Don't worry about it. [laughter] So, when it comes to kind of managed or cloud agents, you know, to do this yourself is quite a tedious process. You know, you have to actually spin up a container or a VM.
02:21 You have to load things onto that, manage it. And then you actually have to do harness engineering, you know, figure out kind of build your own harness within the sandbox. And then let's not even start to talk about networking or setting up firewall rules or all the security stuff. So, that's where kind of managed agents come in and whether it's Gemini managed agents, cloud managed agents, we'll be talking about Gemini managed agents today, which is our offering in the Gemini API at DeepMind.
02:51 And really now it boils down to just being a single API call. So, that is really the beauty of managed agents. With a single API call, you're getting all the things we talked about. So, you're getting the sandbox, you're getting the anti-gravity harness built out of the box that is in the sandbox, and it can go ahead and do a lot of powerful things.
03:13 You don't have to worry about managing any of the infrastructure or the scale as you need in your application, more agents, you can just do more API calls. Actually, we'll go back for a sec. So, you can see here, this is our interactions API. It's our kind of new agent first version of our SDKs and client libraries. So, previously we had kind of models, you would, you know, do an input, get an output, but that didn't really scale to agents in the new world we live in.
03:45 So, we launched a new kind of SDK uh, covering interactions. So, interactions are much more kind of mirroring what agents are doing. So, it can be multiple steps, you know, when a when you do an agent call, it can go ahead and write files, call those files, call different MCP tools. Um, so really this new interactions API that we launched, uh, went GA earlier this year, is now our kind of home for managed agents.
04:13 So, you just call the agent instead of having a model, you have an agent. So, we have our base anti-gravity agent. And then you set environment equals remote. So, that's that key thing that's now telling it, "Okay, we want a managed agent that runs in the cloud." And then you give it kind of regular input as you're used to. So, here's kind of how the infrastructure actually looks under the hood.
04:35 So, when you call a managed agent, you kind of have that input that we saw. And then it calls the Gemini API, which has a bunch of, you know, built-in server-side tools like, um, searching the web through Google Search or file system tools to read and write files. Um, and you can also add your own custom functions or MCP tools as well. And then we have the sandbox.
04:56 So, that's actually running on kind of Google Cloud infrastructure. Um, so when you call the Gemini API to get a managed agent, it goes ahead and actually sets up and spins up that sandbox for you. And you can go ahead and actually upload files to the sandbox. So, if you have agent skills or agents.md, or you want to load a GitHub repository on startup, uh, we allow you to do all of that cool stuff.
05:22 So, here are kind of the building blocks that make up a managed agent. These are kind of the different core pillars. Um, so you've got the harness itself, and that's the anti-gravity harness. It's the exact same harness that's running, uh, in our anti-gravity suite of products over at Google. So, that's what's kind of figuring out the tool calls. It has the built-in tools.
05:43 Um, and then we have the environment. We'll talk a bit more about how the environment is kind of its own entity, um, which allows you to do really cool kind of multi-agent workflows by having different agents pointed at the same sandbox, so they can write files. A different agent can pick that same environment up later and actually build upon those files.
06:01 And then we've got skills we talked about, so you can upload your skills to the sandbox just as you would have potentially like playbooks or different ways of doing things at your company or on your personal agent, you can upload those to the managed agent as well. And then we have credentials. Credentials is a new piece of managed agent, which essentially lets us inject either kind of tokens or your MCP OAuth into the managed agent sandbox, so you can access your different services.
06:29 And then we also have triggers, which allow you to actually schedule a managed agent to run. So, let's say at 8:30 8:30 a.m. every morning before the market opens, you want to go and, you know, do some kind of financial analysis before the market opens up. You could set a trigger, the managed agent would essentially wake up, run its task or run its input, output a result.
06:50 You can like do webhooks so that you could send a Slack message. Maybe it queries your team's Jira board every morning and sends, you know, here's what everyone's working on, um and things like that. So, we talked a little bit about the harness. Um it's the anti-gravity harness that runs under the hood, and you can change the different models that it runs with.
07:10 Uh yesterday we just launched Gemini 4 Argon, which is our new frontier model. Um so, I definitely recommend testing it out. It's a great model. Um but we'll show it later on in this in demo. And you can set the different model in the config for the managed agent in the agent config, as you see there. We have that kind of one-line parameter to set the model.
07:30 So, that's how you can kind of tune the managed agent based on the workflow. If you're wanting to do something that needs to be fast and efficient, you can use Gemini Flash. If you want to do do that's deep reasoning or potentially doing a lot of analysis, then you can use a different model like Gemini 4 Argon. Like we said, Gemini 4 Argon was released yesterday.
07:51 Um it's a really great model. It's especially good at financial tasks, which is great for hopefully for the audience here. Um and really good also at doing data analysis across a wide range of documents. Um and as always, the Gemini models are also super super good at multimodal. Another really cool, interesting um feature that we have with the Gemini 4 model is long decode.
08:11 So, normally models have an output token max of around 64K tokens. Um but with Gemini 4, we actually have up this so that now the 1 million kind of context window or token limit is now shared between input, thinking, and output. So, output, as you need to kind of scale up if you need to do extreme kind of math reasoning or financial modeling where the output might be pages and pages and pages long, the model can actually go and do that.
08:41 And this is showing to actually advance some of the more mathematical and financial benchmarks out there. So, we talked a bit about the interactions API and environments, and this is kind of one of the key pillars. These are kind of two core primitives in managed agents that allow you to get a lot of flexibility and be able to customize kind of the agent configurations that you do.
09:05 So, these are kind of two different um stateful things on our back end in our server side. So, interactions is what manages your conversation. So, when you put an input and get an output and kind of a different turn with the model, um those are saved as kind of what we call interactions. So, you can take one interaction, pass that ID to the next interaction, and that kind of, you know, it's the second turn.
09:29 Um and then we also have environments. So, environments are what's actually kind of in the file system on the sandbox. So, when the agent goes and writes files or creates images or does different file tasks on the actual sandbox in the cloud, that's kind of representative of the environment. And you can go ahead and use our APIs to download files from that environment or upload them.
09:56 But having these two things kind of split out allows you to do some really cool things where you can actually see here that we are creating one agent interaction with our first code block. And it's going to go ahead and do some work and save a file. And then we can pass that environment ID to our next agent. So, it actually picks up. It has a very fresh kind of context window and conversation, but it's reusing the environment.
10:20 So, it can go and, you know, say save the Q3 filings in our workspace. Maybe we're going to go, you know, fetch the fetch the annual reports, the filings. And then we're going to go and do some analysis, save that as a file. And then we can have a new agent come in, reuse that same exact environment, but this time have a fresh context window. Kind of a multi-agent workflow, which is really cool.
10:46 So, there are a bunch of built-in tools already in the sandbox, like code execution, reading and writing files, as well as Google Search. But we also support, you know, remote SMTP servers, so you can bring your own servers. You can hook up to your favorite services. And really that takes the agent a step further and be able to actually do kind of daily tasks or things that you can build into your apps.
11:10 And we talked a little bit about it, but you can also kind of mount files to the file system. So, you can upload your different agents.md files, your skills, and kind of run through the playbooks that you have your agents doing on your personal machine, but doing it in an environment where you can kind of reproduce and have that work done for you in the cloud.
11:27 So, you don't have to worry about, you know, overriding any files or messing up things on your machine. Everything runs in the cloud, um and can just run as a process and get you back that output. So, here's a Here's a code sample where we're actually going to upload an agents.md example into our um sandbox, and then we're also connecting a GitHub repository.
11:49 So, now you can actually have the agent look at your code, check for bugs and things like that. And then you can also save the agents. We also have an agents API, so you can do agents.create. So, once you've kind of refined your workflow and found an agent that works for you, you can save it so you can easily call it, you know, in multiple different times.
12:08 You can iterate on it and then save it for later. And then you can just easily invoke your personal agent by calling it with its uh agent ID. So, another big part of the security aspect of managed agents is that secrets never actually enter the sandbox. So, our managed agents have a proxy that sits uh it's kind of a layer between the sandbox and our API.
12:33 And it actually what it does is it puts a placeholder kind of dummy token into the sandbox so that the agent can never kind of go rogue and say, "Oh, I see that I have this GitHub token laying around. Let me just see what else is on there." Um so, it can actually never do that because it I never actually has your GitHub token. So, what it does is when it goes and calls the GitHub API, our proxy will then inject that token.
12:57 It will match it to say, you know, it's API uh GitHub API. Um we're going to go ahead and inject this secret. Um so, that way the agent can never do anything that it shouldn't be able to. We talked quickly about triggers, but triggers are also really powerful because you can have them set to kind of a daily briefing every morning like we said, scan your emails, maybe suggest ones to reply to, or if you want to check on the stock market before it opens, um you can do that.
13:26 And this is a way to run one of your agents on a set schedule. And we talked a little bit about multi-agent workflows, but managed agents can actually work really well um in multi-agent workflows. So, you can actually set it up so that one managed agent knows how to, because it's just an API call, actually call other managed agents um and do work and fan out work.
13:53 And then you can have very kind of niche and specific targeted agents that have one core purpose. They do that purpose really well. Um you know, maybe it's drafting notes or doing research. Um writes it to a file, gets that information saved, and the next agent can then take over from that different input. And this kind of breaks it up so that you can have things really controllable and really make sure that you're doing specific tasks well instead of just giving a super super broad, you know, task to an agent and
14:23 having it have no way of kind of measuring what it's actually doing. So, now we'll just quickly put this to the test. Um so, we can actually run the agents here and see what this actually looks like when you run one. So, we have an SEC kind of an SEC filing researcher that just researches companies. We have it set to Nvidia here. And we can go ahead and make call of the API.
14:48 So, like again, this is just an API call. It's really easy to build into your own either internal workflows or to actually publish in your services or apps to external folks. So, we can go see here. There are step traces. So, each thing the agent does um is saved as a step trace. You can see we're having function result for the right to file, code execution, and you can kind of trace the what the agent is doing and optimize as you go to kind of make sure that the workflow is straightforward.
15:19 And then were we using the same environment ID that we talked about. So, because we're using the same environment ID in this scenario, we're actually having our agents pick up. So, we can have We had this SEC filing researcher that went and did research on Nvidia, gave us a bunch of metrics as the output. And then, we can now kick off this kind of quant agent, which will go take a look at the metrics because it's in the file system.
15:42 It's reusing the same environment, the same sandbox. And now, it can pick up its task and its job from that um metrics.json, take it, run a bunch of Python code files to see and actually look at it make evaluation for Nvidia. And if we go here and look at the MD file, we can see the managed agent went and actually did research based on the metrics it got, and it's now kind of doing a forecast for the share price in the stock.
16:12 And then, we can kick off a third agent just to kind of take that research and knowledge dump and turn it into a report. And if we had connected different MCP servers, like we could connect Google Docs, have it actually output and write to a Google Doc or send a message in Slack so that you can really kind of create these customized workflows from managed agents.
16:34 And then, you can also build managed agents super easily with the SDK into your own application. So, this is just a demo here where we have a managed agent that is actually um connected to our service. Um it's connected to our Google Drive where we dumped in a bunch of receipts of our annual kind of um company data, and it's going to go ahead and actually create this visualization um by from from the the data.
16:56 And the managed agent is the one that's actually doing all the research. It has, you know, kind of a skill that will go out and tells it kind of how to do this interactive report. Um and then, it's just kind of reasoning through it and building this out for us. So, it's really customizable. You can really kind of anything you can do on your own personal coding agent, you can kind of turn it easily into a managed agent that you can either run as a company daily or set up in your own apps so that we have other ones on
17:28 our on our Gemini API on AI Studio where you can kind of create games on the fly. You can research documents and do all kinds of things. So, the easiest way to get started today is to go over to AI Studio and get started for free over there. And we also have our documentation for managed agents, but I'll quickly just do another demo here since we have a few minutes.
17:57 This is one of our kind of managed agents examples that is on AI Studio in our gallery. And this one's kind of just trying to showcase how you can actually build these managed agents into your own applications. So, this is you know, create a nice front end and put in a stock. Oh, not slash. So, we can go ahead and do VOO. And this ticker agent is a bunch of our different managed agents that will go out and do specific tasks and look for different analysis on a stock.
18:37 And again, this is kind of more of an illustration illustration that's like as you're building managed agents into your own apps, you might not want to have this kind of stream but just to kind of visualize what the actual agent is doing. It's reasoning through all the different steps in the interactions API. And then this managed agent is told to kind of generate a report based on all of the findings and reasoning it did in its sandbox.
18:58 So, now if we go ahead and click on the report, we can see the managed agent outputted this kind of PDF file for us where we can see all of the research it did, see its analysis and key takeaways, as well as doing these charts so we can visualize. And it's also going to go and link out to kind of all of the resources um that it went ends actually using for this.
19:23 So it actually went to the Vanguard Vanguard site, found the different documents, read them in, and then did analysis on it. And that is it on managed agents. Thank you very much.