← All transcripts

Claude Is Now INSIDE After Effects — And It Actually Animates for You Transcript, AI Summary & Key Points

ManuAGI - AutoGPT Tutorials · 24 days ago · Science & Technology · 07:51 · EN-US

🧠 AI Summary

Higgsfield's DaVinci Resolve plugin brings AI video generation, image generation, LUT creation, reframing, background removal, draw-to-edit, and upscaling into the DaVinci Resolve workflow. Editors can select footage, describe or configure an operation inside the Resolve panel, and return the result to the timeline without exporting to a separate platform. The plugin works on macOS and Windows, requires the non-App Store version of DaVinci Resolve, and may require an active internet connection because processing runs through Higgsfield servers.

🔑 Key Points

  • The Higgsfield DaVinci Resolve plugin includes AI video generation, AI image generation, AI LUT Creator, reframe, remove background, draw to edit, and upscale.
  • AI video generation can create missing scenes, characters, camera moves, and B-roll from a natural-language description.
  • Reframe supports 9:16, 16:9, 4:3, 3:4, 21:9, and 1:1 formats, using subject tracking to keep the focal point in frame.
  • Remove background can isolate a person or object and produce footage with an alpha channel for compositing inside Resolve.
  • Upscale can boost footage up to 4K, with the goal of recovering useful detail rather than only stretching pixels.
  • AI LUT Creator transfers tones, contrast, and mood from a reference into footage, but the generated LUT should be treated as a starting point.
  • The plugin is available for macOS and Windows, including Apple Silicon and Intel Macs, but is not compatible with the App Store version of DaVinci Resolve.
  • AI processing runs through Higgsfield servers and may require an active internet connection, while the editing workflow remains inside Resolve.

✅ Actionable items

  • Install the Higgsfield DaVinci Resolve plugin on macOS or Windows.
  • Use the version of DaVinci Resolve downloaded from Blackmagic Design rather than the App Store version.
  • Open DaVinci Resolve's workspace menu, choose workflow integrations, and select Higgsfield.
  • Select a timeline location, open generate AI video, describe the desired scene in natural language, and review the generated result in the context of the edit.
  • Use reframe to select a target aspect ratio and review the result, especially with multiple subjects or fast motion.
  • Run background removal on selected footage and use the resulting subject in a composite.
  • Use upscale on old or low-resolution footage when preparing it for a modern delivery format.
  • Brush over an unwanted object with draw to edit, describe the replacement, and compare the edited frame with the original.
  • Bring a reference frame, photo, or color palette into AI LUT Creator and use the generated LUT as a starting point for final grading.

🤖 AI in practice

Used for

Generate a missing establishing shot, transition, visual detail, or B-roll clip and bring it into the DaVinci Resolve timeline. 02:41
Create still visual assets such as title cards, backgrounds, textures, graphic elements, and scene components. 03:38
Adapt a landscape clip to vertical, widescreen, square, or other delivery formats while keeping the subject framed. 03:53
Isolate a person or object from footage and use it in a composite. 04:36
Prepare old or low-resolution footage for modern delivery formats. 05:03
Remove an unwanted object from a frame, replace an area, or add a new element to a scene. 05:21
Transfer the tones, contrast, and mood of a reference into footage as a color starting point. 05:27
Run AI video editing and generation workflows without exporting clips to another platform and rebuilding the edit. 01:03

Advice

  • Install the Higgsfield DaVinci Resolve plugin from the Higgsfield installer and open it through Workspace > Workflow Integrations > Higgsfield. for DaVinci Resolve editors
    This places the AI tools inside the Resolve workspace.
  • Use the version of DaVinci Resolve downloaded from Blackmagic Design rather than the App Store version. for DaVinci Resolve users installing the plugin
    The plugin is not compatible with the App Store version.
  • Keep an active internet connection while generating. for Users running Higgsfield AI workflows in Resolve
    The AI processing runs through Higgsfield servers even though the workflow stays inside Resolve.
  • Review reframed results when footage contains multiple subjects or fast motion. for Editors adapting footage to new aspect ratios
    Subject tracking may require checking in these conditions.
  • Treat a generated LUT as a starting point rather than the final grade. for Editors and colorists using AI LUT Creator
    The final result depends on the source footage, exposure, skin tones, and creative direction.

What it could not do

  • The plugin does not work with the App Store version of DaVinci Resolve. — Users must use the version downloaded from Blackmagic Design.
  • AI generation may require an active internet connection. — Processing runs through Higgsfield servers.
  • Reframe results should be reviewed when there are multiple subjects or fast motion. — Subject tracking handles repetitive framing work but may need checking in these situations.
  • The generated LUT is not necessarily a final color grade. — Its result depends on the source footage, exposure, skin tones, and creative direction.

🧰 Tools & AI usage

  • DaVinci Resolve — Video editing and color-grading application where the source footage, timeline, generated results, reframing, background removal, compositing, upscaling, frame edits, and LUT workflows are handled.00:00
  • Higgsfield DaVinci Resolve plugin — Integrates AI video generation, AI image generation, AI LUT creation, reframing, background removal, draw-to-edit, and upscaling directly into the DaVinci Resolve workflow.00:29

AI is used for

  • Generate video — Create missing scenes, establishing shots, transitions, visual details, and B-roll from natural-language descriptions.00:27
  • Generate images — Create still visuals such as title cards, backgrounds, textures, graphic elements, and scene components.00:35
  • Reframe footage — Adapt clips to different aspect ratios while using subject tracking to keep the focal point in frame.00:53
  • Remove backgrounds — Isolate people or objects for compositing without setting up a green screen.00:36
  • Upscale footage — Prepare old or low-resolution footage for modern delivery formats, up to 4K.08:23
  • Draw to edit — Replace unwanted objects or add elements by marking an area directly on a frame and describing the desired change.05:21
  • Create LUTs — Transfer tones, contrast, and mood from a reference into footage as a color-grading starting point.05:47

🔗 Links mentioned

📄 Transcript

Searchable transcript of Claude Is Now INSIDE After Effects — And It Actually Animates for You — ManuAGI - AutoGPT Tutorials (07:51). Search for a phrase, then click its timestamp to jump straight to that moment in the video.

Captions sourced from the original video on YouTube, published by ManuAGI - AutoGPT Tutorials. The video, its captions and all related intellectual property remain the property of their respective owners; AINotes claims no ownership. Provided for research, accessibility and search — see the Transcript Notice and Copyright Policy.

00:00 If you edit in DaVinci Resolve, you already know the problem. Your timeline is here, your color work is here, and then the moment you need AI video generation, image generation, reframing, or background removal, you have to leave the app. You export a clip, open another browser tab, upload it, wait for the result, download it, import it again. Then you discover the crop is wrong, the background needs work, or the shot still needs a different look.

00:27 In this video, I'm going to show you the Higgsfield DaVinci Resolve plugin and how it brings AI video editing tools directly into the DaVinci Resolve workflow. We'll install it, open the Higgsfield panel, and run several tools on screen so you can see what the process actually looks like. The plugin includes AI video generation, AI image generation, AI LUT creation, reframe, remove background, draw to edit, and upscale.

00:54 The main idea is simple. Select a clip, open the panel, describe what you want, and bring the result back into the place where you are already editing and color grading. So instead of treating AI as a separate production stage, we can use it as part of the timeline. Let's start with setup. Higgsfield DaVinci Resolve plugins are available for both macOS and Windows, including Apple Silicon and Intel Macs.

01:19 The installation itself is free, and you can download the installer from the Higgsfield DaVinci Resolve plugins page. There is one important detail before you begin. The plugin is not compatible with the App Store version of DaVinci Resolve. If you use Resolve, download it directly from blackmagicdesign.com instead. Once you have the correct version of DaVinci Resolve installed, download the Higgsfield installer for your operating system.

01:45 On macOS, open the package and follow the installation steps. On Windows, run the installer and let it complete the setup. Now launch DaVinci Resolve. Inside the application, open the workspace menu and look for workflow integrations, then Higgsfield. This opens the plugin panel inside your Resolve workspace. You may also need an active internet connection while generating because the AI processing runs through Higgsfield servers, but the workflow stays inside Resolve.

02:14 Your source footage is selected in Resolve, the request is made from the panel, and the result comes back into your editing process. That setup takes a few minutes. After that, the useful part begins. The first workflow I want to show is generate AI video. Every editor has been in this situation. The cut is working, but one shot is missing. Maybe you need a short establishing shot, a transition, a visual detail, or a piece of B-roll that would be expensive or impossible to capture again.

02:45 Normally, that means searching through stock footage or opening a separate generation tool. With the Higgsfield panel open, we can work from the Resolve timeline. I'll select the point where the extra shot needs to go, open generate AI video, and describe the scene in natural language. For example, a cinematic wide shot of a lone cyclist moving through a misty mountain road at sunrise, slow camera movement, soft golden light.

03:11 Then I'll run the generation and wait for the result to come back. Once it is available, I can review it in the context of the edit instead of judging it as an isolated download. This is where the integration matters. If the shot works, I can place it into the sequence and continue editing. If the timing or direction needs to change, I can adjust the prompt and generate another version without breaking the rest of the workflow.

03:35 The same panel also includes generate AI image. That is useful when the missing asset is a still visual, a title card, a background, a texture, a graphic element, or a scene component. The next group of tools solves a different problem, adapting existing footage. Let's start with reframe. Say this timeline was originally edited in 16:9, but now I need a vertical version for shorts or reels.

04:01 I can select the clip, choose the target aspect ratio, and run reframe. The available formats include 9:16, 16:9, 4:3, 3:4, 21:9, and 1:1. The tool uses subject tracking to help keep the focal point in frame as the aspect ratio changes. That means I can take a landscape shot and create a vertical version without manually keyframing every movement. It still makes sense to review the result, especially when there are multiple subjects or fast motion, but the repetitive framing work is handled for me.

04:36 Now, let's look at remove background. This is useful when I want to isolate a person or object without setting up a green screen. I select the footage, run the background removal workflow, and use the resulting subject in a composite. For example, I could place a presenter over a generated AI image, a branded background, or another video layer. The result can include an alpha channel, which means it is ready to use in a composite inside Resolve.

05:03 And if the source clip is old or low resolution, upscale can help prepare it for a modern delivery format. It can boost footage up to 4K with the goal of recovering useful detail rather than only stretching the pixels. Now, let's move into the tools that help refine a shot. Draw to edit lets me mark an area directly on the frame and describe what should change.

05:26 I can sketch over an unwanted object, identify an area to replace, or add a new element to the scene. For this demo, I'll take a frame with a distracting object in the background. I'll brush over that area and describe the replacement, then I'll run the edit and compare the result with the original frame. The other workflow I want to show AI LUT Creator.

05:48 Color matching usually starts with a reference. That might be a frame from another shot, a photo, or a color palette that represents the mood I want. I can bring that reference into the AI LUT Creator, apply it to the footage, and generate a look that transfers tones, contrast, and mood into the DaVinci Resolve timeline. This is useful when I have multiple clips that were captured in different conditions, or when I want to quickly explore a visual direction before doing the final grade.

06:16 I would still treat the generated LUT as a starting point. The final result depends on the source footage, exposure, skin tones, and the creative direction of the project. But it gives me a practical way to move from reference to a usable look without leaving the color workflow. Higgsfield DaVinci Resolve plugins bring seven AI tools into the same application where you edit and color grade.

06:40 Generate AI video can create missing scenes, characters, camera moves, and B-roll from a natural language description. Generate AI image can create backgrounds, overlays, title cards, and other visual assets. Reframe adapts clips to multiple aspect ratios. Remove background isolates subjects. Upscale prepares low-resolution footage. Draw to edit changes areas of a frame.

07:05 And AI LUT Creator turns a reference into a color starting point. The biggest difference is where these tools live. You are not exporting clips to another platform, downloading results, and rebuilding the edit from scratch. You can make the AI request from inside DaVinci Resolve, and keep the result connected to the production workflow. To get started, download the installer from Higgsfield.

07:27 Make sure you are using the version of DaVinci Resolve downloaded from Blackmagic Design, rather than the App Store. And then open workspace, workflow integrations, and Higgsfield. If you want to try the Higgsfield DaVinci Resolve plugin, I've put the link in the description. The plugin works on macOS and Windows. That is the fastest way to see where it fits into your own workflow.