Turn any Image into 3D using AI! (ZoeDepth + After Effects)

BIGFILMS

BIGFILMS

14 min, 48 sec

The video demonstrates how to convert 2D images into 3D using AI tools and After Effects beta.

Summary

  • The presenter uses an image from their environment pack and Zoey Depth AI to create a 3D model.
  • The created 3D model is imported into After Effects beta for further manipulation and integration with green screen footage.
  • Several After Effects tools and techniques such as keying, masking, and camera movement are used to place a person into the 3D environment.
  • Adjustment layers and null objects are utilized for fine-tuning the scene and controlling the camera.

Chapter 1

Introduction to Converting 2D to 3D

0:00 - 11 sec

Introduction to the process of converting 2D images into 3D using AI tools.

Introduction to the process of converting 2D images into 3D using AI tools.

  • The presenter introduces the tutorial on turning 2D images into 3D.
  • An image from an environment pack is chosen to be converted into 3D.

Chapter 2

Converting with Zoey Depth AI

0:12 - 46 sec

Using Zoey Depth AI on Hugging Face to convert a 2D image to 3D.

Using Zoey Depth AI on Hugging Face to convert a 2D image to 3D.

  • Zoey Depth AI's website on Hugging Face is used for the conversion.
  • The selected image is uploaded, and the 'keep occlusion edges' option is selected before submitting.

Chapter 3

Reviewing the 3D Conversion

1:02 - 41 sec

Examining the converted 3D image and preparing to import into After Effects.

Examining the converted 3D image and preparing to import into After Effects.

  • Once the conversion is complete, the 3D image is interactive and can be manipulated.
  • The image is darker than the original, which will be corrected in After Effects.
  • The 3D model is downloaded as a GLB file for import into After Effects beta.

Chapter 4

Setting Up After Effects Beta

1:50 - 49 sec

Preparing After Effects beta for importing and working with 3D files.

Preparing After Effects beta for importing and working with 3D files.

  • The beta version of After Effects is required to handle GLB files.
  • Installation instructions for the beta version are provided.
  • The GLB file is imported and a new composition is created.

Chapter 5

Adjusting Composition Settings

2:41 - 42 sec

Adjusting composition settings in After Effects to match the footage.

Adjusting composition settings in After Effects to match the footage.

  • The composition settings are changed to match the frame rate and resolution of the green screen footage.
  • Orientation of the 3D image is corrected for proper viewing.

Chapter 6

Integrating Green Screen Footage

3:25 - 2 min, 20 sec

Keying and integrating green screen footage with the 3D background.

Keying and integrating green screen footage with the 3D background.

  • Green screen footage is scaled down and keyed out using Keylight, Key Cleaner, and Advanced Spill Suppressor effects.
  • A mask is created around the subject to remove unwanted elements from the footage.
  • The subject is placed into the 3D environment and adjustment layers are used to prevent clipping.

Chapter 7

Finalizing the Scene

5:47 - 8 min, 58 sec

Final touches to the scene, including camera movement and image quality improvements.

Final touches to the scene, including camera movement and image quality improvements.

  • A null object is added to control camera movement smoothly.
  • The camera is animated to create a parallax effect, enhancing the 3D feel.
  • A sharpen effect is applied to the adjustment layer to improve image detail.