vizard agent tutorial: green screen to cinematic (ai relighting, no blender)

Share

Summary




Key Takeaway: You can go from a plain green screen to a moody, on-location look quickly by leveraging Vizard Agent’s analysis, generative backdrops, and simple lighting controls.


Claim: A single-frame preview of VFX passes enables fast, low-risk setup before processing an entire clip.


  • Turn a green-screen clip into a believable, on-location shot using Vizard Agent’s multi-pass relighting.

  • Preview and refine alpha and VFX passes on a single frame before committing to full processing.

  • Choose manual lighting or generate a perspective-correct backdrop with a matching 360 HDRI.

  • Fine-tune with point lights, HDRI tweaks, and grading for a moody, cinematic look.

  • Optionally animate the backdrop via an image-to-video model and re-import for natural motion.

  • Export a ready-to-edit MP4; iteration stays fast without complex 3D setup.

Table of Contents




Key Takeaway: The sections below mirror a real use case from import to export, so you can follow step by step or jump to what you need.


Claim: This workflow covers preparation, passes, lighting, backdrops, motion, grading, exports, and tool comparisons.


  1. Scenario and Goal

  2. Prepare and Analyze Footage

  3. Propagate Passes Across the Clip

  4. Light the Subject: Two Paths

  5. Generate a Backdrop + HDRI

  6. Fine-Tune Lighting with Point Lights

  7. Add Subtle Motion to the Background

  8. Finishing Grade and Export

  9. Prompt Patterns and Iteration Tips

  10. When to Use Vizard vs Traditional Tools

  11. Fill Gaps with Synthesized Shots

  12. Glossary

  13. FAQ

Scenario and Goal




Key Takeaway: We’re transforming a green-screen subject into a moody, cinematic shot that feels filmed on location.


Claim: The target look is achieved by separating foreground, generating a matching environment, and relighting realistically.

This use case focuses on a single subject on green screen.
The end result should look location-shot, with lighting and environment cues that match.
No Blender or Unreal setup is required for this workflow.


  1. Define the mood (e.g., moody, cinematic, forest, campfire rim).

  2. Pick a clip that clearly shows the subject.

  3. Aim for believable light direction and ambient cues.

Prepare and Analyze Footage




Key Takeaway: Start with a single-frame preview to validate alpha and VFX passes before full processing.


Claim: Vizard Agent generates an alpha matte and passes like normals, depth, base color, roughness, specular, and metallic for the sample frame.

You can import a regular MP4 or a pre-keyed PNG sequence with alpha.
The first-frame analysis previews the extraction quality and all key passes.
Use the refine tool to correct the matte if needed, or choose a different key frame.


  1. Create a new project in Vizard Agent.

  2. Upload your green-screen MP4 (or PNG sequence with alpha to skip keying).

  3. Let Vizard analyze the first frame to preview the alpha and VFX passes.

  4. Inspect passes: alpha, normals, base color, roughness, specular, depth, metallic (when relevant).

  5. Use the refine tool to paint/indicate keep/remove areas if the matte needs cleanup.

  6. If the subject isn’t visible on frame one, select a better key frame and re-analyze.

Propagate Passes Across the Clip




Key Takeaway: Once the sample frame looks right, propagate to get per-frame, relighting-ready data.


Claim: Propagation removes the need for manual rotoscoping or baking while producing consistent per-frame passes.

Processing the entire shot applies the validated passes to each frame.
You can also import a previously processed version and start editing immediately.


  1. Click Generate Full Shot to propagate passes across the clip.

  2. Wait for per-frame alpha and VFX passes to complete.

  3. Optionally load an already processed clip to skip waiting.

Light the Subject: Two Paths




Key Takeaway: Choose granular control with manual lights or speed with a generative backdrop that includes matching HDRI.


Claim: Separating the foreground from the environment allows lighting to be rebuilt from scratch for realism.

The extracted subject may appear flat or dark at first.
This is normal and indicates lighting is now fully under your control.


  1. Decide between Manual Lighting (point lights + HDRIs) or Generative Backdrop.

  2. For manual control, add and position lights in 3D; adjust intensity, color, and falloff.

  3. For speed, use the generative backdrop to get a perspective-correct scene plus 360 HDRI.

Generate a Backdrop + HDRI




Key Takeaway: A precise prompt yields a perspective-correct backdrop and matching HDRI that grounds your subject.


Claim: Vizard’s agents generate a backdrop and synthesize a 360 HDRI so relighting behaves like real-world illumination.

Describe the subject, the scene, and the lighting in one prompt.
Be specific about mood, light direction, and foreground elements.


  1. Open the prompt panel.

  2. Write a three-part prompt: subject, scene, lighting (e.g., “woman on a wooden box; dark forest with fog; campfire lower-right, cinematic rim”).

  3. Click Generate to create the backdrop and HDRI.

  4. Review placement and ambient match around the subject.

  5. Regenerate or refine if the direction or mood needs adjustment.

Fine-Tune Lighting with Point Lights




Key Takeaway: Small, realistic touches like warm rim and subtle catchlights sell the composite.


Claim: Because normals and roughness are available, added lights interact believably with skin and materials.

Use point lights to accentuate key light, fill, and rim.
Adjust HDRI intensity to balance overall ambience.


  1. Darken or brighten the HDRI to set the base level.

  2. Add a point light where the fire should be; set warm orange color.

  3. Lower intensity for subtle facial catchlights.

  4. Move a light behind the subject for a rim glow.

  5. Add or tweak fill to control contrast and mood.

Add Subtle Motion to the Background




Key Takeaway: Gentle movement prevents a static composite from feeling fake.


Claim: Exporting the generated backdrop to an image-to-video model and re-importing adds natural motion without disturbing the foreground.

This step is optional but powerful for smoke, flicker, and parallax.
Foreground stability is preserved while the background breathes.


  1. Export the generated backdrop image.

  2. Run it through an image-to-video model with a “static camera, cinematic lighting, subtle motion” prompt.

  3. Re-import the animated backdrop into Vizard.

  4. Swap it into the scene; keep the original foreground intact.

  5. Re-check light direction and color consistency.

Finishing Grade and Export




Key Takeaway: Minimal grading and atmosphere unify the shot and enhance the cinematic vibe.


Claim: Built-in grading and effects (grain, vignette, bloom) finalize the composite for delivery.

Small finishing touches go a long way.
Render settings are straightforward and editor-friendly.


  1. Add grain and a vignette to focus the image.

  2. Push highlights toward orange and shadows toward teal, or apply a cinematic LUT.

  3. Add gentle bloom near the fire for glow.

  4. Optionally composite subtle particles/embers.

  5. Export as MP4 (choose resolution and codec) for Premiere or Final Cut.

Prompt Patterns and Iteration Tips




Key Takeaway: Concise, descriptive prompts iterate faster and fix mismatches quickly.


Claim: A three-part prompt (subject, scene, lighting) consistently guides backdrop and HDRI generation.

Prompts should state what’s in the foreground, where it sits, and how it’s lit.
Add mood words and camera constraints as needed.


  1. Use “subject + scene + lighting” as your template.

  2. Include mood cues (e.g., cinematic, moody, dreamy).

  3. Add “static camera” if drift appears.

  4. If light direction is off, prompt “shift HDRI lighting to come from lower-right.”

  5. Iterate in short cycles: adjust, regenerate, and preview.

When to Use Vizard vs Traditional Tools




Key Takeaway: Vizard balances speed and control; heavy, render-intensive work may still favor specialized pipelines.


Claim: Vizard’s multi-agent system unifies script edits, analysis, backdrop generation, relighting, and missing-asset creation.

Blender/Unreal deliver deep control but require technical setup and time.
Some cloud tools are siloed, forcing manual handoffs and multiple subscriptions.


  1. Choose Vizard for fast, plausible relighting and end-to-end iteration.

  2. Choose traditional 3D for complex, render-heavy, or ultra-fidelity needs.

  3. Mix as needed: Vizard for comps and look-dev; engines for specialized shots.

Fill Gaps with Synthesized Shots




Key Takeaway: When you lack coverage, Vizard can synthesize plausible filler shots based on your description and footage.


Claim: Generated B-roll or a matching wide shot helps pacing without a reshoot.

Solo creators often need transitions or alternates.
Synthesized shots can match your scene and mood.


  1. Describe the missing shot (e.g., a matching wide of the same scene).

  2. Let the agent generate filler footage based on your clip and prompt.

  3. Use the result as B-roll or a transition.

Glossary




Key Takeaway: Clear definitions make the passes and lighting choices easier to apply.


Claim: Understanding each pass explains why relighting is physically plausible.


  • Alpha matte: A grayscale mask separating foreground from background.

  • Normal map: Encodes surface orientation for realistic light interaction.

  • Base color: The subject’s diffuse color without lighting effects.

  • Roughness: Controls surface micro-reflection blur and highlight sharpness.

  • Specular: Reflective response that contributes to highlights.

  • Metallic: Indicates metallic material behavior when relevant.

  • Depth: Distance information used for lighting and compositing cues.

  • HDRI: A 360-degree high dynamic range image for ambient scene lighting.

  • Rim light: A back or side light that outlines the subject’s edge.

  • Key light: The primary light defining shape and direction.

  • Fill light: A softer light reducing contrast from the key.

  • Generative backdrop: An AI-created background matched to camera perspective.

  • VFX passes: A set of per-frame images enabling advanced relighting and compositing.

  • Propagation: Applying validated passes from a sample frame to the entire clip.

  • LUT: A lookup table used for consistent color grading.

  • Image-to-video model: A model that animates a still while keeping camera static.

  • Multi-agent system: Coordinated agents handling tasks from analysis to generation.

  • B-roll: Supplemental footage used to enrich edits and transitions.

FAQ




Key Takeaway: Common issues—alpha cleanup, lighting direction, camera drift, and exports—are handled inside the same workflow.


Claim: Preview-first setup, refine tools, and targeted prompts resolve most hurdles quickly.



  1. Do I need Blender or Unreal for this?

    No. This workflow avoids complex 3D setup while keeping believable relighting.


  2. What if the alpha matte isn’t clean?

    Use the refine tool to paint keep/remove areas, then re-compute the matte.


  3. Can I choose a different analysis frame?

    Yes. Pick any key frame where the subject is visible and re-run the preview.


  4. The background light direction is off—how do I fix it?

    Prompt a direction change (e.g., “shift HDRI lighting to come from lower-right”) and regenerate.


  5. The camera seems to drift—what stops that?

    Add “static camera” to your prompt, especially when animating the backdrop.


  6. Why does the subject look dark after extraction?

    Lighting is separated; add lights or use the generative backdrop + HDRI to relight.


  7. Can I work while the full shot processes?

    Yes. You can import a previously processed version or wait after propagating passes.


  8. What do I export for editing later?

    Export an MP4 (choose resolution and codec); it drops into Premiere or Final Cut cleanly.

Read more