CASE STUDY · GREEN-SCREEN QUIZ SHOW

A pipeline built by hand, turned into recipes

A production company shot an eight-episode quiz show on green screen; the first episode's virtual set, in-show flow animations and sound placement were built step by step with Velvet, and every step was written into a recipe.

A green-screen stage with three cameras; the virtual set, in-show flow animation, Q&A graphic and sound track layered on top; 1 episode built by hand, 7 bound to the recipeGREEN SCREEN → RECIPECAMERASABCVIRTUAL SETFLOW ANIMATIONQ&A GRAPHICSOUND TRACK1 EPISODE BY HAND7 FROM THE RECIPE
Explanatory diagram · not a screenshot
147/151shots camera-aligned automatically: 110 minutes, 38 seconds per shot90/90Q&A graphics renewed, every one in place49 min → 95 sepisode breakdown; speakers identified from their mic track

The challenge

The material shot over 4 days had been split into 151 shots, and in every shot three things had to be right at once: the moving A camera's alignment with the 3D scene, where the in-show flow animations and question graphics sit in the edit, and which words belong to whom across five mic tracks. Each of these is done in a different application (Resolve, Cinema 4D, Unreal), and each would have to be done again for every episode.

Green-screen studio: crane camera A moving and tracked, B and C fixed, 5 mic tracks per takeSTUDIOGREEN SCREENSetA · crane, trackedB · fixedC · fixed5 MIC TRACKSPER TAKECAMERACRANE PATHSIGHT LINEMIC
Explanatory diagram · not a screenshot

The project

Show
8-episode TV quiz show; episode ≈ 49 min, 3 contestants, ~30 questions per episode
Shoot
Green screen, 4 shoot days; 3840×2160, 25 fps
Cameras
A: crane, moving, tracked; B and C fixed
Sound
5 mic tracks per take (host 2, podium, seats 2)
Edit
Rough cut in Premiere, handed to DaVinci Resolve Studio via XML
3D
Cinema 4D + Redshift: camera tracking, set and podiums, studio backdrop
Virtual set
Unreal Engine: in-show flow animations, video wall, 3D relief
Velvet
Desktop app + the Velvet agent running on the production company's own machine; recipe engine

What we did

From mic tracks to a recipe that drives Resolve, Cinema 4D and UnrealPIPELINEMic tracksBreakdownQuestion tableScriptRecipeResolveCinema 4DUnrealDATARECIPEAPPLICATION
Explanatory diagram · not a screenshot
151 shots: 147 aligned automatically in 110 minutes, 4 by handALIGNMENT151 SHOTS147 aligned automatically4 by hand110 min · 38 s per shotAUTOMATICBY HAND
Explanatory diagram · not a screenshot

Every step is a command run by the Velvet agent on the production company's own machine: nothing is written into the artist's file; the work happens on Velvet's copy.

1From audio to table

Input
5 mic tracks per take
Output
Speaker-attributed breakdown, question table, script along the edit timeline
Written into the recipe
Breakdown and speaker separation, from the mic tracks

49 min → 95 s episode breakdown, on the production company's own graphics card

Details

The raw mic tracks were transcribed in Velvet (the 49-minute episode in 95 seconds, on the production company's own graphics card); each speaker was identified from their mic track. Reading the breakdown, we drew up the question table and a script along the edit timeline: 30 question rows, each with the question, answer, score and card frames.

2The artist's method, as a recipe

Input
A 3.5-hour alignment session in Cinema 4D
Output
The solves of all three cameras in a single take file
Written into the recipe
The steps the artist took on each shot

147/151 shots aligned automatically; 38 s per shot

Details

A 3.5-hour camera-alignment session in Cinema 4D was recorded with Velvet's tracking plug-in; the steps the artist took on each shot were read and written, step by step, into the camera-alignment recipe. Then 147 of the 151 shots were aligned in one batch: 110 minutes, 38 seconds per shot; 4 shots stayed manual. The solves of all three cameras were gathered into a single take file.

3Graphics and in-show flow animations

Input
The question table and the flow animation rig in Resolve
Output
Q&A graphics and counters in place, studio backdrop approved
Written into the recipe
Animation + sound placement, graphic placement

90/90 Q&A graphics in place

Details

The Q&A graphics were placed with the new version, 90/90; the counters were set. The in-show flow animation rig in Resolve (579 controls) was measured, and animation and sound placement were bound to a recipe: for every moment of the show, which animation and which sound goes where is read from the table. The studio backdrop was approved in 12 rounds, with a palette deviation of 1.3%.

4The same scene in Unreal

Input
Camera, lens and sensor values from Cinema 4D
Output
A one-to-one scene and sequence in Unreal
Written into the recipe
Transfer of the scene into Unreal: camera, lens and sensor one-to-one with Cinema 4D

147 takes in the Unreal sequence

Details

A one-to-one scene was built in Unreal from the camera, lens and sensor values in Cinema 4D; the in-show flow animations and the 147-take sequence were laid in.

One question table feeding Resolve, Cinema 4D and Unreal, with the count each one receivedONE TABLE → THREE APPLICATIONSQuestion tableResolve248 graphics · 146 sound clips · 352 keysCinema 4D147 shot alignmentsUnreal147-take sequence
Explanatory diagram · not a screenshot

Resolve counts: Episode 2's single flow; Cinema 4D and Unreal: Episode 1.

Scale: 18,355 frames across 151 shots, about 12 minutes of A-camera plates at 25 fps; one dot is about 100 framesSCALE18,355FRAMES151 shots · 110 min1 DOT ≈ 100 FRAMES≈ 12 MIN OF A-CAMERA PLATES · 25 FPS
Explanatory diagram · not a screenshot

Timeline

Timeline: six stops from the site visit to the second episodeTIMELINE26–30 SEPSite visit andmeasurements3–4 OCTVelvet desktop app+ agent installed11 OCT3.5-hour alignmentsession recorded;backdrop approvedin round 1213 OCTBatch alignment147/15115 OCTScene and 147-takesequence in Unreal16 OCTSecond episode in asingle flow
Explanatory diagram · not a screenshot

Tools

Velvet desktop app and agent · Velvet recipe engine · DaVinci Resolve Studio · Cinema 4D + Redshift · Unreal Engine · Whisper (local GPU) · Premiere (rough cut)

Result

Episode 1 is largely done: 147/151 aligned, 90/90 graphics, backdrop approved, animations and sequence in Unreal. Every step done by hand became a recipe; the remaining seven episodes are bound to these recipes, their breakdowns and question tables are being prepared, and they are ready for production.

One shot on a log scale: by hand 54 minutes in one recorded session, with the recipe 38 seconds per shotONE SHOT: BY HAND ↔ WITH THE RECIPELOG SCALEby hand · recorded session, one shot · 54 minwith the recipe · per shot · 38 s10 S1 MIN10 MIN1 H
Explanatory diagram · not a screenshot

Recorded session · one shot: the manual value is one shot, not an average.

Recipes that came out of Episode 1

  • Breakdown Speaker-attributed breakdown from the mic tracks; the question table and script come from it.
  • Camera alignment From the artist's recorded session; 147/151 shots were aligned with it.
  • Flow-animation + sound placement For every moment of the show, which animation and which sound goes where is read from the table.
  • Q&A graphic placement Q&A graphics and counters; 90/90 in place.
  • Studio background Approved in 12 rounds; palette deviation 1.3%.

In Episode 2, 248 graphic pieces, 146 sound clips and a 352-keyframe in-show flow animation were laid in within a single Velvet flow.

What we learned

  • A recipe comes out of the artist's hands, not in place of the artist: record → read → recipe gave faster and more accurate results than "automation from scratch".
  • Lens distortion does not carry over in a pinhole camera: tens of pixels of drift in the corners, under half a pixel in the centre. The fix belongs in the render or comp layer.
  • One table feeding three applications was the decision that saved the most time: animation, sound and graphics are read from the same table.

Let's meet over your own project.

Tell us about your team and your production pipeline, and we'll show you together which steps can be bound to a recipe.

Request a demo

Script breakdown · Assets · Model options