.tech · experiments

Add music to a video

A scene-by-scene score for one public-domain film — Gemini reads the film into cues, we match each cue to catalog music.

An Unseen Enemy 1912 · D.W. Griffith / Biograph · Lillian & Dorothy Gish on Internet Archive ↗

Click a scene to jump the film; click a ▶ track to hear it.

loading scenes…

How scene matching works

Gemini watches the film and breaks it into cues — not just at visual cuts, but wherever the music should turn: a character's mood shifting, a hidden threat revealed, a room emptying out. Each cue comes back with a primary emotion and a short description. The four cues tagged Internal Narrative Shift are the interesting ones — the cut alone wouldn't tell you the music needs to change, but the story does.

We take each cue's emotion and description and match it against our scene ontology — 70 cinematic scene types, each with its own sonic character (energy, instrumentation, mood). The closest scene resolves to the catalog tracks that fit it; click a track to hear it under the film.

← all experiments