Concatenative Video Synthesis (or Video Mosaicing)

Categories:
art, audio-visual, computer vision, technology, visual cognition
Tags:
audiovisual, computer vision, concatenative, mosaicing, object detection, synthesis, video, video processing

prototype

Working closely with my adviser Mick Grierson, I have developed a way to resynthesize existing videos using material from another set of videos. This process starts by learning a database of objects that appear in the set of videos to synthesize from. The target video to resynthesize is then broken into objects in a similar manner, but also matched to objects in the database. What you get is a resynthesis of the video that appears as beautiful disorder. Here are two examples, the first using Family Guy to resynthesize The Simpsons. And the second using Jan Svankmajer’s Food to resynthesize Jan Svankmajer’s Dimensions of Dialogue.