{"id":2632,"date":"2011-08-08T15:09:00","date_gmt":"2011-08-08T22:09:00","guid":{"rendered":"https:\/\/pkmital.com\/home\/?post_type=pkm_artwork&p=2632"},"modified":"2023-08-16T11:43:07","modified_gmt":"2023-08-16T18:43:07","slug":"early-visual-synthesis-works","status":"publish","type":"pkm_artwork","link":"https:\/\/pkmital.com\/home\/works\/early-visual-synthesis-works\/","title":{"rendered":"Early Visual Synthesis Works"},"content":{"rendered":"\n

This collection of early works represent Mital\u2019s explorations of image and video synthesis, primarily throughout the course of his doctoral studies and the development of his thesis on Computational Audiovisual Scene Synthesis<\/a>. In this series, Mital reconstructs diverse visual content ranging from personal memories to iconic art and presents outputs ranging from still and video artworks to procedural augmented reality experiences. <\/p>\n\n\n\n

Nanital | 2013<\/h3>\n\n\n\n

Footage from Mital\u2019s parents\u2019 honeymoon following their arranged marriage are generatively collaged with the colors of Indian wedding ceremonies. <\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n
\"\"<\/a><\/figure>\n\n\n\n

Visual Synthesis Experiments | 2013<\/h3>\n\n\n\n

Early experiments in Mital\u2019s process for creating visual syntheses. These experiments can be seen as early sketches in form, exploring texture, color, and different palettes.<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n
\"\"<\/a><\/figure>\n\n\n\n

Augmented Reality | 2013<\/h3>\n\n\n\n

One of the earliest video examples using a procedural augmented reality. In this video, a Vuzix Wrap 920AR augmented reality device is used to stream the video content from 2 head mounted cameras attached in front of the screen being displayed to each eye. The resulting images are shown here for one eye only. As the algorithm has no semantic knowledge, the resulting syntheses cannot differentiate different letters on the keyboard, though still manage to use its proto-object representations to collage together a single key across an entire keyboard.<\/p>\n\n\n\n

\n
\n
\"\"<\/a><\/figure>\n\n\n\n
\"\"<\/a><\/figure>\n<\/div>\n\n\n\n
\n
\"\"<\/a><\/figure>\n\n\n\n
\"\"<\/a><\/figure>\n<\/div>\n<\/div>\n\n\n\n

Realtime Visual Smash Up | 2012<\/h3>\n\n\n\n

Realtime Visual Smash Up presents a system for realtime mosaicing of visual content. The system learns objects from the camera image and displays the resulting visual mosaic. Only unique objects are learned creating a hallucinatory resynthesis of the original camera image. For instance, all keyboard letters are replaced by only a single letter since based on purely visual appearance, a single letter is unique enough to portray the keyboard.<\/p>\n\n\n\n

\n
\n
\"\"<\/a><\/figure>\n<\/div>\n\n\n\n
\n
\"\"<\/a><\/figure>\n<\/div>\n<\/div>\n\n\n\n
\n
\n
\"\"<\/a><\/figure>\n<\/div>\n\n\n\n
\n
\"\"<\/a><\/figure>\n<\/div>\n<\/div>\n\n\n\n

Mona Lisa vs. Arcimboldo | 2012<\/h3>\n\n\n\n

The works of the 16th century Mannerist painter Giuseppe Arcimboldo are shaped to resemble one of the most iconic portraits in history, Leonardo da Vinci\u2019s Mona Lisa. Arcimboldo, known for his composite head portraits which mold faces from fruits, vegetables, flowers, and other objects, defied the figurative conventions of his time, deconstructing their very essence into an outlandish representation of a portrait. In a 16th century head nod to the painter, Mital extracts and deconstructs the same elemental proto-objects, redefining them to resemble the timeless Mona Lisa.<\/p>\n\n\n\n

\n
\n
\"\"<\/a><\/figure>\n<\/div>\n\n\n\n
\n
\"\"<\/a><\/figure>\n<\/div>\n<\/div>\n\n\n\n
\n
\n
\"\"<\/a><\/figure>\n<\/div>\n\n\n\n
\n
\"\"<\/a><\/figure>\n<\/div>\n<\/div>\n\n\n\n

Harry Smith vs. Pink Elephants | 2011<\/h3>\n\n\n\n

A perceptual model based on proto-objects is presented as a visual reconstruction of Harry Smith\u2019s Early Abstractions. Mital trained the model on a scene from Dumbo, Pink Elephants, asking it to interpret Harry Smith, having only knowledge of Dumbo. The reconstruction is surprisingly able to capture a wide variety of the abstract images and movements in Harry Smith, as well as capture after-image. This model is an early prototype of Mital’s PhD work on visual resynthesis.<\/p>\n\n\n\n