Work> Phototropic Synesthesia
A (Design) work inspired by agriculture and daily life, released in 2018.
#In-situCreation #NDI #GrayCodePatterns
As an entry corridor to the exhibition, the team attempted to create immersive “Rinsing Sensory” experience, so as to deconstruct the normal cognition of the audience on exhibition centers and complete a special welcoming flow in all aspects, from visual and auditory aspects to spatial and atmospheric aspects
With“Phototrophic Plants”as the main concept, image designs are projected onto plants, translating and enhancing the attitude and traits of the four main characters:“Rice, Fruits, Mushrooms, and Tea Leaves.” Using the monitors as a patchwork through the corridor, through continually stacked and abundant images, along with unending compression of space, a fantasy blend of“organic”and“geometric”coexistence. This will allow the audience to obtain a sense of openness in all areas when entering the indoor exhibition area.
To meet the project's demands, visual effects were developed specifically for plants on-site. Since the work had to be done outdoors at night to avoid light pollution, time was limited. To tackle these challenges, two tools were created:
- Projector-Camera Calibration Using Gray Code Patterns
This technology allows visual effects personnel to simulate how images appear from the projector's perspective. Gray code patterns are projected onto the plants, and a camera records the patterns. Using computer calculations, the camera's view is converted into the projector's perspective. Existing tools lacked colour and accuracy, so a custom solution was developed to meet higher quality requirements.
- Real-Time Visual production Using NDI
To streamline the process, a system was created for real-time projection editing. Plugins for software like Photoshop and After Effects enable instant visual updates to the projection system without repeated exporting. Using NDI technology for image transmission, the system also supports a wireless workflow via Wi-Fi.
Let's connect
Curious about this piece or need it for a show? Reach out—we'd love to chat.
#InteractiveTheater #GenerativeArt #ParticleSystem