The art installation, Un:Heard Resonance, stirred up quite an interest among attendees at last month’s Northern Spark 2017. While among other exhibits surrounding the major theme of climate awareness, this interactive display granted attendees the ability to hear and visualize the “unheard” through subtle “resonances” from human interaction with plants, water, rocks and more. The resonant signals were then transferred to technological systems that allowed artists John Keston, Lucas Melchior, Mike Hodnick, and Chris Leblanc to manipulate and perform each interaction through audio and video mediums.
I had the opportunity to ask a few questions with lead video engineer and co-creator, Chris Leblanc. The following Q/A are the results of that interview.
Q: What is Un:Heard Resonance?
A: The piece was an interactive art installation that allowed attendees to perform on custom electronic instruments and feed the sounds into a larger system for processing. The sounds could then be altered, re-looped and sampled by our team of 3 sound artists before hitting the speakers, while each movement built up layers and layers of expanding soundscapes. The video portion had corresponding patches for each movement in the piece to follow the theme. It also reacted to the sounds that attendees were making. Our project focused on musical movements in the themes of Geology, Biology, and Technology, rotating every 15 minutes for 9 hours from sunset to sunrise Saturday night.
Q: Can you tell us how Un:Heard Resonance became an exhibit at Northern Spark?
A: John Keston has performed at several Northern Spark festivals now and our involvement began when the Weismann Art Gallery decided to have John’s piece outside at the entrance of their building during Spark. I’ve attended the festival for several years and think it’s one of the best showcases for the Twin Cities art and technological creativity. Plus, it has always been entirely free to attend so it’s a great community event.
Q: What inspired you to get involved with this project?
A: John Keston pulled me in early to his project when he decided that eye-grabbing video would add to the overall presentation and help pull people towards the piece. His main idea behind the project was to have three different movements of a musical piece that would rotate every 15 minutes for the nine hours that the festival lasted. The three movements were “Geology,” “Biology,” and “Technology.” The Northern Spark overall theme this year dealt with climate change, and our project reflected a few facets influencing it. An underlying theme of the project was that technology may not save our species, and that it actually has great potential for total devastation of both geological and biological processes.
Q: What was the overall message you were trying to convey with this piece?
A: From the main designer John Keston:
“The project will bring awareness to sonic activity rarely experienced within the environments we live in. The combination of micro-sonics and accompaniment will non-verbally stress hidden geological processes, the fragility and jeopardy of the ecosystem as it faces climate change, and the rapid, global expansion of technology. It will also imply that technology may eventually replace the geological and biological states of the world. A precedent for this idea resides in the concept of “Computronium” theorized by Norman Margolus and Tommaso Toffoli at MIT, a hypothetical state of matter that would yield the most efficient and powerful atomic arrangement for computer processing. The Geology and Biology sonatas represent the first two sequential stages in the evolution of the planet, while Technology suggests the dystopian possibility of the world becoming a giant computer that no longer supports life as we know it.”
Q: How long did it take you and your team to develop this interactive display?
A: John had been developing the concept behind the project for about a year and the development of all of the instruments and construction took about a month. My video patch took about 3 weeks to plan.
Q: What experiences might someone have if they were to stop by your art installation? What kinds of interactions could you experience with the different pieces?
A: The geology portion used contact microphones embedded in a sandbox, attached to rocks, and within a water system to make very percussive sounds. Attendees could hit the rocks together or slide them along one another for different sounds. There was a drummer that showed up and he was banging the rocks together like it was a drum kit while the sound artists in back mastered the different sounds and looped the beats into a frenzied rhythm.
The biology portion had three houseplants, each with a different take on a touch responsive synthesizer. You could touch the plants in different ways to make different sounds. One of the plants would sort of scream if you grabbed it, which was pretty funny. There was also a custom synthesizer made by Mike that used a wireless brainwave sensor headset to read 7 different types of brainwaves and shape the sound of the instrument depending on what you were thinking about. It was a really wild concept that worked beautifully in the project’s context. Mike is a total mad scientist.
The technology portion let people use a light sensor to play chasing LEDs as an instrument, and also picked up electromagnetic interference from people’s cell phones. It was an ominous and droning effect that played into the cautionary message.
Q: Is this all original programming? What was used?
A: All of the synths and instruments were custom pieces by the sound team. There were four arduinos powering most of the audio portion. My video setup was the Nintendo I modified, a box by Tachyons, and the heart was the LZX modular system. There were also 2 old video mixers in there too. (Chris, can we add the video mixer equipment titles? – VR50 Switcher?? Etc? )
Q: How did you decide what sounds/video paired with each of the different types of interaction?
A: The geology section was extremely percussive because of the contact microphones on the rocks, and I used live video of rotating fossils and stone slices processed and colorized for texture.
The biology section was very lively and had a variety of types of synth sounds to represent the lush diversity of life on earth and its constant activity. For the video portion, I used a video microscope with various biological specimens for textures.
The technology section had sharper sounds and underlying ominous drone. The video blended live shots of performers being keyed through the Nintendo’s glitch textures.
Q: Can you give us a brief break down on what you had in your video rig?
A: My video system had a larger “master” element where the signals were all blended by older Roland VJ mixers and fed into the LZX modular system. The modular is the heart of my whole system, and it gets blended with feedback loops and a glitch effect box which introduces controlled chaos into video signals.
There were three sub-mixed systems, one for each part of the movement. For geology, I used a visual presenter light box with spinning agate slices and fossils mixed into video of people performing live. For the biology patch, I was using a cheap video microscope to feed magnified images of biological laboratory slides into the system as textures. For the technology movement, I blended textures generated by a 30-year old Nintendo that I circuit bent. It has a patch bay that connects different points on the graphics circuits that weren’t meant to be connected. It generates very glitchy sprites that dance around unpredictably. Anyone who approached my video system and asked me about it was handed a Nintendo joystick and told to help build some textures!
All my gear runs on ancient composite video standards, which is analog and lets you build video content immediately without any latency whatsoever. The analog signal path also means that the modular video system operates a lot like a traditional audio synthesizer, where shapes, waves and animation are all constructed from voltages.
Many people in live video have obviously abandoned hardware entirely in favor of high powered computer systems and software, but there is great artistic potential in a hardware approach. The glitch processors offer a method of what I would consider a “pure” form of video glitch art, where chaos enters the system as the system and circuits are not functioning properly. You are just guiding them into not working properly the way you want in a trial and error method.
Q: Tell us about how you performed the video footage?
A: My video portion was all hardware based, with analog modular synthesis and modified video equipment from the 90s for glitch effects. I blended a camera feed of people interacting with the machines with live images of fossils, agate slices, microscope slides of dog stomachs etc. I also had a glitched out Nintendo I built, which went over well in the technology section.
Q: Did you have a personal favorite moment that you experienced in your live performance?
A: Probably when the drummer was banging out beats using the rock microphones.
Q: Was this your first interactive exhibit?
A: I approach each time I run live videos for a musician as an interactive piece, since my gear reacts to the audio of a room and blends it with various camera feeds of the environment. If all of your content is being made live then it has to be more interactive by nature, since you’re making it all in response to whatever else is going on.
Q: How does it feel witnessing the public interact with your exhibit?
A: This project was a larger scale than what I usually work on for my art video so it was really overwhelming at times. It was extremely satisfying to have a constant stream of people showing up and finding new ways of playing these strange instruments. Northern Spark is great because it’s a night where the entire city seems to embrace the weirder end of art and really stay up all night and celebrate it.
Overall I think they liked it. I didn’t hear any complaining and no one smashed anything!
Q: What’s next? Where can we find more of your work?
A: I perform around town at various music venues when I’m not on work shows performing collage or liquid lightshow based video. I work with electronic musicians and psych rock bands mostly. Come say hi if you see a guy sweating over half of a 1980s broadcast studio in your favorite venue.
Contact Jess at firstname.lastname@example.org or feel free to connect on Linkedin.
Latest posts by Jess Tauber (see all)
MINNEAPOLIS, MN – May 16, 2017
“With the amount of video deployed in our events, d3 has been crucial in reducing the overall time to map and previsualize content. Specifically, with unique LED configurations, the 1:1-pixel mapping capabilities work great. It’s great to have a single media server that provides us with 16 HD outputs (or up to 4-4K outputs) while being able to deliver lightning fast content transfers live to the server with its 10-gigabyte network switch.” says John Bulver, Video Manager, Showcore, Inc.
Showcore year-in-year-out re-invests a substantial portion of its profits directly back into event technology such as the d3 media server. “We went with the d3 platform to expand what we’re capable of designing and delivering for our clients.” says President/CEO Steve Devries.
Why d3 Technologies: (www.d3technologies.com)
The world’s first integrated video production suite, d3 is more than just a media server. Based around a real-time 3D stage simulator, it is the single solution needed to design, present, communicate, sequence and playback your show. d3 lets you work with props, venues, LED screens, projection, lighting and moving stage elements while being completely integrated into a single intuitive software solution that runs on your own laptop or dedicated d3 hardware.
Media Contact: Jack Devries, Director, Showcore, Inc. | 651-587-0425| email@example.com
How to work with your production partner to make your event a success.
A production partner can make or break the event of your dreams. Here are some tips for the best ways to engage with them.
Bring them in early:
It is common practice to do all the front-end work for a meeting or event and then turn to your production partner in the final stages of planning. In order to get the best value and service, bring them in as early as you can. There are so many decisions that take place in the planning process that can drastically affect what your production partner can bring to the table. Some of your best ideas may not work for various technical reasons (such as ceiling height). Wouldn’t it be nice to determine that as soon as possible?
Be open about your budget:
This knowledge gives your production partner the ability to provide the most value for your investment in order to meet or exceed your expectations. The environment’s look and feel has a lot to do with this level of transparency. Just like building a house, the décor elements for the interior of your home will be selected based on what your budget will allow. Similarly, with a trusted AV partner, they will provide the best solution and service for the price point your client can afford. This creates alignment and establishes a stronger relationship.
St. Paul, MN (PRWEB) June 13, 2013
Showcore is proud to announce that it has won the award for Best New Innovative Product or Service for Industry Associations from the Midwest Society of Association Executives (MSAE) for its experiential event design platform, Audience EncapsulationSM. The MSAE award was given to the company that had the best new format, concept or offering that makes a positive impact on associations.
Associations are faced with the constant challenge of attendance since many members have alternatives to spending time and money to attend an event, so it is imperative that they continue to engage attendees and provide them with an ‘experience’. That is where Audience Encapsulationsm comes in. Judges determined that Showcore had the best innovation based on the following criteria: Inspiration, Distinctiveness, Creativity, Source of Creation & Development, Ease of Use, Overall Effectiveness and Impact on the Association Industry. (more…)
St. Paul, MN (PRWEB) July 10, 2012
Showcore, Inc. announced today that it has extended its event services footprint to reach over 30 international markets across the globe. As a leading event design and production company, this initiative was spearheaded in response to customers that continually needed support in their market expansion plans. As customers continue to extend their markets, and enter their products and services in a particular market, it was obvious they have the same needs to execute special events, corporate meetings, and marketing initiatives as they do in the U.S.
“Our global event services have become even more important to our customers as they continue to nurture and grow their sales and marketing operations overseas. Now U.S. companies no longer have to worry about how they will be supported when they are faced with an event project in another country – or vice versa for their European operations”, stated Steve De Vries, President of Showcore. “It goes without saying…we pride ourselves on making our customers’ event projects seamless”, added De Vries. (more…)
(PRWEB) May 29, 2012
As the saying goes…content is king…and marketers are faced with and continually striving to find new ways to engage consumer audiences. In turn, as audiences become more technology savvy and become accustomed to immediate stimulation, it becomes more important to engage them in diverse settings. This means designing visual and sensory environments that engage ever-shrinking attention spans by delivering messaging in new compelling ways.
These newer technologies are allowing marketers the ability to build differentiation within their market segments because their imagination is no longer bound by real-world reality. As the need for new interactive and experiential environments has increased – savvy brand marketers will look to 3D video mapping technologies to present content to drive brand messaging to engage target audiences like never before. (more…)
St. Paul, MN (PRWEB) April 12, 2012
Garners Best ISES Team Effort Award
ISES MINNESOTA STAR AWARDS FOR 2011
I believe that the interactivity and informal setting truly represents the future in corporate communication and outreach.
Showcore Inc., a leading event design and production company, announced today that it was awarded, along with its other teaming members, the Team Effort Award for 2011. The ISES Star Awards represents an opportunity for event designers and production companies to gain recognition for the fabulous events they create, plan, manage, and execute each year. The project for a medical manufacturer brought together a group of best-in-class service providers that provided a new concept in the way corporate events engage their audiences.
Is Audience Boredom Killing Your Meetings and Events?
Not Anymore! Showcore’s Audience Encapsulationsm Event Design
Platform Engages and Captivates Audiences!
St. Paul, MN (PRWEB) March 7, 2012. Showcore, Inc., a leading event design and event production company announced the formal launch of their Audience Encapsulation™ design services platform. Audience Encapsulation™ was developed to address the limited attention spans of today’s audience members which have grown accustomed to interactive and sensory interactions that are the result of our technology culture. (more…)
Showcore Supports Event With New Listen Technologies Wireless Conferencing Solution Showcore , a cutting-edge event design services provider has partnered with Listen Technologies to add Wireless Conferencing products into their professional inventory to meet the audio needs of their customers that have meetings and events in conference centers or anywhere that running cable is difficult, simply not feasible, or situations that require rapid deployment.
Bluffdale, Utah, USA — Showcore has added a new line of multi-band Wireless Conferencing products to its rental inventory. Confidea® delivers a highly reliable communication solution for meetings and events where participants need to hear and be heard. (more…)