We are getting there. Setting up for our Saturn3 Performance tomorrow in collaboration with Łukasz Szałankiewicz aka Zenial at Izlog Festival. The robots and the first of the three projectors are set up, just one projector for the top-down and the one for the face projection missing.
Preparing for Izlog Festival and our Saturn3 Performance on 2nd May, 10:00 pm, we are experimenting with face-tracking and real time projections onto our faces.
Yesterday night we made some first tests, using infra-red light and a filter for visible light on the camera, to track the face and its landmarks in real time, while the projection was projected back onto the face, being visible for the human eye, but not for the special camera.
It’s a first idea of how it will be when the robots take over and transform Łukasz Szałankiewicz aka Zenial into one of them during the Saturn3 performance, synthesizing sound depending on his emotions.
Preparing for Izlog festival, we just set up our working space in the gallery: Electronics are spread out, visuals projected onto the walls, the 3D-printer is printing, a lot to do, but a coffee in the sun with everybody is a fantastic break from time to time. 🙂
Currently we are working on making our Robot Swarm perceive humans. The vision sense of our robot is a camera; the robot sees its environment, but that alone is not enough. The robot needs to learn to differentiate a bit more.
Previously we used Python and could already detect emotions, but to be more flexible and have the possibility to have more control, we are porting our coding environment to c++.
With the goal to respond to human emotions the primary goal is to detect faces. In order to teach Robertina to identify a human face, we use the computer vision and machine learning libraries OpenCV and dllib.
And see what she can already perceive: That’s Adam and me and she can identify two heads and amazingly also our so called facial landmarks that play a relevant role in her future ability to actually perceive emotions!
The workshop gives an introduction to robotics, directional sound and visual control ranging from working with mechatronic systems to programming in processing and VVVV to cross-communication using open sound control.
We give an insight into our artistic practice and participants have the possibility to engage with 5 robots and use the tools we normally use to have a jam session together. This includes controlling the movements of the robots, the sound that is played and a custom made visual mixer.
~ 4 hours, start 2pm – open end evening
informal meet-up at the gallery space,
hands-on jam session: control robots + sound + visuals
Student Center, gallery
The work is coproduced at Kontejner within the framework of EMAP / EMARE and co-funded by Creative Europe.
Fritz Heider and Marianne Simmel’s analog overhead projector animations were already used in 1944 to demonstrate how easy it is for the observer’s brain to associate emotional attachment to inanimate objects and how our human brain is hard wired for compassion.
Empathy Swarm will transplant this from a digital to a physical environment by creating a swarm of robots that as a whole can adapt its behavior and interacts with the observer’s emotional feedback.
An inspiring and challenging conference in Helsinki asking real questions about the role and future of media art in Europe. Sara Cook gave an impressive overview about the history of media art and the challenges of it.
The conference was also the perfect opportunity to meet-up and discuss with all the EMAP/EMARE artists and organizations and to get to know each other’s projects. For the first time we also met the organizers of our residency from KONTEJNER.
“Sanatorium Dźwięku launched in 2015 in Sokołowsko is a festival dedicated to contemporary experimental music and sound art. Its main objective is to present the phenomena and trends in the 20th and 21st centuries, maintaining the balance between traditions of experimental music and the new, still structureless tendencies.” from http://festiwal.sanatoriumdzwieku.pl/en/ .
From stereo, multidirectional sound, to a sound beam of precision. Adam Donovan and Katrin Hochschuh offer a visual manifestation of what we hear, or as Gail Priest encourages us to question, sounds we may see and visuals we may hear. This brings the rare opportunity to sit with a precise point of sound as it moves through space. The Curious Tautophone robot is controlling the inputs here. I am mesmerized with the fine silver lines that form curves in constant motion, evolving in their formations. Some dancing toward the center, others away from it. Gliding and sliding as the sound too circulates, as I move in and out of conscious awareness of it. Both eyes and ears are invited to follow. Is my latent memory darting out before me, as I see spiders’ legs or feel fingers upon my skull? Lines flipping and flicking to create new shapes. Lines splaying from center to periphery or creating rings. The reflection of the metal robotic head running across the fine lines as circles dancing into and out of swirls. What Priest offered in her meditative voiceover tones I feel here in the constant flows of these fine lines.