Tchaikovsky becomes the starting point for a virtual concert
It was on Sunday, April 28 that Malmö Academy of Music Symphony Orchestra played Tchaikovsky's Fourth Symphony under the direction of conductor Daniela Musca at Malmo Live and the first recording test was done. The test is done within the work with Kalaudioscope/The Ludich Projects, which is a research and innovation initiative in collaboration between Lund University, Malmö Live Concert Hall/MSO, Axis Communications, Amazonas, Cinfo, Capgemini, Ericsson, Future by Lund and others. The projects aim to create completely new possibilities for a virtual experience using a combination of different recording techniques for sound and video. This makes it possible to sit at home on the couch and choose your own version of a concert — maybe even decide from which position in the concert hall you want to listen.
The project manager for the sound recording is Sebastian Hastrup.
- This may be one of the most comprehensive recordings of a symphony orchestra that has been conducted, both in the number of microphone capsules but also in terms of the breadth of different technologies. It was very exciting to coordinate and implement this project together with my audio colleagues. Our preliminary listening tests already show that there is great potential in the material specifically for Kalaudioscope, but also for many other educational and research scenarios in the future,” says Sebastian Hastrup.
The concert was recorded using a total of 176 microphone capsules in five different sound techniques and six AXIS cameras along with a 360° camera on stage. The various recording techniques for sound are: Decca Tree, which is one of the traditional techniques for recording symphony orchestras, High Order Ambisonics which provides both a high-resolution 360-degree representation of the recording location as well as the ability to focus on specific sound sources, Binaural recording which involves an artificial human head with microphones placed in the ears. This technology is based on HRTF (head-related transfer function) which is a transmission function that describes how the human stereo hearing works, and finally a special recording technique designed by Yann Coppier, researcher at Lund University/Malmö Academy of Music, where 16 round recording microphones are placed around the concert hall. Finally, a physical “clap” of the type used for film recordings was also used to allow all recordings (sound and image) to be synchronized with the same starting point. Among the experts in the recording group is Nedelko Grbic, a specialist in signal processing. He processes all the signals in retrospect so that they become synchronized.
The recording was made to explore which recording technique, or combination of recording techniques, works best to “zoom” sound in an immersive production to create material for a comprehensive virtual production. This also includes a test of which technology provides the best sound quality when “zooming” sound, which is needed to amplify the experience of the home audience. On the fourth of June, an open workshop will be held where there will be an opportunity for a first try-out at Malmö Live. Prior to the workshop, the material is evaluated and processed so that participants can experience different versions and explore the interactive potential of streamed concerts. Work on the recording is funded by Region Skåne/ERDF.
The thematic collaboration initiative is coordinated by Jesper Larsson, who has a solid background in the cultural sector from previous directorships of Malmö Live and Kulturhuset Stadsteatern in Stockholm and now works at the Faculty of Arts at Lund University.
- Through Kalaudioscope, we want to democratize the concert experience in order to reach many more people with the publicly funded culture. With the technology of the future, we can become much more accessible and offer many more versions and perhaps even co-create with the audience and find new artistic formats. At the workshop, we will both try prototypes of possible experiences and discuss what further development is needed,” says Jesper Larsson.
The workshop is free of charge and is mainly aimed at those who work with developing live experiences or areas that are tangential to this (musicians, VR, business models, platforms, etc.) but also of course those who represent the audience perspective. Sign up here
The Ludich project aims to create the best possible conditions for a new generation of digital live performances. In the project, the actors work with interactive streaming solutions and digital formats that allow the user to choose and customize their concert experience. This will be possible with the help of the latest technology and the combined expertise of the project's collaboration partners, which are six faculties at Lund University, Malmö Live Concert Hall/MSO, Axis, Amazon, Cinfo, Capgemini, Ericsson, Future by Lund, Helsingborg Arena and Stage and Science Village Hall.
Read more: Lund University Digital Interactive Concert Hall - LUDICH
