Episode 74 Agnieszka Roginska (NYU)

Interactive Audio

Viewing posts tagged Interactive Audio

Episode 74 Agnieszka Roginska (NYU)

Summary

This episode is sponsored by Spatial, the immersive audio software that gives a new dimension to sound. Spatial gives creators the tools to create interactive soundscapes using our powerful 3D authoring tool, Spatial Studio. Their software modernises traditional channel-based audio; by rethinking how we hear and feel immersive experiences anywhere. To find more, go to https://www.spatialinc.com.

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by the Professor of Music Technology at NYU – Agnieszka Roginska, from New York, US.

Agnieszka Roginska is a Professor of Music Technology at New York University. She conducts research in the simulation and applications of immersive and 3D audio, including the capture, analysis and synthesis of auditory environments. Applications of her work include AR/VR/XR, gaming, mission-critical, and augmented acoustic sensing. She is the author of numerous publications on the topics of acoustics and psychoacoustics of immersive audio. Agnieszka is a Fellow of the Audio Engineering Society (AES) and a Past-President of the AES. She is the faculty sponsor of the Society for Women in TeCHnology (SWiTCH) at NYU.

Agnieszka speaks about the importance of the Audio Engineering Society and initiatives for education for the unrepresented communities and her involvement in a wide spectrum of research and publishing activities on spatial audio.

Listen to Podcast

https://open.spotify.com/episode/4rMdK2RQdzm2W8QeK5buzE?si=7f70288c9aff4e23

Show Notes

Agnieszka Roginska LinkedIn – https://www.linkedin.com/in/agnieszka-roginska-784a07/

NYU Official Website – https://www.nyu.edu/

NYU Music Technology Program – https://steinhardt.nyu.edu/programs/music-technology

AES Official Website – https://aes2.org/

Designing Effective Playful Collaborative Science Learning in VR – https://link.springer.com/chapter/10.1007/978-3-031-15325-9_3

Insight into postural control in unilateral sensorineural hearing loss and vestibular hypofunction – https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0276251

Multilayered Affect-Audio Research System for Virtual Reality Learning Environments – https://nyuscholars.nyu.edu/en/publications/multilayered-affect-audio-research-system-for-virtual-reality-lea

Methodology for perceptual evaluation of plausibility with self-translation of the listener – https://www.aes.org/e-lib/browse.cfm?elib=21874

Sound design and reproduction techniques for co-located narrative VR experiences – https://www.aes.org/e-lib/browse.cfm?elib=20660

Evaluation of Binaural Renderers: Multidimensional Sound Quality Assessment – https://www.aes.org/e-lib/browse.cfm?elib=19694

Immersive Sound: The Art and Science of Binaural and Multi-Channel Audio – Audio Engineering Society Presents (Paperback) – https://www.waterstones.com/book/immersive-sound/agnieszka-roginska/paul-geluso/9781138900004

2023 AES International Conference on Spatial and Immersive Audio – https://aes2.org/events-calendar/2023-aes-international-conference-on-spatial-and-immersive-audio/  

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Episode 73 Arjen Van Der Schoot (Audio Ease)

Summary

This episode is sponsored by Spatial, the immersive audio software that gives a new dimension to sound. Spatial gives creators the tools to create interactive soundscapes using our powerful 3D authoring tool, Spatial Studio. Their software modernises traditional channel-based audio; by rethinking how we hear and feel immersive experiences, anywhere. To find more go to https://www.spatialinc.com.

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by the co-founder at Audio Ease – Arjen Van Der Schoot from Utrecht, Netherlands.

Arjen studied music technology at the Utrecht School of Arts. After which Arjen and 4 of his fellow graduates started Audio Ease in 1995. He was freelancing recording Classical music, Minoring in Classical guitar and majoring in software development for audio and music. Together they made about 10 products before their big break with Altiverb which became an industry standard. The 360pan suite came out of the fierce hope that an old affection – ambisonics, would now finally definitely make it, because somebody thought of it in the context of head-tracked VR, an application that requires headphones, in Arjen’s opinion the only medium it is perfect for.

Arjen tells a fascinating story of the creation of Audio Ease and the famous Altiverb and we explore the topic of convolution for spatial audio.

Listen to Podcast

Show Notes

Arjen Van Der Schoot – https://www.linkedin.com/in/arjen-van-der-schoot-4036a932/

Audio Ease – https://www.audioease.com/

Audio Ease Official YouTube Channel – https://www.youtube.com/user/audioease

Altiverb – https://www.audioease.com/altiverb/

360 Pan Suite – https://www.audioease.com/360/

Speakerphone – https://www.audioease.com/speakerphone/

Sonic Wonderland: A Scientific Odyssey of Sound – https://www.amazon.co.uk/Sonic-Wonderland-Scientific-Odyssey-Sound/dp/1847922104

Watch The Sound with Mark Ronson – https://tv.apple.com/gb/show/watch-the-sound-with-mark-ronson/umc.cmc.56ka6i8ccv7tsatj6nd1uo808

Sennheiser VR Mic – https://en-uk.sennheiser.com/microphone-3d-audio-ambeo-vr-mic

Delay Lama – https://freevstplugins.net/delay-lama

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Episode 72 Kasson Crooker (THX)

Summary

This episode is sponsored by Spatial, the immersive audio software that gives a new dimension to sound. Spatial gives creators the tools to create interactive soundscapes using our powerful 3D authoring tool, Spatial Studio. Their software modernises traditional channel-based audio; by rethinking how we hear and feel immersive experiences, anywhere. To find more go to https://www.spatialinc.com.

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by the Director of Product Development at THX – Kasson Crooker from Seattle, US.

Kasson has spent the past 30 years focusing his career and creative musical passions on the intersection of audio and technology. After graduating from Berklee College of Music (MP&E 1995), Kasson has worked in the videogame industry as Audio Director and Project Director on games like Guitar Hero, RockBand, and Dance Central for Harmonix, at Microsoft creating spatial audio experiences for HoloLens V1, and he is currently at THX as the Director of Product Development for their spatial audio initiatives. He is an electronic musician, composer, and mix engineer having released 20 albums and touring throughout North America and Europe. His current creative passions involve creating interactive music experiences with immersive spatial audio technologies for VR.

Kasson talks about the latest technology developments at THX and we explore the implementation of spatial and interactive audio for a music experience in VR.

Listen to Podcast

Show Notes

Kasson Crooker LinkedIn – https://www.linkedin.com/in/kassoncrooker

Instagram/Twitter/YouTube: @symbionproject

THX –  https://www.thx.com

THX Spatial Audio for Games – https://www.thx.com/thx-spatial-audio-for-game-developers/

Symbion Project – https://symbionproject.bandcamp.com/

(m)ORPH –  https://www.oculus.com/experiences/quest/5857833644234313/

Saturnine – https://www.oculus.com/experiences/quest/5075664742454466

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Episode 70 Michael Plitkins (SPATIAL)

Summary

This episode is sponsored by Spatial, the immersive audio software that gives a new dimension to sound. Spatial gives creators the tools to create interactive soundscapes using our powerful 3D authoring tool, Spatial Studio. Their software modernises traditional channel-based audio; by rethinking how we hear and feel immersive experiences, anywhere. To find more go to https://www.spatialinc.com.

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by the Co-Founder and Co-Der of SPATIAL – Michael Plitkins, from Los Angeles, California. Before founding Spatial, Michael was a founding engineer at Nest which was ultimately acquired by Google. Michael helped develop a set of groundbreaking smart consumer products for the home like the Nest Thermostat and helped define the category we know as Home IoT today. Prior to Nest, he was a founding engineer at Tellme Networks, which was acquired by Microsoft. He also has experience in developing tools and technologies for 3D modelling, animation, VR and graphics. Michael has over 35 patents in UI design, streaming audio, smart home optimization and more.

Michael co-founded Spatial with the amazing idea that sound should not always be linear or channel based, where he patented the Spatial Reality technology; the Spatial audio rendering platform that allows sound to move, using object-based audio and acoustic physics. Michael also developed key integrations within Spatial’s platform that allows new tools to take advantage of Spatial IP.

Michael shares the story of the creation of SPATIAL as a company which subsequently developed into a multifaceted platform for sound designers. We look at the key elements of software architecture, discuss the most recent case studies featuring Spatial technology and a newly launched educational 101 course for new users.

Listen to Podcast

Show Notes

Michael Plitkins – https://www.linkedin.com/in/michael-plitkins-720341145/

SPATIAL LinkedIn – https://www.linkedin.com/company/spatialinc/

SPATIAL Official Website – https://www.spatialinc.com

SPATIAL Creators Space – https://www.spatialinc.com/creators

SPATIAL 101 (FREE COURSE) – https://guide.spatialinc.com/hc/en-us/categories/8192004472723-Spatial-Studio-101

Immersive Audio Podcast Episode 60 – Ken Felton (SPATIAL) – https://immersiveaudiopodcast.com/episode-60-ken-felton-spatial/

In this episode of the Immersive Audio Podcast, Oliver Kadel, Monica Bolles and Bjørn Jacobsen are joined by Ken Felton, Sound Designer at Spatial, from the San Francisco Bay Area, US. Ken is an Audio Director and Sound Designer with decades of experience in professional audio, and a passion for storytelling and immersive soundscapes. Ken started in pro-audio by touring N. America and running sound reinforcement systems. In 1994 he moved to Northern California and started working with interactive audio at Electronic Arts. Most recently in 2021, Ken joined Spatial where he works as a sound designer and brand ambassador. In this episode, we discuss Spatial technology and its entire ecosystem of tools, exploring the breadth of implementation options and some recent case studies.

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Episode 69 Poul Holleman & Salvador Breed(4DSOUND)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by Poul Holleman and Salvador Breed the co-founders of the spatial sound and creative development studio – 4DSOUND, from Amsterdam, Netherlands. 

Poul Holleman is co-founder and technical director of the spatial sound and creative development studio, 4DSOUND. As a creative technologist, Poul focuses on the application of spatial sound to a variety of art forms, ranging from light installations to kinetic architecture and live performances.  His work focuses on the continuous development and exploration of spatial sound as an emerging artistic medium, through the use of 4DSOUND technology.  He is a lecturer in the Creative Systems Design programme at Utrecht University of the Arts (HKU). Next to his artistic achievements, Poul holds a Master’s degree in Cultural Sociology from the University of Amsterdam.

Salvador Breed creates and sculpts sound and technology for a wide field of contexts like live performances, fashion shows, video art, and interactive art installations.  The Dutch artist preoccupies himself with the way acoustics, natural ambience, silence, and space enrich one another, using subtle means to expand our notions of listening, experiencing, and sensing.  As a co-founder of spatial sound company 4DSOUND, he specializes in composing space as an important element of soundtracks – while pushing the technical possibilities in this field.

Poul and Salvador dive deep into the technical make-up of 4DSOUND software architecture along with their unique speaker system implementation and we explore the concept of using a physical space as an instrument.

Listen to Podcast

Show Notes

Poul Holleman – https://www.linkedin.com/in/poulholleman/

Salvador Breed – https://www.linkedin.com/in/salvadorbreed/

4DSOUND Official Website – https://4dsound.net

4DSOUND Systems – https://4dsound.net/systems

4DSOUND Software – https://4dsound.net/software

4DSOUND Studios – https://4dsound.net/studios

4DSOUND Offical YT Channel – https://www.youtube.com/channel/UCmsVqXSLY409bTaIExx8BsA/featured

4DSOUND featured by Ableton (2014) – https://www.youtube.com/watch?v=DMWEEGUlJco

Immersa Montreal – https://www.imersa.org/2021

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Episode 68 Markus Zaunschirm (Atmoky)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by the CEO of Atmoky – Markus Zaunschirm from Graz, Austria.   

Markus Zaunschirm MSc, PhD is a renowned spatial audio expert and co-founder of Atmoky. During his research, he combined advanced signal processing with the models of human perception and invented a unique method for spatial audio playback for headphones. Building on that technological foundation, Markus co-founded Atmoky, a spatial audio software company with the mission to shape the future of audio in virtual worlds and the metaverse.  

Markus discusses Atmoky’s creation and their philosophy on spatial audio and we take part in a live interactive demo of their recently released Web SDK which you can listen to binaurally in this episode.

Listen to Podcast

Show Notes

Markus Zaunschirm – https://www.linkedin.com/in/markus-zaunschirm

Atmoky Webpage – https://atmoky.com

Atmoky Interactive Web Demo – https://demo.atmoky.com

Atmoky Image Video – https://www.youtube.com/watch?v=yqndq1tTfqU

Portal App – https://portal.app

Europe’s Sixth Student 3D Audio Production Competition and virtual Finals are held on October 2022 – https://ambisonics.iem.at/s3dapc/2022

One Square Inch – https://onesquareinch.org

Logitech Chorus, off-ear integrated audio for Meta Quest 2 – https://www.logitech.com/en-us/products/vr/chorus-for-meta-quest-2.982-000153.html?fbclid=IwAR2qyFUCwURylLAlAXXBY1GfwASnBzS_pRqqutZLh5AfGp9MDVWpVI8yNxw

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Episode 66 Sennheiser AMBEO Mobility (Part 3)

Summary

In this three-part series of the Immersive Audio Podcast, Oliver Kadel will travel to Zurich in Switzerland for an exclusive opportunity to speak to the entire Ambeo Mobility team. The use of spatial audio is becoming ever so ubiquitous, it seems that it’s just a matter of time before we get to enjoy immersive content from the comfort of our cars on a regular basis. Join us on this journey to explore and learn about the cutting-edge applications of spatial audio in automotive.

Veronique Larcher (Director)

Dr Veronique Larcher is the Director of AMBEO Immersive Audio, Sennheiser’s brand for immersive audio products and experiences. She is also a founding advisor at Earkick, a startup focused on monitoring anxiety using audio biomarkers, among others. Veronique has over 20 years of experience in the areas of audio and venture building – before launching AMBEO in 2016, she held multiple roles spearheading innovation at Sennheiser, most notably founding and managing their Strategic Innovation office in San Francisco. Veronique holds a PhD in 3D Audio for Virtual Reality from Ircam (France) and a Bachelor’s degree in Economics and Finance from the Paris Institute of Political Studies.

Luca Brambilla (Project Manager)

Luca is the project manager of the Sennheiser AMBEO Mobility initiative, part of the founding team of the project and a real car enthusiast. As a car audiophile, he is motivated by bringing innovative audio technology into the most prestigious cars in the industry and is excited by the opportunities the future of mobility hold. His background is in Industrial Engineering, and with a Master’s degree in Management, Technology and Economics from ETH Zurich, he is skilled at combining technical knowledge and management expertise. In the team, he covers the role of project coordination, and planning, and is in charge of customer and supplier relations.

Sofia Brazzola (Brand & Marketing Manager)

Sofia is leading Brand & Marketing efforts aimed at the growth of the corporate venture AMBEO Mobility, launching Sennheiser in the automotive industry. She has been in the team for several years under different capacities leveraging her Design Strategy, User Experience and Marketing skills aimed at de-risking and launching product concepts in new opportunity markets for Sennheiser internationally, including VR/AR and immersive music streaming. In her current role, she coordinates digital and event marketing activities designs brand strategies and is responsible for Sennheiser AMBEO’s brand positioning in the automotive world. She recently graduated with an MBA from Imperial College in London and holds a Master’s degree in Design from the Zurich University of the Arts.

Rui Wang (Customer Developer)

Rui is a digital marketer, cross-cultural communicator, and partnership developer. She holds a master’s degree in European and Asian Business Management from the University of Zurich. With four years of experience working with top technology companies, she has a keen understanding of the needs of B2C & B2B clients in the field of innovation. As a bridge between the West and the East within the Sennheiser AMBEO team, she takes pride in providing market insights and data-driven business strategies. In addition to her primary job functions, she has been certified as a Data Analyst with Python for her commitment to data analysis.

Lorenz Bucher (Software Architect)

Lorenz Bucher is part of Sennheiser’s interdisciplinary AMBEO Mobility team. As a software architect, he’s eagerly striving to shape the future of automotive sound experiences and leading Sennheiser towards software excellence. He has a background in electrical engineering and spent many years of his career developing embedded audio DSP systems and implementing audio algorithms for high-end professional mixing consoles and consumer electronics. Being an avid musician in his spare time, Lorenz has found the sweet spot where he can combine his love for music with his passion for tweaking the technology to create the ‘wow’.

Sofia Checa (Software Engineer)

Sofia is a software engineer specializing in spatial audio. She has a degree in Electrical Engineering and Computer Science from Yale University and is also a classically trained cellist. She joined the team in 2019 to help create the first AMBEO Mobility Demo Car and has been fascinated with the project ever since. Sofia loves her job because it allows her to tap into both her technical side and her artistic side each and every day. Her responsibilities range from writing code to critical listening to developing demo experiences.

Henrik Oppermann (Head of Sound)

Henrik Oppermann (M.Mus.) is a leading 3D sound specialist, bringing with him over 15 years of experience in recording studio-quality audio on location for film, advertising, music industry clients and 3D sound installations. Henrik has worked on over 150 VR and AR projects, capturing 3D audio in a number of challenging environments, including low-flying military aircraft, formula one race cars, refugee camps, mountain peaks and concert halls around the world. An expert in his field, Henrik has developed hardware and software audio applications and workflows for VR collaboration with leading sound partners, to deliver the best possible Immersive Sound. Henrik joined Sennheiser AMBEO Immersive Audio as the Head of Sound in February 2022.

Hans-Martin Buff has been a Recording engineer and music producer since 1993, when he graduated from Music Tech vocational college in Minneapolis, USA. He began his career at Pachyderm Studios, where he made excellent coffee and then proceeded to hone his studio chops by assisting on projects such as Live’s million-seller “Throwing Copper”. Hans-Martin worked his way through various Minnesota rock’n’roll factories before he found a more permanent home at Prince’s Paisley Park Studios, whose personal engineer he became and remained for four funky years. During this period he wasn’t only responsible for His Purple Majesty’s recordings, but also for the studio affairs of world-renowned artists, including No Doubt, Chaka Khan and Larry Graham. Being a native of Germany, Hans-Martin Buff relocated to his home country in 2001, where he continued his career as an independent recording engineer and producer, and where he has since mixed and recorded a host of national and international talent, such as Mousse T., Joss Stone, Zucchero, Eric Burdon, Roachford, Maxi Priest and the Scorpions. Since 2018, Hans-Martin has explored the subject 3D-Audio for headphones, and he is now considered an industry expert. He has written a book on the subject and holds an “MA in Immersive Music Production”.

Listen to Podcast

Show Notes

Sennheiser – https://en-uk.sennheiser.com

Immersive Audio – https://en-uk.sennheiser.com/ambeo

AMBEO Mobility Official Page – https://en-uk.sennheiser.com/ambeo-mobility

AMBEO Mobility LinkedIn – https://www.linkedin.com/showcase/ambeo-mobility

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Episode 63 Kevin Bolen (Skywalker Sound)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by a director for interactive audio at Skywalker Sound – Kevin Bolen from California, US. 

Kevin Bolen supervises Skywalker Sound’s interactive audio department, which combines decades of cinematic audio experience with bleeding-edge technologies to create unforgettable immersive audio experiences such as the Academy Award-winning Carne y Arena, the Peabody Award-winning Queerskins: A Love Story, and the Emmy-nominated Star Wars: Vader Immortal. Kevin’s team collaborates with partners including Disney, Lucasfilm, Marvel, Legendary Entertainment, and ILMxLAB to extend the power of cinematic storytelling into location-based experiences and home entertainment alike.

In this episode, Kevin shares his perspective on how they approach the spatial and interactive audio philosophy at Skywalker and we explore the Star Wars: Tales from the Galaxy’s Edge project case study.

Listen to Podcast

Show Notes

Kevin Bolen – https://www.linkedin.com/in/kbolen/

Skywalker Sound – https://www.skysound.com/

ILMxLAB – https://www.ilmxlab.com/

Facebook Spatial Workstation – https://facebook360.fb.com/spatial-workstation/

Star Wars: Tales from the Galaxy’s Edge – https://www.oculus.com/experiences/quest/3484270071659289/?locale=en_GB

Bandcamp acquired by Epic Games – https://www.epicgames.com/site/en-US/news/bandcamp-joining-epic-games-to-support-fair-open-platforms-for-artists-and-fans

The audio heard through the episode are binaural excerpts from Star Wars: Tales from the Galaxy’s Edge VR Experience.

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.