Samsung has revealed that it has been working with Google to develop Immersive Audio Model and Formats (IAMF), an advanced 3D spatial audio technology that was adopted by the Alliance for Open Media in October 2023.
Per a press release from Samsung, the new 3D audio technology, which is described by Samsung as being able to offer movie-quality audio from the comfort of one’s home, offers three distinct features that enhance the audio experience, including one that leverages AI:
- Ability To Express Sound Vertically
- Previous open-source audio codecs only supported horizontal sound expression. With IAMF technology, audio can now be expressed vertically so that sound is increasingly multi-directional. “IAMF makes sound more realistic, by allowing listeners to hear audio in front, behind or to either side and also above or below them,” said [WooHyun Nam, one of the research leads from the Visual Technology Team at Samsung Research]. “As such, when IAMF technology is applied to home TV speakers and sound bars, it allows listeners to hear sounds such as birds flying over their head on their TVs at home.”
- AI-Based Scene Analysis and 3D Audio Effects
- IAMF utilizes AI and deep-learning technology to analyze scenes and emphasize certain aspects of the content — adjusting audio levels for more enhanced sound throughout the viewing experience. “In TV and film, there are certain scenes where the soundtrack or background music is the main focus,” said Nam. “IAMF will balance the sound in these instances. Similarly, the technology will fine-tune audio when there is character dialogue to allow the listener to focus on the conversation.”
- Highly Customized Audio
- Users will be able to freely adjust sound according to their preferences with IAMF technology. Whether viewers are looking to amplify sound effects from an action scene or enhance dialogue, IAMF gives them the flexibility to customize content audio for a more personalized experience.
Samsung goes on to confirm that IAMF is the very first open source-based audio technology standard to be adopted by the AOM, seemingly making it an attractive alternative to Dolby Atmos, which, despite being described as being “the world’s leading spatial audio technology,” is proprietary.
“In order to allow people to freely create content with 3D audio technology, related technology needs to be open to all,” Nam said. “Providing a complete open-source framework for 3D audio, from creation to delivery and playback, will allow for even more diverse audio content experiences in the future.”
“My hope is that Samsung’s sound technology will enable consumers to enjoy an upgraded audio experience that is on par with that of current visual experiences,” added JeongHoon Park, another member of the Visual Technology Team at Samsung Research. “I hope that content creators will utilize Samsung’s audio technology to make 3D audio content accessible. Additionally, we aim to create a supportive environment that enables researchers to take on bold and exciting challenges such as expanding Samsung’s audio technology.”