When designing sound effects for apps and games, the right notes make all the difference. And when those notes are built to support multichannel audio, they might even turn one’s head. (Exactly.)
Room And I hate it These are just two of the many apps and games that use Spatial Audio. They use multichannel mixers, Core Audio and AVFoundation to add texture and dimension, creating immersive surround sound experiences that immerse listeners into the world inside their app.
Design for spatial interaction
Discover the fundamentals of creating intuitive physical interactions between two or more devices, as demonstrated by Apple designers who worked on the iPhone, HomePod mini, and AirTag features. Explore how you can apply these patterns to your own apps when designing features for Apple platforms and…
Room (pictured above) offers personalized and tailored sound settings based on biometrics and location to help people focus and get better sleep. The first Spatial Audio soundscape named World Orbit – brings the app’s amazing blend of art and AI to a new dimension.
“You seem to be in a very shiny place,” said Dmitry Evgrafov. Room Founder and Chief Voice Officer. It almost sounds like phonology, where the little dots create a structure of their own and you’re immersed in the object. It’s a beautiful scene, and not something you can replicate in stereo.
When they brought Spatial Audio to their ecosystem in 2010, Room The team’s first task was to determine whether the technology was compatible with the changing, generative soundscape. That job largely fell to co-founder and chief technology officer Kirill Bulasev. “[Spatial Audio] We had to add one more dimension to the static element,” he says. “In addition to choosing what to play and when to play, we had to think about where the sound would be and how it would move around you.”
That sound placement also had to “strike a fine line between adding to the experience and making it distracting,” says Evgrafov. Because while most apps (and games and movies and songs) are designed for active participation, Room It aims to be the perfect background companion – enhancing your experience without taking away from your focus. “Our use case is different from other products using the technology,” says Evgrafov (who credits founder Oleg Stavisky for “the beautiful sounds in the app”).
It’s like the sound of a point lens.
Dmitry Evgrafov, * Endel * founder and chief audio officer
A pianist and musician with 10 albums under his belt, Evgrafov certainly knows his way around a stereo. But the position of the sound is randomized in space? That’s a whole different beast,” he says.
The first serious example of Spatial Orbit was ground bound, set to a realistic jungle scene. “The idea is that you walk around this magical Garden of Eden and exotic tropical animals sing around you,” he said. “We had a ditch by the water, a stream, birds that don’t exist in the real world, things like that.
Similar ideas kept coming: a Gregorian choir that slowly passed by as it sang, field recordings from a cave. Although the concepts were cool and the prototypes looked good, the team kept running into the same problem. “They weren’t Endel,” Evgrafov said. “They moved it somewhere, but that meant people were knowingly using the app. They don’t align with what we stand for.”
What does the final version of Spatial Orbit correspond to? Room It stands – and achieves the fusion of art and technology that Endel strives for. “The rain [in our soundscape] It’s almost metaphorical,” says Evgrafov. “It has this slightly enhanced feel that allows you to sink in and be with your thoughts, focus on your book or focus on whatever it is you’re doing.”
Adjusting the soundscape was an adventure in itself. “Watching people test Room It’s kind of a funny exercise,” Stavitsky said. This is because there is no proven way to test a personalized, self-generated soundscape across a group of people at once.
[The rain has] It’s that slightly added feeling that allows you to get a little lost and be with your thoughts, focus on your book, or focus on whatever you’re doing.
Dmitry Evgrafov
“We created the process and the set of tools,” says Evgrafov. It involved a lot of people wandering around Endel’s Berlin offices… and elsewhere. “Also, I’ve been a lot of people in public places looking at anything like a cat.”
Ultimately, Spatial Orbit captures that elusive blend of innovative technology and artistic resolution. “When we realized that the science was there and that it still checked all of Endel’s boxes, it was a big relief,” Evgrafov said. “We thought, ‘Well, we can be non-intrusive and spatial at the same time.’
Download Endel from the App Store
I hate it It also focuses on creating the best ambient soundscapes – but from a scientific point of view. “I want our composers to think of inventing planets and filling them with sound,” says Joon Kwak, the app’s Seoul-based founder. “We want to get people through these new planets.”
The app’s soundscapes, which evoke anything from a cascading waterfall to a chaotic digital backdrop to the calm of the deep sea, use head tracking and multichannel audio to create a truly immersive mix. (The app is a visual feast, with every soundscape accompanied by ever-changing techno-awarded art.)
But you are no passive listener in these realms of sound. The individual components that make up each sound feature can use a virtual, playful UI that allows you to change each sound element (like the waterfall) wherever you want.
suitable for the future, Oh! my god The backstory is one of exciting meetings, well-timed hardware and software releases, and good luck. Kwak conceived the first version of the app as a graduation project at the Design Academy Eindhoven. Originally called Virtual Sky, the prototype contained the bones of what could be I hate it, but it was mostly based on real world sounds. It also required a mess of hardware and special equipment — all of which became irrelevant after AirPods came with spatial audio.
“I was depressed for a while,” Kwak said. “’I’ve been working on this for months, and now it’s useless!’ But then I thought about it and realized: ‘Oh, this means I don’t need to provide hardware, and that’s actually pretty cool.
Kwak has partnered with Volst, a company interested in 3D soundscape applications. Where the building blocks are placed, Oh! my god UI developer and designer Rutger Schmel took on the challenge of bringing Kwak’s project to life—a process that was faster than expected.
I want our composers to invent planets and fill them with sound.
Joon Kwak, *audio* founder
“We know they have AirPods. [surround sound] But we were skeptical about the support. “We thought, ‘OK, they have head tracking, but maybe it’s just for first-party stuff.’ But we’re still excited, so we quickly set up an Xcode project to get the data from AirPods to the device.
They had a prototype on the headset in minutes. “We were deprived of how easy it is,” Schmel said. “And we decided on the best 3D audio framework from Apple, which is the perfect base for what we’ve been working on for an hour.” Coding began in January. By April, the team had a Swift-powered demo ready to go.
to build I hate it Soundscapes, composers such as Kwak; I hate it Sound designer Max Frimout and a team of outside musicians – all at Logic Pro – collaborate to blend ambient sounds, synthetic bells and music.
After soundscapes were created and properly tested in coffee shops, parks, and subways, the artists submitted their files to Schimmel. For a role that involves great design, immersive audio, and impressive levels of customization, Schimmel’s toolbox is surprisingly uncluttered: AVAudioEnvironmentNode (AVKit) for creating 3D sound environments, CMHeadphoneMotionManager (Core Motion) for getting headset motion data, and Sentry for bug tracking and QA.
“Everything else in audio was created from scratch in Swift — everything from data management to interacting with audio recordings to real-time archiving of interactive audio files,” Schimmel says.
The result is a stunning example of the power and simplicity of designing for spatial audio. “Honestly, most of the hard work is done by the composer,” says Schimmel.
Download audio from the app store
Get geometry-aware audio with the Physical Audio Spatialization Engine (PHASE).
Explore how geometry-aware audio can help you build complex, interactive, and immersive audio scenes for your apps and games. Discover PHASE, Apple’s Spatial Audio API, and learn how the Physical Audio Spatialization Engine (PHASE) keeps sound always relevant to your experience—helping…
Submit your application in Spatial Audio.
Learn how spatial audio can help you deliver a theater-like experience for media in your apps and on the web. We’ll show you how to easily deliver immersive audio with compatible hardware and automatically deliver a variety of listening experiences…