Selective audio highlight based upon area of focus?

[Daniel Harrell]

Hello All,

This is my first post, and you all seem like a knowledgable bunch, so I’m hopeful someone can help me. I’d like to create a 360 video that can playback inside an open source player for iOS/Android and the audio playback would be dependent upon where the viewer is pointing their attention. So as an example, if you shot a video in a restaurant and had people sitting all around you, where ever the viewer focused (pointed) the playback device, the audio from that area would be louder while the audio from the other areas would drop away to just background noise. If the viewer focused on another table (area of video playback) then that audio would take prominence and the others would drop away.

Is this even possible? Has anyone played with this?

[Sam Rohn]

this is known as “spatial audio”, see the following links for more info

google cardboard and youtube spatial audio support –

https://support.google.com/youtube/answer/6395969?hl=en

https://developers.googleblog.com/2016/01/spatial-audio-comes-to-cardboard-sdk.html

https://github.com/google/spatial-media/blob/master/docs/spatial-audio-rfc.md

https://support.google.com/jump/answer/6399746?hl=en&ref_topic=6399824

facebook spatial audio support –

https://facebook360.fb.com/spatial-workstation/

https://fb360spatialworkstation.zendesk.com

spatial audio hardware –

http://www.synthtopia.com/content/2016/05/18/zoom-h2n-update-lets-you-record-immersive-audio-for-virtual-reality/

sam

[Author]

Posts