Loudness Management: How Audio Technology Will Impact Streaming Video
Loudness Management: How Audio Technology Will Impact Streaming Video
The OTT video (over-the-top) market has experienced explosive growth since 2015 as viewers have increased streaming media consumption. Subscriptions are up, and so is the use of smart devices used to watch OTT content. In 2018, eMarketer expects that 181.5 million U.S. consumers will use Smart TVs at least once a month, and by 2021, that number will reach 194.4 million consumers, which is almost 58% of the population. The NPD Group estimates that over 57% of all U.S. smartphone users access video content via an app at least once a month. Streaming video is the number one driver of cellular and Wi-Fi data consumption, with apps like YouTube and Netflix driving the greatest data demands.
Consumers have embraced binge-watching original TV and long-form content featuring celebrity talent. Mass market and niche OTTs are serving award-winning content and liberating consumers from overpriced cable channel bundling. With this recent growth burst, the OTT market has expanded into multiple facets: Live Events, Live TV, User-Generated Video, and Video on Demand. Companies such as Hulu, Amazon Prime, Netflix, ESPN, MLB.tv, DirecTV NOW, YouTube TV, Twitch, and HBO Now are the market leaders in these categories.
The Technical Hurdles
One of streaming media’s biggest challenges to date has been transmission: getting the signal across and delivering quality streaming video through the open internet. The complexity of the behind-the-scenes transmission ecosystem is staggering, and the nearly seamless viewing experience that most subscribers enjoy is a technical marvel.
Developing this complex delivery system, and making it reliable, has largely been the technology focus over the past few years. One of the byproducts of this focus is that streaming services haven’t prioritized audio quality. But, the fact that audio technology lags behind transmission and video quality is a scenario that is now familiar to media consumers.
Despite the famous quote that “sound is half of the experience,” audio for home entertainment tends to lag behind transmission and video technologies. On emerging media platforms, sound quality typically takes a backseat, while a focus on sound quality appears to be indicative of a maturing media platform. For example, multi-channel television sound was adopted by the FCC in 1984, about 20 years after the first color TVs showed up in US households. In the video game industry, it took years before audio caught up with advances in 3D graphics. And, during this awkward audio catch-up phase, loudness irregularity is typically an issue.
In the 2000s, loud commercials on broadcast TV led to a slew of consumer complaints to the FCC. In 2010, Congress passed the CALM Act requiring the FCC to stem the problem. Around the same time, video game developers made strides in game mixing using middleware like Audiokinetic’s Wwise. Now, 10 years after Netflix started streaming, loudness is a point of frustration for OTT users, according to Greenlight Insights, and is often cited in customer reviews and support forums. Audio seems to be lagging again, but Smart TVs and Digital Media Players are supporting next gen audio tech like Dolby Atmos and raising consumer expectations. Today, streaming platform companies are beginning to appreciate the need to invest in resources to improve audio quality and specifically to integrate solutions that provide loudness management for consumers.
Audio Tech Improvements and Subscriber Retention
While high quality content, variety, and affordability have largely been the drivers of OTT subscriber acquisition, keeping those users on the platform will ultimately be based on the quality of their overall experience, including audio. Savvy OTTs like Netflix and Amazon Prime are already taking steps. In 2017, Netflix debuted Dolby Atmos with the release of the original movie Okja. A year later, Amazon Prime announced support for Dolby Atmos for the Tom Clancy Jack Ryan TV series.
Still, most of the popular OTT services fall short of the audio experience that consumers now expect from their smart devices. Platforms that begin investing now in higher quality audio and solve for these technology obstacles will surface as market leaders based on consumer satisfaction and retention. Integrating loudness management solutions will allow subscribers to take their thumbs off the volume control, and bring the OTT experience to the next level, beyond convenience.
NFL Season is Here: Fans Debate Video and Sound Quality on Streaming TV vs. Broadcast For many football fans this NFL season, the decision to keep paying for cable instead of switching to streaming TV is as much about the quality of experience as it is about access to the games they want to watch. While streaming services offering live TV bundles, such as Sling TV, are less expensive and offer many of the same channels as cable, the quality of the video and audio may not be as good as cable. With streaming, frame rates are lower than cable for for sports and news channels, and audio consistency as well as surround sound are often nonexistent. Thus, the debate continues among fans this year whether to cut the cord or wait another season for streaming to catch up on sound and video quality. A Focus on Improving Video Latency Live streaming video gets chopped up into chunks that are delivered over the open internet. Larger chunks can cause latency and lower frame rates, but solutions are already underway to improve speeding up video delivery. The content delivery network Akamai announced plans last year to process smaller chunks of video more quickly, and a new video standard called WebRTC could also improve latency as it becomes more widely adopted. We may even see video delivery improvements during the current NFL season, but next season will almost certainly bring higher quality. Catching Up on Audio Quality As latency and video quality improves, we should expect streaming platforms to begin prioritizing audio quality, specifically loudness management. The Gaudio Sol Loudness SDK can provide streaming TV with an improved audio experience for viewers by smoothing variations in loudness, providing continuity of the perceived sound level between streaming content programs. The Sol Loudness SDK uses a unique architecture in which the server-side performs the loudness measurement and generates metadata that the client-side uses to normalize content to a target loudness setting. Other loudness management software solutions employ a legacy “file-based” approach that destructively modifies the original content and typically produces distortion. Advantages to the server-client solution include the opportunity to set loudness targets per platform, end-user device, or even listening environment. Video streaming services offering live sports programming can leverage Gaudio’s loudness management software to provide a higher quality audio experience for viewers, leading to increased subscriber retention. The OTTs are catching up to cable in quality and providing subscribers with award-winning, binge-worthy content together with live TV. As the OTT transmission and video technologies solidify and mature, attention will shift to providing higher quality audio experiences. The OTT’s that bring focus to solving loudness management issues will have more sports fans cutting cords, and making the jump to subscriptions. Stay tuned for more updates on how audio technology can enhance the streaming media experience. To learn more about Gaudio’s Sol Loudness SDK, please contact us!2018.10.05
Berklee Indian Ensemble – Unnai Kaanadhu Naan (360 Video from Power Station at BerkleeNYC) The Berklee Indian Ensemble performs “Unnai Kaanadhu Naan” by Shankar-Ehsaan-Loy in a 360 audio and video recording at the Power Station at BerkleeNYC. The song was arranged by the Berklee Indian Ensemble. This is an immersive 360 audio and visual experience where the listener finds themselves at the center of all elements, being surrounded by the music. When you rotate the video by moving your mobile device, dragging the picture on your computer, or moving your head while wearing VR goggles, the sound field will also rotate. For the full immersive experience, please wear headphones.2018.12.21