Rob AyerstClose Icon

Spectrum TV
Video
Player A/B
Experiment

Spectrum TV Video Player A/B Experiment

Company

Spectrum TV Stream

Platforms

iOS, Android

Tools

Sketch, Principle for Mac

Date

Summer 2022

My Role

UX, Prototyping, Experimentation Concept

View the Project
Scroll Down to View

Business, meet Customer

Working for a cable company often highlighted how strong business deliverables can drive design decisions. It also helped forge me into a designer who is keen on understanding the business side, striving to curate design options that satisfy both customer and profitability. I had been working on a PIP (Picture-in-Picture) project, and getting increased video streaming time per app use was the primary goal. While balancing stakeholder opinions, business deliverables, engineering constraints, and the end user experience, I had an idea.

Live TV conflicted with the guide

Spectrum TV Stream is a linear (live TV) app first and foremost. The Video player is the most important feature - but the Guide is closely tied to it. Spectrum had deeply entrenched technical issues preventing the two to be fully merged, thus creating a split experience with a "Mini Guide" tied to Live TV, and a full Guide on a separate page.

Live TV Mini Guide

Features

  • Portrait Video Player
  • Direct tune to channels
  • On-Now specific filters
  • Restart as Video On Demand if available

Limitations

  • No Future Airings
  • No access to product pages
  • No ability to start recording to DVR
  • At the time, the app didn't support a PIP player
  • If the user navigates away, the TV Stream & Sound is cut off. When they navigate back, it has to reload.

Guide

Features

  • Live and future airings
  • Ability to add networks to favorites
  • Access to product pages
  • Restart as Video ON Demand
  • Record to DVR

Limitations

  • No Video Player
  • No direct tune (have to go to product page first)
  • No focus state for which channel is currently streaming

🤔 Insight

We knew that 10-ft experiences far outpace mobile for video consumption. We also knew that the Mini Guide left a lot to be desired with functionality, not allowing customers to set DVR recordings, manage recordings, view information about what's being aired, see into the future, or set favorite networks - yikes! By burying the Live TV stream in a nav tab, we were essentially forcing people to leave it behind if they wanted to do any of those actions. Something is wrong with this picture.

Comparative Research

Let's take a step back, and consider how people consume media on mobile devices. From music to audio books, short form video to movies and series, we were the only ones to smash the stream into a page. I intentionally ignored other cable companies, because they seem to all be losing their market share. Still, we can learn from the rest of the industry.

YouTube

YouTube is a giant. The Google-owned streaming service takes 10% of total viewing for streaming services - eclipsing the competition. Not only that, a remarkable 40-60% of their streams are viewed on mobile devices. This product will set mobile streaming paradigms by their UX decisions alone, and to say they are doing something right is an understatement. While they aren't a direct competitor to the linear-based cable companies (and YouTubeTV is a thing) ... I believe it's relevant to take notes on the titan of video.

Home Page

Open up YouTube and you'll find an endless feed of content to scroll through, filters, and a nav bar at the bottom. Videos will auto-play without audio when brought on-screen.

Product Page

YouTube scraps the idea of a product page. Instead, they utilize the 3 dots next to the meta data for quick actions, and a "more" option under the video player.

Video Player

The video player overtakes the screen, covering the nav bar, video feed, giving the user a limited version of a product page plus a feed of related content which scrolls under the video. Landscape player is accessed by rotating the device or tapping the icon, and offers limited navigation to other videos.

Mini Player

If a user wants to do anything else in the app other than watch the video, pick a related one, or take an action on the video, they are required to push the video down into a mini player.

🧐 Observation

When you select a video to watch, it takes over everything. It does allow for some minute navigation ... next / previous videos, related videos, or jumping to the channel - but it significantly limits the functionality of the app beyond those.

Netflix

Next up on the list of streaming services that are sweeping the floor with cable, good ol' Netflix. Blockbuster wasn't the only casualty in evolution. A close second to YT with 8% market share for total streaming, it's another one that can't be ignored.

Home Page

Similar to YT, there's a big feed of video content. Their quick-play video is limited, and most movie and series assets open a dedicated product page.

Product Page

Netflix's product page takes over the app, limiting navigation until it's closed. It offers previews for content, ability to play or download, plus meta data, suggested content and a few other actions.

Video Player

Netflix keeps the player apart from the rest of the app, forcing a takeover. They don't offer any sort of portrait player, but they do allow series to navigate to other seasons / episodes, as well as skipping to next episode

Mini Player

There is no concept of browsing while you watch in Netflix. They are serious about you watching content! While you can't passively browse while streaming, they do offer a native PIP so you can exit the app without closing the video stream.

🤔 Insight

Netflix takes a more draconian approach to multitasking compared to YT. They will let you switch episodes when watching a series, and they'll let you exit the app and keep the video streaming, but they aren't interested in allowing you to view the rest of the app if you started a stream.

Prime Video

Like it or not, basically anything Jeff Bezos touched has launched to success. If you look at market share and growth, Prime Video is no exception. This is an interesting service because of their ability to blend TVOD and subscription-based content so well. Let's dig into how they handle video streaming.

Home Page

Prime Video defaults the user to a typical landing page. Here, you'll see a few filters, access to account and casting, a nav bar and various content.

Product Page

Filters at the top are replaced with a Back icon, but the Nav Bar is still present. When you select an asset, the highlighted Nav Bar option remains static. However, if you tap on one of the Nav Bar icons, it will reset when you come back.

Video Player

Prime Video keeps it simple here. The Nav bar is hidden, and navigation is limited. While you can expand the cast info, continuing to dig in will quickly dismiss the video stream.

Mini Player

No multi-tasking in the app while watching video, but Prime will allow users to open other apps while continuing to stream the content they have started.

🤔 Insight

I suspect it might cause frustration when a user is on a product page, accidentally (or on purpose) taps something in the Nav Bar, and when they return their product page is gone. It's possible to build up a hefty back stack in the sub-nav - I hope I don't lose my place!

Hulu

Hulu is one of the OG's in the streaming world. Started in 2008 ... just a year after the launch of our first smartphone, the iPhone. They've kept their status as a major player, and continue to dominate as a streaming service provider.

Home Page

Hulu takes a standard approach to their home page. There's a feed of content, with the three dots opening an abbreviated product page control bottom sheet.

Product Page

Keeping in line with Netflix, Hulu's product page acts as a full-screen modal and covers the Nav Bar. While you can continue on to related content, it doesn't let you do much else in the app.

Video Player

When a video stream is initiated either from a product page or a quick-play option on a main page, Hulu defaults to a portrait landscape, with ability to watch next or open a product page for related content.

Mini Player

Hulu will let you multitask in the app, unlike Netflix's more heavy-handed approach. They use the native iOS PIP, allowing for in-app navigation and continuing the stream in over other apps.

🤔 Insight

Hulu blocks the Nav Bar for both Product Pages and the Player. This makes it more obvious to a user that if they navigate away, they must minimize (for the player only) or exit the content first.

Putting it Together

We've looked at streaming apps that are more successful than cable, and observed one or two patterns which are very different from how the old-school media players do things. Older generations might be happy with their set top box units, proficient with the nuances, and adverse to change. That doesn't need to limit how we handle the mobile apps - they don't need to be functional clones of the on-screen cable guide that's been around for a half-century.

High-level View

All these apps do more than only play video ... the list goes on for why a person would use a video service. Let's think about hierarchy. Probably most people aren't opening their iPhone to have background noise for their pet while they leave the house.

Primarily, I'm here to...

Watch Something

Consumption of content is the bread and butter for all media streaming apps. Period. It's why people pay for them, it's how the companies get paid. The more streaming, the better.

But also, these things are important

Find Something

It's a prerequisite for watching something. With the exception of watching the currently tuned / startup channel on app launch, they are going to need to find something appealing to them.

Download / Record something

About to get on a flight? Probably want to download some content to the device to watch later. Is there a game on while you are at work? Definitely want to set a recording to watch later instead of hearing about it from friends.

fun with innovation week

Spectrum TV had an innovation week, and I was excited to jump in and show a new idea - free from the typical mire that projects went through. Here's how I took the observations from above, and put a little spin on it.

Fun with Innovation Week

I love doing full re-designs, but there's a huge opportunity to enhance the experience if you can work with what you have. Recycling existing components is easier to budget for and less risky to put forth as experiments.

Here's a concept where we can continue to open the app with the Live TV Stream playing at app launch, allow for navigating the app without cutting it off, all by reshuffling components we already have built.

Features

  • Video initiates in mini player on app launch
  • User can navigate around without interrupting the video stream
  • Mini guide to change channels is moved to be hidden until the mini player is expanded
  • Mute is front and center on mini player, so if a user isn't opening the app to watch, they can essentially dismiss the video experience while the cable company keeps hitting their metrics

Limitations

  • Opening with a mini player playing video could confuse customers
  • There's no way to dismiss the player besides muting
  • It's an unproven reshuffle, not a redesign

Let's keep pushing

Not long after creating this concept, the business deliverables started to soften. A new initiative to make a modern looking "Home" was kicked off, and a willingness to experiment with the nature of the video player took shape. Instead of landing on Live TV, we could show a landing page with an embedded player in it - still streaming content, but separated from the standard Live TV experience we were used to.

Sticky Stakeholders

While we were free to create a new experience for the landing page, there was a very long-standing wish from designers, product owners, developers, and VP's alike to "just put the video player of the guide". That had been the wish for so long - based on a knowledge that it was silly we had to split the Live-only guide with the full Guide - other ideas were met with skepticism.

Pinning the TV Stream above the guide would have been an improvement over the current implementation, I value the communal expertise of my colleagues who had worked in the industry much longer than I. What a perfect opportunity to set aside opinions and get some data with an A/B Experiment!

Version A

  • Video Plays without audio in Hero Card on app launch
  • Live TV embedded above Guide in dedicated Nav Tab
  • Video Stream is combined with Guide on a dedicated Nav Bar
  • Video Stream would cut out if user navigates away without initiating PIP

Version B

  • Video Plays without audio in Hero Card on app launch
  • Guide without Video Stream is on a dedicated Nav Tab
  • Quick play from Home or from Guide tab would initiate a full Video Stream
  • User must minimize Video Stream into a PIP in order to navigate the rest of the app

Experiment Goals

The purpose of this A/B experiment would be to learn if users want to browse the Guide with a primary focus on the Video Stream. Is the long-standing "just combine live and guide" a user based design? Does taking the whole screen with the portrait player - forcing the user to consciously minimize the Stream - help them complete other tasks without abandoning the app completely?

Success Metrics to Measure

  • Increased total video streaming time per app launch
  • Increased general app usage while PIP is streaming video
  • Increased secondary actions like setting DVR recordings, adding favorites
  • Increased overall app usage

Next Steps

I left Spectrum right around the time I was starting to share these ideas, and I'm afraid the experiment it might have fizzled out after I moved on. Any media streaming company could benefit from taking a look at their player, how it fits into (or over) the app in general, and experiment around it. I would be curious to see how this line of thinking could help Cable be more competitive.

Back to Top
Projects