SmartGlass: A Big Step toward Convergence of TV and the Web Across Screens

Microsoft Xbox SmartGlass is CoTV 1.0 (maybe) -- on to CoTV 2.0!

With the release of Xbox SmartGlass, I am gratified to see many of the concepts I described as "Coactive TV" in 2002 finally being realized. I had been seeing increasing progress in recent years, as noted in my January post, but those have been very fragmented, partial steps, and I was being optimistic to refer to it then as CoTV 1.0. SmartGlass might be considered a major complementary step toward what (when integrated with those other pieces) will become representative of what I had in mind as CoTV 1.0.

The basic concept of CoTV is that we have multiple screens and input devices, and multiple content sources that have a Web of interconnections.  What we really want (even if most do not realize it yet) is to use the right combination of screens and input devices, at the right time, in the right way -- to work with whatever content we want at a given time. What connects them is the cloud, and our devices should use the cloud to support our media use seamlessly, not constrain it.

As noted in that January post, and more fully in my January "CoTV Now" summary, we are getting there, but there is still much more to come -- what might be looked to as CoTV 2.0 and beyond.  Now we seem to be at a significant milestone.  That makes this a good time to review where we are now, and to look to what will follow.  Based on the announcement materials, it seems as follows.

Now/emerging (CoTV 1.0):

• Numerous  iPad, iPhone, Android (and soon Surface) companion apps
• Social TV
• Producer and third party enhancements on the second screen
• AirPlay (and Miracast) screen-shifting 
• and now a much richer any-screen experience with SmartGlass that includes rich remote control and enhancements, and steps toward full multi-screen hypermedia browsing.

Still to come (CoTV 2.0):

• Selectable, Alternative "Enhancement Channels" 
• Screen targeting 
• Flexible session-shifting
• Link-and-pause (and sync bookmarks)
• Full multi-screen hypermedia browsing  
• TV Context parameter/API
• Full Coactive Internet commerce and advertising
• Third-party linking rights/fees

Some links expanding on this are listed below.

-------------

I want my CoTV!  ...SmartGlass promises to be a reasonable start!

(Apple, your move. AirPlay was nice, but SmartGlass goes much farther.  Google?  Others?)

-------------

On SmartGlass:


A very nice video overview:
Xbox SmartGlass and Internet Explorer for Xbox - E3 2012 HD

Some descriptions:
Introducing the New Entertainment Experience from Xbox
Xbox SmartGlass goes beyond the second screen
Introducing Xbox SmartGlass

More video:
E3 2012: Xbox Media Briefing Smartglass Highlights
E3 2012: Xbox SmartGlass
Xbox SmartGlass Walkthrough

On CoTV:

CoTV Now

Social TV -- The "Killer App" for Coactive TV -- Ready for Ubiquity

Social TV promises to be the killer app for coactive TV (CoTV).  (A "killer application" is an application that is so desirable to users that it drives the adoption of a larger technology.  The concept emerged when spreadsheets and word processors drove the adoption of PCs, which have obviously broadened to far wider importance.)

There are a number of signs that Social TV is emerging as such a killer app (some mentioned in previous posts).

• IntoNow launched in January 2011 and was quickly acquired by Yahoo on 4/25/11, and Spot411 re-launched 7/18/11 as TVplus.  Both have gotten prominent press and both do fully automatic syncing to any program, without need for any involvement by the TV distributor. 
• The Wikipedia article on Social Television was created in 5/07 with 3,244 bytes, grew to 5,528 by the end of 2009, then grew to 10,469 by the end of 2010, and to 16,851 by 8/23/11.  It now includes a list of 32 such systems (not all of which involve two-screens).
• One of the most popular FIOS TV apps was the Twitter app.

Being a killer app does not mean it will ultimately dominate the use of the platform, but only that it drives early adoption.  I suggest there are other killer apps for coactive TV as well, and that the long term value will span a wide range of apps.

• From a user viewpoint, EPGs (electronic program guides) are another important killer app, not least because it is one the MSOs (multi-system operators, TV distributors) are embracing along with users.  EPGs showcase the value of the companion device to allow interaction with a nice UI, and without interfering with current viewing.   The irresistible power of the iPad UI and relatively open ecosystem has finally convinced the MSOs that they must go outside the box (at least as to the set-top box and the TV screen).  Comcast and Time Warner Cable have moved quickly to offer tablet-based EPGs and DVR programming.  The coactive EPG will evolve into the full "Media Concierge" service that I have been blogging about since 2005). 
• The real money to drive all of this is in advertising.  Obviously this will drive the service providers and advertisers, but I submit that users too will recognize and increasingly demand the value of well targeted ads that exploit the flexibility of coactive UIs to be unobtrusive.  Well targeted ads can be a valuable service, as long as they are no more intrusive than the viewer wants them to be (which may vary from time to time, and from ad to ad).  Coactive ads--driving from a short spot to a companion microsite (whether linked to live, or deferred using a bookmarking feature)--can be far less intrusive and far more useful than a longer TV ad with no coactive companion element. A good UI can give the user control over when and how such ads appear.

All of these promising killer apps have synergy with one another.  Coactive TV is at heart hypermedia, and thus "everything is deeply intertwingled." (Quoting Ted Nelson, who also coined the terms hypertext and hypermedia.)

• Social TV apps can work both as program enhancements and to provide program guide/media concierge services.  
• Social TV can also be about ads, such as during the Superbowl, or when any ad of interest to my social circle appears.
• All of these will drive usage of enhancement content (such as IMDB pages), which will create further synergies.

But there is one more thing that is essential, and that is ubiquity. While full, ubiquitous coactivity is not central to all Social TV, I suggest it is essential to enabling it to reach scale.

• Synchronizing Web browsing to TV can be done manually, and has for decades.  Viewers have created their own Social TV ever since the first two people sat with a laptop in front of a TV, and ever since the first online chat about a TV program.  It can also be automated with program specific apps.  ABC did it a decade ago with Enhanced TV for the Oscars and other shows, and now on the iPad for Grey's Anatomy, but program and network apps cannot create massive synergy.
• What is essentially to enabling Social TV (and most other CoTV apps) to cross the chasm is ubiquity.  Siloing companion apps to a separate app for each network or program or advertiser is hugely self-defeating.  How many users will load more than a few apps, and how many will bother to open those apps more than once?  Just as the Web eliminated the need for separate apps for every content service, a ubiquitous CoTV service will require only a single context-linking app to reach services for every program, to every Web service. There will be all kinds of mashups driven by that context, but an effective context-linking service must be essentially universal.

A truly ubiquitous coactive TV service will be always on, and always aware of a viewer's TV context (except when disabled).  Such a ubiquitous service can activate any Web service and any application, in a rich ecology much like that on the Web.  That way a user can just set up the coactive companion context service just once, and get synchronized for any program or ad, to any social networking service, content service, or whatever -- whether directly, or via mashups.  (Just how such services can be structured to enable flexibility and user control was described in my published patent disclosures, and will be a subject of  future posts.)

It now appears that Social TV is the next big thing in TV, and will drive full coactivity -- but a whole lot of other functions will ride its coattails.

How do you explain something that's never existed before?

This is one of my favorite images, and largely speaks for itself.  So you can stop here (all else is commentary).  

----

A "better mousetrap" is easy to explain.  The first mousetrap, like the first wheel, is not so easy.  

This cartoon is from the October 1981 announcement of the Xerox Star workstation, the productized version of the Alto, the very first WIMP (Window, Icon, Menu, Pointing device) Graphical User Interface.  (To anyone who has the full advertisement this was clipped from, I would love to have a better, more complete copy.)

Relevant to my theme of user-centered media, this gets to the idea that the user may not know what he really would like.  In many respects, Steve Jobs is a champion of user-centered media (even if maybe not user-centered business practices).  Asked why Apple doesn’t do focus groups, Jobs responded: "We figure out what we want. You can’t go out and ask people ‘what’s the next big thing?’ There’s a great quote by Henry Ford. He said, "If I’d have asked my customers what they wanted, they would have told me ‘A faster horse.’"”  Of course we need to think of the user, and usually should listen to them, but to innovate, one must look far in front of them.

All the best really new ideas are simple at heart, but have many aspects and embodiments.  Like an embryo, it may be all there at conception at some level, but the details that work in the world unfold as you let it grow to maturity.  Depending on context, some aspects grow faster and are more apparent than others.  But explaining them is no easy task.  I have enjoyed seeing many new ideas in early stages, but am still trying to learn how to explain them.  Steve Jobs has the advantage of being able to build them and show them off.  I have not had his resources.  And sometimes no one has the resources until the time is right.

I tried to convince Mobil Corporation to buy a Star workstation to experiment with when I was in their technology planning group in 1981, but it was too expensive, even for Mobil (which was the first company to buy a Cray supercomputer)!  The workstation cost about $100K, but  as I recall, a useful single-user system also needed a file server, print server, and communications server, totaling about $250K minimum (about $600K in current dollars).

I watched hypertext unfold since 1969.  Ted Nelson did a masterful job explaining it (inspired by Vannevar Bush's 1945 vision in The Atlantic Monthly), and Doug Engelbart spectacularly demonstrated similar techniques in what was called "the mother of all demos" in 1968.  But it was slow to reach wide recognition until technology advanced, Berners-Lee simplified it, and Andreesen packaged it.  

As to my own inventions, I have struggled with the challenge of trying to explain online/local hybrids in 1994 (now in RSS, AJAX, and HTML5), coactive TV companion devices (now emerging for iPads) in 2002, and now for FairPay in 2010.  (A companion post is on my FairPayZone blog.

-----------------

[Caption text:  "How do you explain something that's never existed before? ... He had a similar problem"]

The Daily, iPad, and Apps ...or Web browsing with HTML5 -- Which paradigm?

The appearance of  The Daily from News Corp. is seen as a big step in the online journalism business, as described in a WSJ article.

I played with it briefly and it brings me back to some key questions about the future of media.  It will be very interesting to see how it does.  There are a range of important issues, and here are some impressions.

The interesting business issue is how app models are seen as a last chance to give publishers another bite at the monetization apple (pun intended) vs. free Web content.  This depends to some extent on whether Apple and other app stores let publishers keep enough money and enough control of the customer relationship (which Apple clearly hates to do, but Google is more open to).  But with HTML5 Web apps as alternative, that may become a harder sell than Murdoch now hopes.

Underlying this is the big technology question of whether the app fad loses out to HTML5 Web browsing.  In many respects, the app/widget model is a giant step backward.  Pre Web, there were "apps" for every online service, and they were all unique and non-interoperable with a clutter of invocations and divergent UIs.  The Web/browser brought a "World Wide Web" of consistency and interoperability that still enabled flexibility and varying look/feel.  A key issue is how to benefit from apps/widgets without going back to another age of islands and silos?  I built some of the first pre-Web publisher "apps" for TV Guide (hello again News Corp), Golf Magazine, Sierra, and others in the early '90s, and saw first hand how much the Web simplified things for both publishers and users.

The question is why bother downloading apps, when it seems HTML5 will soon give pretty much the same UI with no download?  Most of the current UI benefits of apps will soon go away.  The lasting benefit of the app store is central merchandising/sales (and a home page UI), and as Google shows with their Web app store, this can be done as little more than a Web site.  A few useful links are an Engadget article, the Chrome Webstore, and its FAQ.

Check out NY Times and SI Snapshot Chrome apps for an app-like experience in a browser, with little or nothing to download.  The NYTimes chrome site actually runs in Safari on the iPad and looks/acts much like the iPad app (but seems to give a different content mix).  The only essential thing the app store really adds is the home page array of icons (and maybe a different way to get people to pay).

I will bet on the browser.  It offers the best overall and most open user-centered experience.  And I think there are other ways to solve the monetization problem.  (One in particular is my FairPay pricing process, with an example of usage for a newspaper on my FairPay Zone blog.)

The awakening of TV to the 21st Century ...Real Soon Now?

CoTV was ahead of its time in 2002...  Now the stars may really be aligning for TV "companion" apps.


When I talked about CoTV to people at major TV and Web companies in 2002-5, they thought it was a good idea and assured me "Yes, I get it."  Some did, and some just thought they did.  Like all forms of "interactive TV" it has been "just around the corner" for many years "waiting for the stars to align."  But now the stars really do seem to be aligning.


At the recent TV of the Future "TVOT NYC Intensive"  from iTVT and Canoe, it was evident that important things are happening:

• iPad has awakened he giants:  Comcast, Time Warner, TV networks, TiVo, and many others are jumping into coactive "companion" apps for tablets (and phones).  iPad and other tablets are nearly ideal companion devices, and already in millions of laps.
• Platforms for interaction (CableLabs/Canoe, ETV, EBIF, ...) are enabling real innovation and increasing openness from within the distribution establishment.  EBIF is in over 20 million homes, and growing rapidly, not only in cable systems.  ETV is getting real.  The PayPal Buy Button is a nice example.
• Over-the-top alternatives are real -- the incumbent system operators know they need to get into the 21st century or watch their content distribution business get bypassed.

At the same time, others are moving in the same direction, and users are doing it themselves, manually and awkwardly, but in growing numbers:

• External plays based on TiVo, Blu Ray (Pocket BLU), and sound recognition (Spot411 Entertainment Tonight) show how this can be done outside the cable plant, even for shows distributed on cable.
• Social TV apps (about what you are watching now) are making the viewer value proposition even more powerful.

What is missing is for a smart player to provide an "always-on" TV sync connector -- a single app and context portal that drives any companion content for any show (and any ad) to a large base of households.  The problem has been that nearly all attempts to provide TV companion apps have been siloed, and limited to a single program or network.  

• In the early 2000's ABC ETV and Goldpocket did second-screen companion apps for major network shows (Millionaire, Sunday/Monday Night Football, Academy Awards, etc.) but only if you navigated to an ABC or program-specific Web site.  Up-take was rarely even 1% of  viewership, hardly a basis for a business.
• Now iPad and iPhone apps are creating similar experiences, but for the most part it is still a different app for each show or network.

How can anyone really expect significant uptake when users must know there is a particular app, bother to get it, then bother to use it, and then do the same every time they change channels or programs?  Even now at TVOT, I spoke to someone from Canoe who seemed to think I must be some kind of idiot to view this as a problem.  Saying (my paraphrase): "The user can just get the right app, or just go to the right Web site.  That BMW ad you want to sync to is a network ad, not a cable ad, so the network has to provide the app -- or the viewer can just go to bmw.com. That is simple -- why can't you see that???"  

One more time:  The viewer should not have to switch from a Comcast app to an ABC app to an MTV app to a BMW app (or enter a different URL) every time a program or ad changes. Only when there is one app (or Web portal) that seamlessly syncs enhancements for any show and any ad will this be easy for the viewer.  I should just be able to turn enhancements on, and have them appear on my tablet with no further effort (until I turn them off).  And when it is that easy, companion enhancements might quickly grow to 10-20-30% of viewership or more.  Just the linkage revenue from linking those ads would be worth many billions.

So does anyone get it yet?  Yes.  My contacts with well-placed industry players indicate that more and more of them now do get it, and some see it beginning to happen in the next year or two.  The cable operators have finally recognized that set-top boxes are good MPEG engines, but hopelessly inadequate platforms for user interfaces, and that they must open up to partners using Web-based technologies.  Canoe is seeking outside partnerships and ideas.  Maybe the system operaors will actually do what they need to do.  One interesting hint of this new direction is the eBay companion TV app, which can sync an iPad with any program on an EBIF-enabled set-top.  A demo by RCDb at TVOT Intensive showed a similar app for syncing iPad enhancements to deliver IMDB pages and other content.  Cable operators are starting with companion program guides, but a program guide that does not know what you are watching right now is pretty lame (as they are aware).  Once they provide that added smarts to the companion, linking to program-specific enhancements will be (relatively) easy.

And if the distributors do not get their act together, outsiders will do it.  The Spot411 effort shows one approach, and there are many others.  TiVo is well positioned to do it (and could still win big if it did).  And if it comes too slowly to the legacy providers, the IPTV players will soon have enough viewership on big screens to lead the way.

So who will it be that realizes this is a critical race, does it right, and wins it? TV is ready to be reborn for the 21st Century.  Once someone makes it easy to use across the board (and does not cripple it), it will happen very fast.

Sent BMW into the shop -- but it was a server problem

Thinking about The Internet of Things, as IBM is promoting it, it struck me that my recent automotive service experience was a telling landmark in the coming of the new order.

My new 3-series has a BMW Assist feature with its navigation system that lets you find a destination on Google Maps in your home or office, and then send it to the car, so the guidance system can take you there.

I tried it several times, but could find no messages in the car from Google Maps (which said they were successfully sent to my car). BMW Customer Service remotely fixed some errors they had in my account email address, but it still did not work days later, so they said I had to take it to the shop. Seemed like a server-side problem to me, but that is what they wanted...

After a couple phone calls while working on my car (over the course of 3 days), the dealer service rep finally called to say the messages were there, but that it was hard to find them (he had never worked with the feature before). We assumed I must have been looking in the wrong place. He suggested I come in for instructions, but I suggested I call from the car when I could. BMW needs to hire some people from Apple to work on UI, but wait, there is more..

After getting the car back and sending it a new destination to look for, I got in and looked around, starting with the same menu selection I had looked into before ("BMW Assist/Messages"). Lo and behold: there were my previous message, a couple dealer test messages (opened), and my new message (unopened) -- right where it kept saying "No messages" before.

I can only conclude that the car had been fine, I had been using it properly, and something changed on BMW's end (either in some server, or in the setup entered into some server by BMW Assist staff.

Imagine the cost of sending thousands (eventually millions) of cars into the shop for problems that could be diagnosed and fixed remotely! BMW does not yet realize they are in the network services business (and selling network node devices). I hope they realize it soon.

Internet of things, Internet of computers, Internet of people. ...Convergence every which way ...I can't wait for the next release.