virtual reality – I Spit Hot Fire

Trying out LucidCam and the YouTube VR180 Format

I’ve been playing with a LucidCam recently as part of my work. LucidCam’s is a really easy way to start taking 180 degree VR content, both with photos and videos. Just turn it on, choose a media mode, and then point and press the “shutter” button to shoot. There’s no viewfinder, though you can enable one through your phone if you tether it to the camera via a direct wifi connection.

The 180 degree lenses basically takes away the need to focus – as LucidCam says, you can “capture moments from your perspective”, which just means you can capture everything (technically more) your eyes see, so there’s no need to spend time framing a shot.

Below is a playlist of some bike rides I took this week in the South Bay (you can view in 180 degree 3D with a VR headset like the Google Daydream one). The first set of videos is from an evening commute ride from Apple in Cupertino to Mountain View, the second set is an early morning ride through Palo Alto and Los Altos.

A Kellogg MBA Perspective on What Happened with Google Glass and What Should Be Next

Over the Winter Quarter, our Technology and Innovation Strategy class at Kellogg culminated in a final research paper. The paper looked at the shuttering of Google Glass and what Google’s next steps should be. As part of this, I got to look deeply into the current state of Virtual Reality, which I have been following and waiting for (hello Oculus!) since I was a child, and Augmented Reality. I will be posting portions of the paper (it’s quite long) in digestible chunks here over the next week. Our team was comprised of Melissa Caldwell, Raghu Chirravuri, Olga Gordon, Jeff Hoffman, and me, Michael Nguyen.

To see all of the sections, see my tag virtual reality.

Google Glass: A Brief History

The idea of Google Glass was born out of a brainstorming session about the future of computing by Google’s founders and several key executives in 2009. Google decided to pursue a portable computing technology that could be attached to the body or worn on glasses. A team of developers, scientists and researchers was recruited and the project was placed inside its own experimental lab called Google X. By 2011, there were conflicts within Google X over issues such as privacy and appropriate public use cases. Sergey Brin argued for the release of the Glass prototype despite agreement among the project engineers that the design was not ready. Brin argued that the uses and societal issues caused by the introduction of Glass should be discussed transparently in a public forum with the users and pushed for the immediate release of the prototype.^[1]

Glass was publically announced in April 2012. An estimated 2,000 units were pre-ordered.^[2] In the spring of 2013, Glass was launched exclusively at “Basecamp” stores located in New York, San Francisco, Los Angeles, and London at a $1,500 introductory price point. Although there was significant interest and hype surrounding the product release, Glass was introduced with bugs and suffered poor reviews stemming from short battery life and poor screen and camera quality. At first, sales were by invitation only and mostly extended to journalists, developers, and tech media.

Google did not accurately predict the societal backlash against Glass, including privacy concerns. Months before Glass was released, states started passing laws to prohibit use of wearables while driving. People began to associate the device with invasion of privacy. Google responded to concerns by releasing an etiquette guide in February 2014, approximately a year after Glass was released.^[3]

Many developers abandoned their Glass projects citing lack of consumer demand and support from Google as the main reasons for halting their operations. The developers who continued to create products for Glass have pivoted their strategies for enterprise application rather than consumer use.^[4] In January 2015, Glass stores were shuttered and the project’s key employees were reassigned to different areas of Google. Google’s release of Glass mirrored their software releases in that they provided access to the device and garnered feedback from users. However, this strategy backfired as the device was a very expensive prototype, prompting many early adopters to publish negative reviews publicly.

Aside from the failed marketing launch, Google did not address all of the impediments required to adopt this new technology on a large scale. The team never found a “killer” mass-market app or use case that would encourage mass penetration, leading to consumer and developer confusion over how to actually use this new technology. Although Google has announced that Glass is dead, there appear to be signs that Glass is being repurposed for enterprise uses or concept redesign as the project has been moved to the leadership of Tony Fadell and the Nest team, known for its Internet-of-Things connected home devices such as smart thermostats.^[5]

Glass for Med

We recommend re-launching Glass with a medical focus in order to establish a foothold where it can gain new users, learn about how consumers will use its devices, and the ways to work with developers to improve device functionality. This strategy coincides well with Google’s focus on using technology to improve quality of life for people and can help lean away from the negative connotations of Glass, rebranding it as a product that enables the good in society, working with doctors to revolutionize the healthcare industry.

Before its shift in focus, Google Glass was in the early stages of the adoption curve with hospitals and doctors – the most tech savvy among them were using the technology. There are a myriad of applications for medical professionals; examples include helping guide surgeries, documenting and transmitting audio and video of procedures, and allowing increased access to patient information. Many hospitals have been willing to adopt iPads to replace clipboards and folders and we see Glass adoption as an extension of this technological shift. Glass will prove superior to the iPad as it is more sanitary and can be operated hands-free. Some hospitals like Massachusetts General and Beth Israel Deaconess^[1] have already shown interest in figuring out the best ways to use the technology.

We propose Google partner with beacon hospitals to roll out the Glass program hospital-wide and connect doctors with application developers to help design more ways to use the technology. Google can act as a facilitator between the developers and doctors to tailor apps specifically for Glass. By focusing on a few hospitals, Google will be able to work very closely with the doctors and developers, creating a feedback loop to help Google have a firm understanding of how exactly people use the technology in a wide variety of use cases and what could be applied beyond medicine. This will also give more people exposure to Glass, where they can directly benefit from use of it, through faster doctors appointments.

Success will be measured primarily in the information that Google is able to collect from the hospitals, doctors, patients, and developers. Feedback from each of these parties will be integral in understanding how Glass can be used more widely, specifically what type of experiences can best leverage the platform as well as ways to train people on the best ways to use Glass. Utilizing the hospital pilots to increment the product as well as seed a network of evangelists more effectively than the Explorers program will allow Google to continue to perform R&D on this AR technology in an outward facing manner while creating new PR and marketing opportunities, helping to repair Glass’s tarnished brand. Over time, Google will be able to gauge the external market for Glass and enter when it feels like both the product and consumers are ready.

3D Content Hub

In parallel with developing niche applications for Google Glass, we believe Google should leverage AR/VR technologies to create a 3D content platform similar to YouTube. Leveraging Google’s strengths in advertising, experience in platform building and their portfolio of assets like search and Android, we see a 3D content platform as the next paradigm in online content. It will be aimed at both businesses and consumers, allowing both parties to create and view 3D content. With content categories like product demos, training videos, and entertainment, this new platform will grow traffic to Google, increase advertising revenues, and attract users to Google’s other products like Android, shopping, and search.

To successfully build and scale such a 3D platform, Google will first need to identify a VR/AR technology that can be used to record and display AR/VR content. This technology could be based off Magic Leap or some other technology currently in development. The next phase will be to build a YouTube-like content platform that enables upload, search and discovery of AR/VR content. Google could use Search, android and Youtube to drive traffic to this new platform and get users engaged. We believe that it is also important to train customers (both business partners and end consumers) on the new technology to make it easy to record and view content on the platform. In addition, Google could seed the platform with content by hiring or partnering with content developers. Incentivizing content creation will produce high quality content and attract viewers to the platform, who will in turn create and share content. Google has done this successfully in the past with YouTube and we believe that they can achieve similar success with this new content platform.

Success in building this new platform can be measured by comparing the size of the captured AR/VR content market. Another indicator of strong growth is the number of content creators and subscribers. As the platform grows and advertising is incorporated into it, advertising revenues could be a measure of commercial success. Lastly, synergies between this new platform and Google’s existing products could be measured by incremental growth in Android, shopping, and search.

Conclusion

The reason that creating footholds in the Augmented Reality and Virtual Reality spaces is important is in how the battle for these technologies mirror the web browser, smartphone, and tablet wars. In the recent technological age, networks effects are key to success, making it imperative to be an early mover to create a seamless and usable experience for users trying out new technologies. This is why each of these competing firms are focused on capitalizing on the next consumer leap in technology usage: they want to set the standard for consumers. These firms moving quickly in the AR and VR ecosystems, as it is clear this is where consumer and commercial technology is going.

We believe that it is crucial for Google to aggressively pursue both VR and AR solutions to be the platform of the future. By utilizing the foundation that Glass built and expanding use within hospitals, we can better understand usability issues and build solutions specific to doctors, but apply learnings more broadly. Additionally, with our capabilities in building developer platforms, we should continue to pursue our content hub as a place where developers can develop content to be consumed by masses. A combination of these moves will allow Google to continue to be the industry leader in the future, a position that will afford us new ways to capitalize on advertising and build a more complete picture of consumers than our competitors.

^[1] http://venturebeat.com/2014/03/12/forceps-scapel-google-glass/

^[1] http://www.nytimes.com/2015/02/05/style/why-google-glass-broke.html

^[2] http://glassalmanac.com/history-google-glass/

^[3] Ibid.

^[4] http://www.reuters.com/article/2014/11/14/us-google-glass-insight-idUSKCN0IY18E20141114

^[5]An insider’s look at the tumultuous launch of Google Glass http://www.businessinsider.com/google-glass-launch-2015-2 Published Feb 28, 2015. Accessed March 1, 2015.

A Kellogg MBA Perspective on Virtual Reality & Augmented Reality Consumer and Enterprise Adoption

To see all of the sections, see my tag virtual reality.

Consumer Adoption of AR and VR

AR and VR are gaining adoption and becoming more standard, with consumers getting more exposure to them in day-to-day life, particularly in retail, education and entertainment industries. By layering information onto existing objects or creating virtual environments, they provide consumers with richer, context-specific information in 3 dimensions.

Technologies are now available that make it possible for grocery shoppers to scan aisles with their smartphones or other AR devices to quickly identify products that are on sale or address certain dietary requirements and preferences. Layering this information onto existing physical stores helps customers efficiently browse and purchase products. In some cases, AR is not layered onto a physical store but onto a blank wall. Yihaodian, a leading Chinese e-commerce grocer, launched 1,000 virtual stores overnight to compete against its brick-and-mortar rivals with experiences that allow customers to walk around in the virtual stores and make purchases that are delivered directly to homes. Similarly, several fashion retailers are using AR “magic mirrors” to allow their customers to “try on” clothes, jewelry or shoes and help customers decide which clothes or accessories to buy without having to actually stock the items.

In education, AR and VR are being used to embed content into text and real world objects, allowing for visualization of 3D models and interaction within historical events, as well as remote collaboration. In higher education, AR and VR allow students to learn mechanical engineering concepts, math or geometry through 3D models that help them visualize spatial structures and interact with virtual models.

Learning via remote collaboration is another major use case for education; students and instructors at different physical locations can share a common virtual environment populated by virtual objects and learning materials. These technologies allow students to interact with objects in topics like astronomy, biology and medicine that would otherwise be inaccessible.

AR and VR have also been adopted by media companies to provide a more immersive entertainment experience. For example, AR is currently being used to create interactive movie posters and to embed content into movies that can be accessed through smartphones or other AR devices. At the same time, work is being done to create fully immersive 3D movies delivered through VR headsets. AR technologies allow gamers to experience digital game play in a real world environment, where movement detection allows players to interact with objects within the game using gestures and eye movement. VR systems like Oculus Rift create an immersive gaming experience where the user is placed into the game environment, opening up innovative content delivery prospects.

Enterprise Adoption of AR and VR

AR and VR also have the potential to change the way that many businesses function due to the technologies’ abilities to immersively simulate varied situations and conditions, particularly in industries such as the military, medicine, and automotive design and manufacturing.

The military has integrated these technologies more than any other industry across different use cases. One of the military’s primary applications of VR has been in training. Formerly, training would consist of physical simulations and crude recreations, but VR has provided a much more accurate, immersive version of what it actually feels like to be on a mission.^[1] VR can also be utilized to simulate controlling drones so that training runs are as close as possible to the experience of when a drone is actually deployed.

AR and VR have also seen traction in the healthcare industry, as a number of implementations could improve patient care and make doctors’ jobs easier. From allowing doctors to quickly source and project medical histories, to lenses that allow them to see through a patient’s skin and identify veins, making it easier to place IVs correctly; hospitals were among the most loyal adopters of glass.^[2]

AR can also be utilized during surgery. AR-implemented glasses (such as Google Glass) allow surgeons to record accurate representations of their work hands-free. They can stream video of surgeries around the world, allowing remote doctors to offer advice on difficult procedures. Information overlays will be extremely useful in the future, as the steps of a given procedure could be presented unobtrusively through a surgeon’s line of sight.^[3]

As the automotive industry has historically been on the cutting edge of technology, it is no surprise to see that the biggest firms are leveraging early forms for AR and VR to help design, test, and manufacture new products. Ford has already partnered with Oculus, utilizing VR to rapidly design and prototype new cars. The headset allows engineers and designers to virtually enter the car and evaluate its design more practically than a 3D model on a computer or small-scale mock-up.^[4]

Despite these exciting ventures, there are still a wealth of implementations not yet explored. For example, AR could be leveraged to help with manufacturing, increasing the complexity of products while decreasing the amount of focus and time commitment needed per-employee. During the manufacturing process, a projection could be displayed over two components to show how they properly fit together. Assembly and disassembly processes could also become easier as step-by-step instructions could be overlayed on a given product, making it easier to understand the order in which to proceed.^[5] In addition, videos could be presented to the employees unobtrusively when text instructions may not suffice. Further uses include the ability to use VR to allow engineers to see inside of components to understand how they really work and are constructed.

^[1] http://ultraculture.org/blog/2014/11/19/us-military-piece-virtual-reality/

^[2] http://thenextweb.com/dd/2014/01/01/medical-augmented-reality-will-seamlessly-save-life/

^[3] http://venturebeat.com/2014/03/13/this-stanford-surgeon-shows-us-the-future-of-medicine-augmented-reality-google-glass-exclusive/

^[4] http://www.fastcompany.com/3024328/innovation-agents/ford-taps-oculus-rift-for-future-automobile-designs

^[5] http://advancedmanufacturinginsight.com/archived-articles/item/augmented-reality-manufacturing

A Kellogg MBA Competitive Analysis: Major Stakeholders in Augmented Reality / Virtual Reality (Microsoft Hololens)

To see all of the sections, see my tag virtual reality.

Microsoft (Hololens – Augmented Reality)

The most direct threat to Google’s existing business is from Microsoft’s Hololens headset. Similar to Google Glass, Hololens is a stand-alone, untethered AR headset extended from the Xbox Kinect platform that will be released with the launch of Windows 10 by the end of 2015. Hololens differs from Glass, as it has a full computing platform built within the headset. Running on Windows 10, this headset can project images not just on top (as Google Glass) of what the user sees, but also can place 3D holographic objects into the real world and allow people to interact with those objects naturally with hands, fingers, and voice. This functionality means a Hololens wearer could watch a holographic large screen TV on a real living room wall, play with digital Legos on a kitchen table, or even walk across the surface of the moon and view details on the ground in high resolution.

The potential of Hololens lies in its integration into the complete Windows 10 ecosystem. Microsoft is focused on having one Windows 10 operating system across PCs, tablets, and mobile phones, and Hololens is meant to serve as a complete communications, productivity, and entertainment platform. This would allow apps running on any other Windows 10 platform would run just as easily run on Hololens, eliminating the inertia present in creating a developer ecosystem. Microsoft sees the evolution of the tablet as a portable computing device in Hololens, and possibly as an eventual replacement for the monitor. This is an attempt to define a new product category and jump-start it with an existing ecosystem, as Apple did with the iPad. Success will depend on how well the Windows 10 unified ecosystem works in reality.

We expect several shortcomings from the initial Hololens product, similar to Google’s own experience with Glass, including battery life, overheating, and outdoor usage. While Microsoft does have hardware experience from its video game and mobile phone (formerly Nokia) divisions, it is unlikely that a launch with such new technology and learning curve will soon reach a mass-market audience in both reception and pricing.

It is possible that in a future in which Hololens becomes successful, users will no longer rely on a Google search box to look for information, instead using the Cortana personal assistant interface in Windows 10 by pointing at an object in view or issuing a vocal command. Regardless of whether Hololens can be an immediate mass-market success, as an early mover, this is a significant attempt by Microsoft to own the category and define standards for how people engage and interact in AR, similar to how many standard mobile touch gestures were defined by Apple.

A Kellogg MBA Competitive Analysis: Major Stakeholders in Augmented Reality / Virtual Reality (Sony, Oculus, Valve)

To see all of the sections, see my tag virtual reality.

Competitive Analysis: Major Stakeholders in Augmented Reality / Virtual Reality

While numerous firms are engaging in VR or AR headset platforms, firms that have major corporate backing to avoid being acquired and have the finances to pose a legitimate threat to Google are discussed below and in summary Table A.

Sony (Project Morpheus – Virtual Reality) and Valve (HTC Vive – Virtual Reality)

Sony and Valve are similar in their focus on gaming entertainment through VR headsets. While Sony has its own console platform (Playstation), Valve focuses on the PC market, creating a consistent gaming experience for PC gamers regardless of hardware manufacturer or operating system through its Steam gaming platform. In March 2015, both companies revealed they are planning to release their products by the end of 2015. Sony will develop and manufacture its own headset, while Valve will work with partners such as HTC to release headsets, similar to Oculus and Samsung in producing Gear VR. With both firms’ focus on entertainment, these are greater threats to Oculus, discussed below, rather than Google AR and VR.

Facebook (Oculus Rift – Virtual Reality)

The Oculus headset is a tethered (wired) unit that requires a high-end PC to power, creating a sit-down user experience. Oculus has gained traction in VR and AR by creating an ecosystem of applications and new hardware add-ons that add functionality to the device such as body movement and finger tracking for user interfaces.

Oculus initially had a pure focus on gaming and simulation rather than productivity, making it less of a threat to Google. However, with the Facebook purchase of Oculus VR and the announcement of the partnership with Samsung to release Gear VR (more detail below), the Oculus platform is more of a threat. Aside from its current dominance as a social platform over Google+, Facebook has also launched search, advertising, and portal-like products that combined form a significant threat to Google as the default source of information of the masses.

Oculus has released several developer headset kits to the community, with the first consumer-focused version expected in 2015. Oculus has repeatedly stated the consumer product must be oriented to the mass-market not only in functionality but also price. While Facebook does not have direct experience in producing hardware at mass levels, Samsung, its partner on the Gear VR, does. Thus, we believe that Oculus will be able to deliver a mass-market headset more quickly than other competitors.

Samsung (Oculus Rift / Gear VR – Virtual & Augmented Reality)

Samsung’s Gear VR is an untethered (wireless) headset that requires the Galaxy Note 4 mobile phone. Note 4 users simply insert the device into the headset. Using Oculus technology, the Gear VR has an advantage over Oculus because it supports AR through its outward facing camera. Unlike other AR solutions, Gear VR cannot not reasonably be worn outdoors. While Gear VR does not compare to full-powered VR solutions such as Oculus, the partnership creates two concerns for Google. First, Samsung is a dominant global hardware partner for Facebook, with experience in display and mobile technologies. With Samsung as a manufacturing partner, Oculus would have an advantage in merchandising over other platforms. Second, the partnership creates more exposure to the Oculus platform for users and app developers. The Gear VR was released in December 2014 at $199 (non-mass market focused “Innovator Edition”); based on Samsung’s aggression in the mobile market, we can expect rapid iterations on the platform and increased compatibility with new phones.