When Microsoft released the Kinect, people thought it was a great gaming innovation. But it was the company’s decision to open up the platform that led to a Cambrian Explosion of innovation. The Kinect has won awards around the world, and it’s being used in dozens of new, and often unexpected, ways. In this session, Sheridan Jones, Director of Business and Strategy for Kinect for Windows, looks at some of the products and businesses around the world that have picked up the torch Microsoft lit, and incorporated natural user interactions into how they work. We’ll see how these creations are changing lives in often surprising ways. And ultimately, we’ll see that the dirty little secret behind any innovation is that while innovators are catalysts, it’s the ecosystem of businesses, developers, and end users that are the reagents producing real, lasting change.
12. BIG BRANDS LOVE KINECT
Nissan created the Pathfinder 2013 Virtual Tour for the Chicago Auto Show to give visitors the
ability to experience the car inside and out through gesture and movement.
Bloomingdales and Bodymetrics introduced a body-mapping “pod” at their Los Angeles store in
March to help women shop for the perfect-fitting jeans.
Mattel is hosting a series of events at malls across Australia this year with the Kinect-enabled Barbie
Dream Closet, which allows people of all shapes and sizes to virtually try on 50 years of Barbie
designs.
I’m Sheridan Jones, and I am the Director of Business and Strategy for Kinect for Windows. Today I want to talk to you about whole new ways humans are interacting with computers, enabled with what began as an inexpensive consumer device built for gaming and entertainment, but what is becoming a tool to revolutionize businesses and industries in ways we’ve never seen before.
Interfaces evolve
We began with the manual input of command line interfaces
Which was replaced with GUI
And we’ve moved on to ever more natural interfaces like we have today with our phones, with Surface, with PixelSense
Interfaces are becoming ever more natural, and one of the best examples I can think of is the Kinect. When we introduced the Kinect for Xbox in November of 2010, with the promise of YOU ARE THE CONTROLLER, we exploded the current paradigm of interaction for gaming and entertainment, and it was a game-changing success.We sold an average of 133k units per day in the first 60 days after we released Kinect for the Xbox 360Kinect combinesarray microphonesa projected IR dot patternan IR cameraRGB camera to sense the surrounding environment. With these inputs, the Kinect sensor can isolate and record sounds, generate a room depth-map, and build 3D models of human faces and skeletons. With almost 20 million units installed in living rooms around the world, it is safe to say that Kinect for Xbox was a gamechanger.
When we launched Kinect for Xbox, we saw an immediate response from developers and researchers who wanted to experiment with Kinect on the PC. It was amazing the number and diversity of applications we saw in the first few weeks as people hacked together drivers and started playing with the potential. And so we asked ourselves: what would happen if we REALLY brought Kinect to the PC, if we built a team, if we supported Kinect as a product for Windows. Where could we take this?
In the first few weeks after we released Kinect for Xbox amazing things started happnening – developers and imagineers all over the world started experimenting with Kinect on the PC; we called this phenomenon the Kinect Effect.
At Microsoft, we believe in the power of technology to change the world. We have invested years of R&D and hundreds of millions of dollars to bring Kinect to market. Starting with a home run in the consumer space with Kinect for Xbox, we have now taken this technology to Windows so businesses can build applications for the PC.With the launch of Kinect for Windows, developers are creating a whole new class of Windows applications using gesture and voice, and companies worldwide will use Kinect for Windows to enhance their businesses, their products, and their relationships with customers.We believe we are at the beginning of a revolution in the way humans and computers interact.
We’re building the future with customers and partners all over the world. Today, we have over 350 participants in our Testing and Adoption Program. Some of the world’s most recognizable brands are investing in Kinect for Windows scenarios. Almost every industry you can imagine is represented.
All of these different companies are doing radically different things in just about every context you can imagine, but there are a few scenarios that seem to have huge immediate potential: Therapy, healthcare, retail and training applications are all extremely interesting. For example, consider the surgeon you see up there using Kinect to help him review a patients’ data during an operation. In the past, if that surgeon had wanted to look at his patients’ MRI while he was operating on them, he would have had to leave the sterile field in order to use a keyboard and mouse. Gloves off, rescrub, gloves back on – the entire process can take as long as 20 minutes. If I’m on that operating table, I don’t want the surgeon to lose that time. This is a really simple application of Kinect, but it can have a significant beneficial impact, and it is in place in operating rooms today. That application was created by a young Canadian company – GestSure Technologies out of Toronto.Interacting with the deviceAugmenting or replacing traditional modes of inputInteraction where previously no interaction existedVisualizing dataInteracting with the physical environmentPassive monitoring of people / environmentAugmented & virtual realityVisualizing physical environments & objects
Some of the world’s biggest brands are very early adopters of Kinect in retail applications.
But I believe we’ve only just seen the tip of the iceberg. The next wave of innovation will come from you – from the start-ups and innovators who have the vision and the drive to take this technology to almost unimaginable heights. You will build the future.
One of the ways that we at Microsoft are investing in helping start-ups to realize this future has been through our recent Kinect Accelerator project we ran in Seattle, WA.Nearly 500 applications63 countries, 19 industry verticals4 city Meet Up tour – 125 per event10 companies selected3 months of hands on mentoring and creativityApril – June – downtown SeattleTechStars Entrepreneurs & MSFT engineersFinal presentation to audience of angel funders and venture capital
11 dreams of the future, accelerated, and two of them were Canadian companies. GestureSure, I already mentioned, and another young Canadian company changing the world with Kinect, and here at the Startup Festival today, is Jintronix.Seattle-based Freak'n Genius makes it possible for anyone to animate instantly, utilizing Kinect for Xbox. Founder and CEO Kyle Kesterson, co-founder and CTO Dwayne Mercredi, co-founder and CMO Clayton Weller, and Interactive Music Architect Andrew Willingham, make it super simple and fun to create and instantly share more engaging video content through an innovative combination of 2D animation and music, using real-time voice and motion capture.GestSure Technologies has developed a device allowing surgeons to navigate patient MRI and CT scans in the operating room while maintaining sterility. Inspired to find a better solution, co-founders Jamie Tremaine, CEO, Greg Brigley, Engineering Lead, and Dr. Matt Strickland, Medical Lead, use Kinect for Windows and custom hardware to create a universal touchless interface for surgeons. Jamie, Greg and Matt have been friends since they attended university together and came up with the idea while jogging. The technology is currently in use at Sunnybrook and Credit Valley Hospitals in Toronto and the Mayo Clinic. Developed while coaching some of the most elite athletes in the world, IKKOS is changing the way the world learns movement by using Kinect. In his work with world class swimmers, CEO Sean Hutchison realized effective technique is the strongest factor for success in sport. The product aims to assist athletes in performing better than they thought possible through teaching physical movement faster than traditional methods. The product is also being validated in neurology by Dr. Richard Macko, Director at the Veterans Administration Center of Excellence for Exercise & Robotics in Maryland.Founded by Argentinian brother and sister team, Alejandro, CEO, and Florencia, CFO, Muther, CFO, with Rodolfo Bogado, CTO, Kimetric uses Kinect for Windows sensors strategically placed across the store to gather useful data, helping a retailer to better understand consumer behavior, and at the same time, allowing for the creation of a new interactive shopping experience for customers.Jintronix uses Kinect for Windows to track a patient's movement as they perform rehabilitation within a virtual environment, increasing accessibility and engagement, while lowering cost. CEO Justin Tan saw first-hand the challenges patients face when participating in rehabilitation after his father, a surgeon, suffered a stroke during a flight. In partnership with some of his long time high school friends, all from Montreal, Canada, Jintronix uses the depth-sensing and gesture technology of the Kinect for Windows to improve healthcare and rehabilitation.Manctlseeks to bring 3D capture to the masses by producing 3D scanning software solutions based on consumer-grade depth sensors such as the Kinect for Windows. With their main product Skanect, French co-founders Nicolas Burrus and Nicolas Tisserand challenge other expensive and complex 3D scanning solutions by offering a cost-effective way of producing real-world 3D models of people, places and things. Their current technology, already successfully used in the orthotics and lingerie industries, will be extended to address the needs of other markets, including 3D modeling, game content production and 3D printing. CEO Dan Xie, CTO ShichaoOu, vice president of development Yun Lin, and vice president of operations Haopeng Zhang of NConnex, designed technology to allow for 3D room scanning using Kinect for Windows. Their product, NConnex Designer, allows users to digitally place furniture in their home and get a feel for sense of space before purchasing. The software also has the potential to be accessed from mobile devices and tablets. Based out of Los Angeles, California, Styku is empowering consumers “try before they buy” using a virtual fitting room technology enabled with Kinect for Windows. Founder and CEO Raj Sareen, vice president Pierre Du Charme, and project manager and engineer Tommy Vo provide consumers with a clear advantage when it comes to getting a precise fit from clothing purchased online. ubi interactive can turn any surface into a 3D multitouch screen with Kinect for Windows. The company, including founders AnupChathoth (CEO), Chao Zhang (CTO) and David Hajizadeh (CFO), has created commercial solutions for interactive displays in office space and digital signage.VOXON, based in New York, NY, is developing the first open hardware reference designs and standards for 'voxie' volumetric 3D movie capture and display with the introduction of the VoxieCam, VoxieStage, and VoxieBox. Founders Alan Jackson, David White, and Sean Kean are excited to release these kits out into the creative community so visual artists, makers, and game designers can begin building experiences that will usher the pubic into the volumetric age of 'holographic' entertainment and education.Zebcare, formed in Boston, Massachusetts, by Zeb Kimmel, LinseyBattan, Avi Kimmel, and AlexaSchmuland, uses Kinect for Windows to monitor the well-being of seniors in real-time, without the use of images or video. Zebcare provides ongoing reassurance that loved ones are active and well, while ensuring complete privacy.
What we do is combine motion-tracking technology, interactive entertainment, and proven medical principles to redefine how patients access and receive physical and cognitive rehabilitation. As an alternative to high-cost and inaccessible rehab services that currently exist, Jintronix is a developing a LOW-COST and HOME-BASED solution that has two components: first, a set of engaging clinically validated exercises that patients can use with the Microsoft Kinect, and second, an online web application that clinicians can use to view precise patient metrics and customize treatment. Based on these features, our system adds value to both patients and clinicians. On the one hand, patients can access clinically-validated and compelling rehab exercises anytime and anywhere, even in the comfort of their own homes. For clinicians, they now have the ability to prescribe patients exercises and monitor their progress remotely. By harnessing new technological innovations and combining elements of gaming and telemedicine, we are offering patients and clinicians a cost-effective, engaging, and accessible tool for helping people move better, think better, and live better. There currently exist over 35.8 million1 individuals suffering from physical disability in the UnitedStates, with an additional 1.1 million individuals suffering from conditions resulting in physicaldisability each year. These patients are served by approximately 30,000 medical rehabilitationhospitals2, which equates to a market size valued at $20 billion3 in rehabilitation costs in the UnitedStates. Coupled with improvements leading to decreased rates of mortality and increased lifeexpectancy among those with physical disabilities, current trends suggest that the increasedincidence of physically disabling conditions such as stroke, congenital malformation, and spinalcord trauma will lead to an ever-growing demand for rehabilitative services in the years to come.
Jintronix was borne out of a personal experience
The Client Application is what the patient uses to participate in their rehabilitation. Using the Microsoft Kinect for Windows and a computer, their movements are captured, allowing them to interact within a virtual environment. There they participate in activities meant to target specific deficiencies. The activities, based on clinical exercises, are designed with physical and cognitive rehabilitation in mind throughout the whole development process. Working closely with both patients and clinicians, we strive to make as effective and engaging an experience as possible. With several to choose from, it is possible to work on issues such as balance, coordination, memory, and more. While patients are performing their rehabilitation, the system is recording their progress and transmitting that data to our servers. From there, a clinician, such as a physical therapist, can log onto the Web Portal and check in on their patients.They will then be able to monitor how often a person is performing their rehabilitation, as well as how they are doing in each individual activity. Based on that data, the clinician can prescribe new activities, or modify any to make them either more difficult or easy. All this is can be done from their web browser with our clean, simple user interface, from anywhere.
Back in the 90’s Microsoft had a popular tagline “where do you want to go today.” Today, the Kinect for Windows team has an even more important question for you: where will YOU take us? What will you do to change the world for the better with technology? Where can we go together? The sky’s the limit.