Mobile and Social CPS including Augmented Reality

Mobile and Social IoT +
Augmented andVirtual Reality
Bob Marcus
Co-Chair NIST Big Data PWG
robert.marcus@et-strategies.com
Work in Progress. Will expand over the next few weeks
Saturday, September 10, 16

Outline of Presentation
• Cyber-Physical-Social Grids
• Mobile CPS
• Combining Social and Mobile CPS
• Augmented Reality

Cyber-Physical-Social Grids (CPSG)

Convergence to Cyber-Physical-Social Grids (CPSG) by Bob Marcus
Internet
of Things
Social
Mobile
Cyber-
Physical
Systems
Big Data Cloud
CPSG
for Smart X
Applications

From http://www2.nict.go.jp/univ-com/isp/doc/NIST.IR.7951.pdf
SmartNetworked Systems and Societies(SNSS) from NIST and NICT
SNSS combines:
● Networked Computer Systems
● Real-time Control System
● Sensor/Actuator Networks
● Social Networks
● Cloud Computing Services
● Humans

From https://www.waze.com/about
Waze is all about contributing to the 'common good' out there on the road.
By connecting drivers to one another, we help people create local driving communities that
work together to improve the quality of everyone's daily driving. That might mean helping
them avoid the frustration of sitting in traffic, cluing them in to a police trap or shaving five
minutes off of their regular commute by showing them new routes they never even knew
about.
So, how does it work?
After typing in their destination address, users just drive with the app open on their phone to
passively contribute traffic and other road data, but they can also take a more active role by
sharing road reports on accidents, police traps, or any other hazards along the way, helping to
give other users in the area a 'heads-up' about what's to come.
In addition to the local communities of drivers using the app, Waze is also home to an active
community of online map editors who ensure that the data in their areas is as up-to-date as
possible.
Waze: Example of a Cyber-Physical-Social System

From http://scm.ulster.ac.uk/~scmresearch/SERG/ucamiiwaal2014/workshop-iot.html
High LevelVision of Cyber-Physical-Socio Systems

Internet of Everything from Cisco
From http://www.slideshare.net/CiscoBusinessInsights/fast-it-accelerating-innovation-in-the-internet-of-everything-era

From http://nlpr-web.ia.ac.cn/mmc/workshop/slides/Koji_Zettsu.pdf
NICT K-L Grid: Cyber-Physical Social Sensing Platform

From https://arxiv.org/ftp/arxiv/papers/1201/1201.0216.pdf
Smart Communities
A Smart Community can be roughly understood as a group of connected (social) objects
that interact with each other over ubiquitous networks and deliver smart services to
possibly all members.The members of a smart community are objects that can be
human individuals, as well as physical things

From http://www.knowledgegrid.net/~h.zhuge/CPS.htm
Cyber-Physical-Socio Systems

From http://tinyurl.com/gv38c78
Smart Networked Systems and Societies (SNSS)

From http://cps-vo.org/ﬁle/20908/download/60342
Human Cyber-Physical Systems

Key Challenges for Human Cyber-Physical Systems

From http://www.slideshare.net/LuigiAtzori/social-io-tsito-siot
Cyber Physical Social Systems(CPSS) from Kyushu U.

From https://www.yumpu.com/en/document/view/31538504/cpss-cyber-physical-social-system
Cyber Physical Social Systems(CPSS) from Kyushu U.

From http://www.slideshare.net/ArpanPal/cps-isi
Internet of Everything from TCS

From http://www.cisco.com/c/dam/en_us/about/ac79/docs/IoE/IoE-AAG.pdf
Internet of Everything from Cisco

From http://arxiv.org/pdf/1403.2498.pdf
Cognitive Cyber-Physical-Social Framework

Mobile and Social CPS

From http://www.slideshare.net/SukumarNayak/snsecurity-architecture-for-mobile-computing-and-iot
Mobile Computing and IoT Trends

From http://www.cloud-council.org/deliverables/CSCC-Cloud-Customer-Architecture-for-Mobile.pdf
Cloud Customer Mobile Architecture from CSCC

From http://www.techtradeasia.info/2016/06/iot-opportunity-surpasses-that-of-mobile.html
Connected Device Predictions from Ericsson

From http://www.talkandroid.com/226447-google-play-launches-page-for-project-tango-development-kit/
Google Tango

Smart Trafﬁc Control using Mobile and Social Feedback

CPS Loop for Smart Trafﬁc Control using Mobile and Social Feedback

CitiSense for Smart Cities from Redtone
From http://www.redtone.com/internet-of-things/

Citi-Sense Project’s Citizens’ Observatories Toolbox for Smart Cities
From http://social.citi-sense.eu/CitizensObservatoriesToolbox.aspx

From https://www.computer.org/csdl/trans/ec/2013/01/06558754.pdf and
http://mobilesoa.appspot.com/
Vita: Crowdsensing-oriented Mobile CPS Application

Augmented Reality (AR) and
Virtual Reality(VR)
“Reality is a spectrum from unaugmented reality through augmented reality to virtual reality. This is
analogous to the spectrum from wilderness through human-inﬂuenced to totally artiﬁcial environments. Note
that wilderness areas are rapidly disappearing ”
Bob Marcus

From https://en.wikipedia.org/wiki/Augmented_reality
Augmented Reality
Augmented reality (AR) is a live direct or indirect view of a physical, real-world environment whose elements are augmented (or
supplemented) by computer-generated sensory input such as sound, video, graphics or GPS data. ...Augmentation is
conventionally in real-time and in semantic context with environmental elements, such as sports scores on TV during a match.
With the help of advanced AR technology (e.g. adding computer vision and object recognition) the information about the
surrounding real world of the user becomes interactive and digitally manipulable. Information about the environment and its
objects is overlaid on the real world.
Augmented Reality Timeline
From www.crystalinks.com/ar.html

From https://en.wikipedia.org/wiki/List_of_augmented_reality_software
Augmented Reality Software (Open Source)
• Argon - augmented reality browser by Georgia Tech's GVU Center that uses a mix of KML and HTML/JavaScript/CSS to allow
developing AR applications; any web content (with appropriate meta-data and properly formatted) can be converted into AR
content; as of November 2011, available for iPhone only.[1][2]
• ARToolKit - an open source (LGPLv3) C-library to create augmented reality applications; was ported to many different languages
and platforms like Android, Flash or Silverlight; very widely used in augmented reality related projects.
• ArUco - a minimal library for augmented reality applications based on OpenCV; licenses: BSD, Linux,Windows.[3]
• JavaCV - A Java/Android interface to OpenCV; licenses: GPLv2 [4]
• ATOMIC Authoring Tool - a multi-platform authoring for creating AR applications on Microsoft Windows, Linux and Mac OS X
operating systems.[5]
• Goblin XNA - a platform for researching 3D user interfaces, including mobile augmented reality and virtual reality, emphasizing
games; written in C#, based on Microsoft XNA Game Studio 4.0, BSD license.[6][7]
• GRATF - open-source (GPLv3) project, which includes C# library for detection, recognition and 3D pose estimation of optical
glyphs.The project includes application, which does 2D and 3D augmented reality.[8]
• mixare (mix Augmented Reality Engine) - open-source (GPLv3) augmented reality engine for Android and iPhone; works as an
autonomous application and for developing other implementations.[9][10]
• PTAM - non-commercial use only.[11][12][13]
• DroidAR - open source (dual-license: GPLv3 or commercial) augmented reality framework for Android, featuring location-based
and marker based AR.[14][15][16]
• GeoAR - open source (Apache 2.0 License) browser for Android, featuring location-based AR and a ﬂexible data source
framework.[17]
• BeyondAR - open source (Apache 2.0 License) augmented reality framework based on geo localisation for Android.[18][19]
• Mangan - open source (Mango License) augmented reality framework based on Nano localisation for Android.[18]
• Vrui

Augmented Reality Software (Content Management)
• Gamar - a web based platform to create, manage and publish educational trails and audio guides using augmented reality.
• Augment - a web based platform for managing 3D models and creating augmented reality experiences.
• Blippbuilder - a web-based system for creating AR experiences with image recognition.
• buildAR.com, - a web based content platform for building geolocation and natural feature tracking based mobile augmented
reality.[28][29]
• Catchoom CraftAR - a web based content management system to create Augmented Reality experiences coupled with Cloud
Image Recognition.[30][31]
• Hoppala Augmentation - a web-based content platform for creating geolocation-based mobile augmented reality.[32][33]
• Layar Creator - a web-based AR CMS and creation tool for adding various digital media to ﬂat surfaces with image recognition.
[34][35]
• TARTT - web based software to create, manage and publish Augmented Reality content by an integrated process with Adobe
InDesign or other interfaces.[36]
• Webcam Social Shopper - web based software for integrating apparel visualization on e-commerce sites.
• WakingApp - a desktop-based AR andVR creation platform that features cloud-based library for distribution of content to
dedicated mobile apps
Augmented Reality Software (Education)
• AR Circuits - an app-based augmented reality electronics kit that uses marker cards to simulate electric components[39]
• SkyView - an app-based tool for identifying stars, constellations, and satellites[40]
• Anatomy 4D - creates three-dimensional visualizations of human anatomy using printed target images[41]

Augmented Reality Software (Development Toolkits)
Augmented Reality Software (End-to-end Branded App Solutions)
• Kudan AR Engine - an AR SDK for iOS and Android devices.[21]
• Layar SDK - an augmented reality SDK for iOS and Android apps.[22][23]
• Catchoom CraftAR AR SDK - an iOS and Android SDK that renders Augmented Reality experiences with plugins for Cordova and
Unity.[24]
• Vuforia Augmented Reality SDK, formerly known as QCAR, - a Software Development Kit for creating augmented reality application
for mobile devices.[25][26]
• Wikitude SDK - an augmented reality SDK for mobile platforms originated from the works on the Wikitude World Browser app by
Wikitude GmbH. The Wikitude SDK was the ﬁrst AR SDK providing a JavaScript API to work with augmented reality experiences.
• Aurasma
• Blippar
• Layar
• Nokia City Lens
• Wikitude
• XARMEX
• Zappar

Augmented Reality Software (Games)
• AR Games - a pre-loaded app on the Nintendo 3DS gaming console consisting of numerous AR games.
• A.R.Warriors - a turn based monster ﬁght game for iOS and Android that can be played anywhere thanks to an "User Generated
Target" technology.
• Bravely Default - Has an AR Movie Mode which recognizes a series of AR Cards to display short augmented reality introductions to the
playable cast and more.
• Cool Stacks - a game developed by Marxent Labs for Speedway LLC, is an integration of an augmented reality game into a consumer
loyalty application.[42]
• Cybergeneration - a table top role-playing game by R.Talsorian, includes "virtuality", an augmented reality created through v-trodes,
cheap, widely available devices people wear at their temples.
• Dead Space - a video game in which a RIG worn by Isaac Clarke is thoroughly equipped with augmented reality technology, including a
navigation system that projects a line along the best route to his destination, and a system that displays images, video and text in front
of him. In conjunction with the game, an augmented-reality website called No Known Survivors was released in 2008.
• E.X.Troopers - a video game with an AR Mode on the Nintendo 3DS version.This recognizes AR Cards of characters to display them as
well as numerous emotes and attacks when the player presses inputs.
• Hatsune Miku: Project DIVA F - a video game in which an option named AR Mode allows the console to project Hatsune Miku onto a
Fiduciary marker.This enable her to sing as an Augmented RealityVocaloid

Augmented Reality Software (Games) continued
• Hydrophobia - a survival-adventure video game from Dark Energy Digital features the MAVI (Mobile AutomatedVisual Interface), which
is a tool used to enhance environmental geometry among other purposes.
• Ingress - a location-based mobile game developed by Niantic Labs for iOS and Android devices where two teams battle for control of
regions and landmarks.
• LyteShot - an open source mobile gaming system that uses sensor-based technology to play digital video games, such as ﬁrst person
shooters, in the live action space.[43]It can also use smartglasses for interactive gameplay.
• Pokémon Goa
• Raving Rabbids:Alive & Kicking
• Spectrek - an augmented reality ghost hunting game.[44]
• StarWars Rebels - an augmented reality ﬁrst-person shooter built by Blippar for the launch of the Star Wars Rebels TV show.[45]
• Tuttuki Bako - a minigame system from Bandai is described as featuring augmented reality.[46]
• "Zombies, Run!" - An interactive running game that is available on the Android and iPhone platforms.The player takes the role of
"Runner 5", surviving in a zombie apocalypse era while trying to learn how it all started.

From http://www.slideshare.net/jhaag75/augmented-reality-examples-and-tools
Mobile Augmented Reality Use Cases for Learning

From http://www.seattletimes.com/entertainment/visual-arts/bloom-and-doom-pokemon-go-like-art-project-explores-climate-change/
Augmented Reality Art: Gardens of the Anthropocene

From http://argon.gatech.edu/
Argon Research Project from Georgia Tech
The Argon research project started 2009 in the Augmented Environments Lab at
the Georgia Institute of Technology.The project is exploring the software
architectures and interaction metaphors needed to support users running multiple
independently-authored AR applications at the same time, across different
platforms (from mobile phones to head-worn displays). On one hand, we are
developing the programming constructs and metaphors programmers need to
author applications that are not tied to a particular AR platform, and are able to
run in parallel with other applications. On the other hand, we are exploring the
user interfaces and interaction metaphors needed to allow users to effectively use
multiple AR applications at the same time, in the same physical space.To support
this work, a long term goal of the project is to create an open, standards-based
ecosystem for mobile augmented and mixed reality experiences that integrates
smoothly with existing web infrastructures.

From http://www.cse.ust.hk/~panhui/papers/mars2014_cloudridar.pdf
Cloudridar Cloud-Based AR Layered Software Framework

From http://www.glassappsource.com/google-glass-features/google-glasses-work.html
How Google Glasses Work

From https://www.microsoft.com/microsoft-hololens/en-us/why-hololens
Microsoft Hololens

From https://research.cc.gatech.edu/polaris/
Kharma Augmented Reality Mobile Architecture Framework

References

References (Augmented Reality)
Augmented Reality Software
https://en.wikipedia.org/wiki/List_of_augmented_reality_software
Augmented Reality Community
http://www.perey.com/ARStandards/
Augmented Reality Existing Standards
http://www.perey.com/ARStandards/existing-standards/
Examples and Tools for Augmented Reality
http://www.slideshare.net/jhaag75/augmented-reality-examples-and-tools
When Augmented Reality meets Big Data
https://arxiv.org/pdf/1407.7223v1.pdf
Augmented Reality vs Virtual Reality
http://www.augment.com/blog/virtual-reality-vs-augmented-reality/
Google’s Tango
https://en.wikipedia.org/wiki/Project_Tango
20 Best Augmented Reality Apps
http://www.digitaltrends.com/mobile/best-augmented-reality-apps/
Xperiel Real World Web
https://xperiel.com/

References (Virtual Reality)
20 Best Virtual Reality Companies
http://www.datamation.com/mobile-wireless/virtual-reality-companies-top-20-vr-companies-to-watch-1.html
Specular Theory Virtual Reality
http://www.speculartheory.com/

References (Mobile IoT)
GSMA Mobile IoT Initiative and Connected Living Programme
http://www.gsma.com/connectedliving/mobile-iot-initiative/
http://www.gsma.com/connectedliving/connected-living-mobilising-the-internet-of-things/
Architectural Models in Mobile Crowdsensing
http://www.ijsr.net/archive/v4i2/SUB151428.pdf
Chinese Mobile and Social Applications
www.nytimes.com/2016/08/03/technology/china-mobile-tech-innovation-silicon-valley.html

References (Social IoT)
Social IoT
http://www.social-iot.org/

Mobile and Social CPS including Augmented Reality

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Andere mochten auch

Andere mochten auch (13)

Ähnlich wie Mobile and Social CPS including Augmented Reality

Ähnlich wie Mobile and Social CPS including Augmented Reality (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Mobile and Social CPS including Augmented Reality