Metaverse and Digital Twins on Enterprise-Public.pdf

Metaverse & Digital Twins
在企業的應用與建置
Tommy Wu (吳志忠) , IoT Solution Architect
Microsoft , Global Partner Solutions

Consumer Metaverse Enterprise Metaverse Industrial Metaverse
Microsoft Enterprise & Industrial Metaverse
Different use cases target different domains
Facebook Focus
Microsoft Mesh Focus
Azure IoT & Customer Innovation Team

Metaverse capabilities
Physical World
Synchronize
Model
Monitor
Track the Past, Analyze
Predict, Simulate, Autonomous Control
Interact

Physical World
Azure IoT
Azure Digital Twins
Azure Maps, Indoor
Azure Synapse Analytics
Azure AI & Microsoft Project Bonsai
Power Platform
Microsoft Mesh & HoloLens
Metaverse technology stack

Digital Twin applications in manufacturing
Configuration
Management
Asset
Management
Process
Control
Performance
Management
Simulation
Modeling
Priority Scenarios
Product
[Connected Product
Innovation]
Factory
[Factory of the Future]
Supply Chain
[Intelligent Supply Chain]
Spaces
[Smart Buildings]
ISV Partners SI Partners

Process Control
Digital Capabilities across the Enterprise
Turbine 3 Power Plant
Turbine 1 Turbine 2
Performance Mgmt
O SN #44
BSN #7
H
K
L
R
S
A
Q SN #71
O SN #44
SN #6
H
K
L
R
S
Q SN #71
A
O SN #AB
H
K
L
R
S
SN #8
Q SN #71
A
Configuration Mgmt
Simulation
Configuration Mgmt
Asset Mgmt
Process Control
Performance Mgmt
Service change
J
C
D
G
T
J
C
D
G
T
C
D
G
T
J
F
Simulation
F
Fuel Pump
Asset Mgmt
SN #97
F SN #98
F SN #99
F

What can you do with
Digital Twins?

Physical Digital Environment
&
Interact

Model any environment, connect sensors and business systems to the model.
Control the present, track the past and predict the future.
Azure Digital Twins

Banks
Finance
Plants
Factories
Industrial Sites
Utilities
Manufacturing Stores
Warehouses
Distribution
Centers
Malls
Micro-fulfillment
Retail
Building
Office
Entertainment
Restaurants
Hotels
Enterprise
Campus
Real Estate
Public Spaces
Arenas &
Stadiums
Transportation Hubs
Subway &
Train Stations
Ports
Utilities
Water Treatment
Facilities
Cities & Government
Hospitals
Labs
Pharmacies
Clinics
Retirement
Facilities
Healthcare
Farms
Water Supply
Power
Storage
Processing
Agriculture
Schools
Campuses
Virtual
Environments
Education
Generating
Power Stations
Substations
Energy
Connected Assets Connected Environments Connected Ecosystems

Azure Digital Twins
REST
API
External Compute
Handles business logic and data processing
Client Apps
Manage models and the digital twins graph
Digital Twins
Definition
Language
A Z U R E D I G I T A L
T W I N S G R A P H
IoT Hub
Workflow integration
(e.g. Logic Apps)
Business systems/services
integration via REST APIs
Workflow integration
(e.g. Logic Apps)
Cold Storage
Azure Data Explorer
Analytics
Create next generation IoT solutions that model the real world

Open Modeling
Language
Live Execution
Environment
Input from IoT &
Business Systems
Output to TSI,
Storage & Analytics
{
"@id": “dtmi:example:Station;1",
"@type": "Interface",
"extends": “dtmi:example:Room;1",
"contents": [
{
"@type": "Property",
"name": “isOccupied",
"schema": "boolean“
},
{
"@type": “Property",
"name": “hasAVSystem",
"schema": “boolean“
},
{
"@type": "Property",
"name": “capacity",
"schema": “integer“
}
],
"@context": "dtmi:dtdl:context;2"
}
Azure Digital Twins
Control the present, track the past and predict the future
▪ Create custom domain models using “Digital Twins Definition Language” (DTDL)
▪ Models describe twins in terms of
▪ Telemetry
▪ Properties
▪ Commands
▪ Relationships
▪ Components
▪ Models define semantic relationships to connect twins into a knowledge graph
▪ Models can specialize other twins using inheritance
▪ Digital Twins Definition Language is aligned with
▪ IoT Plug and Play
▪ Time Series Insights data model
ADX,

Open Modeling
Language
Live Execution
Environment
Input from IoT &
Business Systems
Output to TSI,
Storage & Analytics
Azure Digital Twins
▪ Create a live execution environment from the DTDL models in
Azure Digital Twins
▪ Twin instances and relationships form a live graph representation
of the environment
▪ Use a rich event system to drive business logic and data
processing. Use external compute such as Azure Functions
▪ Extract insights from the live execution environment with a
powerful query API
▪ Query using rich search conditions, including property values,
relationships, relationship properties, type information and more
DTDL
Azure Digital Twins
Azure Digital Twins Graph
Zone 1
Track 1 Track 2 Track 3
Station 1
Region 1
Train 1
Switch 1
Access
Gate 1
Access
Gate 2
ADX,

Open Modeling
Language
Live Execution
Environment
Input from IoT &
Business Systems
Output to TSI,
Storage & Analytics
Azure Digital Twins
▪ Use IoT Hub to connect to IoT and IoT Edge devices to keep the live
execution environment up to date
▪ Use a new or an existing IoT Hub (IoT Hub is no longer internal to
Azure Digital Twins)
▪ Drive ADT from other data sources using REST APIs or create a Logic
Apps connector
Zone 1
Station 1
Region 1
Train 1
Switch 1
Access
Gate 1
Access
Gate 2
REST
API
ADX,
Azure Digital Twins

Open Modeling
Language
Live Execution
Environment
Input from IoT &
Business Systems
Output to TSI,
Storage & Analytics
Cold Storage
Historical
Actions
Analytics
Azure Digital Twins
▪ Use event routes to send data to downstream services
via Event Hub, Event Grid or Service Bus
▪ Connect Azure Digital Twins to Azure Data Explorer to
track time series history of each node
▪ Store data in Azure Data Lake, analyze data with Azure
Synapse and other Microsoft data tools for analytics,
integrate workflow with Logic Apps
Zone 1
Station 1
Region 1
Train 1
Switch 1
Access
Gate 1
Access
Gate 2
REST
API
ADX,
Azure Digital Twins

3D Model Creation & Rendering Technology

WebXR 3D Model Render With Digital Twins

Babylon.js includes updated support for WebXR. This
exciting new standard allows developers to easily
create compelling cross-browser AR/VR web
experiences
Babylon.js: Powerful, Beautiful, Simple, Open - Web-Based 3D At Its Best (babylonjs.com)

UI Modeling with Babylon.js – 3D Model Rendering

UI Modeling with Babylon.js – Azure Digital Twins Model
• Model your data as Digital Twins Graph • Update Model Properties by IoT Sensors

UI Modeling with Babylon.js – WebXR in Hololens
You can view WebXR experiences in Windows Mixed Reality with the new Microsoft Edge and Firefox Reality
const xr = await scene.createDefaultXRExperienceAsync({
floorMeshes: [env.ground]
});
Render your App in Hololens 2
XR Support
Rendering Effect in Hololens 2

Digital Twins
for critical infrastructure
Bentley’s mission is to provide
innovative software and services
for the enterprises and professionals who
design, build, and operate
the world’s infrastructure – sustaining the
global economy and environment for
improved quality of life.
Roads and
Bridges
Oil and Gas
Digital Cities | Digital Factories
Electric and
Gas Utilities
Rail and
Transit
Offshore
WWW.BENTLEY.COM | © 2020 Bentley Systems, Incorporated
Water Treatment
Plants
Construction

25 | WWW.BENTLEY.COM | © 2020 Bentley Systems, Incorporated
• Visualize, simulate, and optimize every aspect of critical
infrastructure including energy efficiency, carbon footprint,
safety, and disaster response
• Track current performance, predict future performance,
and reduce maintenance costs
• Monitor energy consumption, air quality, space occupancy
and temperature
• Simulate the impact of workplace incidents or extreme
weather events
iTwin – Infrastructure Digital Twins
Benefiting from Microsoft Azure Digital Twins and Azure IoT
Hub—including a wide range of Azure microservices—Bentley’s
users can now rapidly process and make sense of huge amounts
of sensor data, produce critical insights, and gain quick decision-
making capabilities.
Roads and
Bridges
Digital Cities | Digital Factories
Electric and
Gas Utilities
Rail and
Transit
Offshore
Water Treatment
Plants
Construction Oil and Gas

Connected Highway
Coffs Harbour Roadway in Australia
Need: Access to sensor data to monitor
health of roadway infrastructure
Problem: Large amounts of unstructured data
from disparate systems
Solution: Digital twin to visualize streaming
data and alert operators when
actions need to be taken
Benefits: Safer roadways with lower cost and
more efficient maintenance

Smart Buildings: Real Estate Core
▪ Partnered with RealEstateCore (OSS)
▪ https://github.com/Azure/opendigitaltwins-
building
Smart Cities: ETSI NGSI-LD
▪ Extend through community contribution
▪ github.com/Azure/opendigitaltwins-smartcities
Domain-specific Ontologies to get started
Open-Source RDF/OWL to DTDL sample converters

Digital Twins Consortium
Founders and Groundbreakers
Founders
Air Force Research Laboratory CodeData Healthskouts LUNO UAB Systems Analytics Solutions
Animated Insights Connector Geek Ltd IIMBE Lux Modus Ltd. Transforma Insights
Asset Management Lab, LLC ConstruWise, Inc. IOTA Foundation Monash University Trendspek
Association of Asset Management Professionals CumuloCogitus Inc. IOTIFY NSW State Government Twin Building GmbH
Autiosalo Ltd Cybertwin Idun Real Estate Solutions AB Neural Concept University of Melbourne
BEC - Blockchain Engineering Council DIGIOTAI ieLabs Padi LLC UrsaLeo Inc.
BIM6D Consulting DataCities IoT Management Piprate WSC Technology
Bandora Systems e-Magic Inc. imec PropTechNL Willow
Bentley Systems Executive Development Itus Digital Resonai Ynomia
Building 4.0 CRC Gafcon, Inc. Jitsuin, Inc. Ricardo YoGeo, Inc.
Chain Technology Development Co. Limited Geminus.AI LINQ Ltd. Slingshot Simulations
Groundbreakers

GIS Maps Rendering Using Digital Twins

Scaleand secure your privatemap data usingAzure Maps Creator as yourcopy of record
Azure Maps Creator
API and SDK in support of indoor
map data owners and smart building
applications
Mapping as a Service: automated
CAD processing, multiple level of
details, built-in map styles and
dynamic styling options for IoT
Map Services: render, spatial query
API and more
SDK: integrate indoor with multiple layers and indoor-outdoor experiences
In Public Preview

Indoor Map Data Management Experiences
Transform CAD data to maps
Georeference facilities, Categorize rooms and
additional metadata properties
Review CAD data
errors
Create maps with multiple facilities
Author Maps
Point of interest, logical spaces and more
Bulk Import of fixture data

Examples of supported Smart Building Solution Experiences
Facility Managers
Queries (show all mid-size meeting rooms, ramps)
Replay IoT data, aggregate, monitor live
Asset Tracking/Guests/VIP experiences
Use indoor asset location to track assets, define and
monitor geofences and trigger business logic
Help users find and reach
point of interest
(not in public preview)

Linking reference and operational data
Correlate space with other related systems’ live data
Devices
(Occupancy, Temperature, …)
Microsoft Graph
Free/Busy, Book Now, …
Vision Modules
People Count, People
Tracking, …
Location
COSINE 802.11mc, Beacons, …
Azure Maps
Azure Digital Twins
Thigs-Topology, Ontology,
…
Customer solutions
Other Sources
Live Maps
Asset Tracking/geofencing/…
Spatial Queries
Device - space relationships,
augment and aggregate data

Maps Conversion Tool - Quickly Convert Your DWG CAD file

CAD file Data Model in Azure Digital Twins Explorer

Indoor Maps Update based on DT Model Property

Azure AI
Sense. Plan. Act.
• Perceive and asses the system’s state
• Create intelligent recommendations
• Activate autonomous systems across
processes and equipment

Azure Spatial Analysis AI Service
The spatial analysis container enables you to analyze real-time streaming video to understand spatial relationships
between people, their movement, and interactions with objects in physical environments
• Counts people in a designated zone in the camera's field of view
• Tracks when a person crosses a designated line in the camera's field of view.
• Tracks when a person crosses a designated line in the camera's field of view.
• Tracks when people violate a distance rule.

Classified as Microsoft Confidential
Azure Percept
Audio
Azure Percept
Vision
Azure Percept
Trust Module

Classified as Microsoft Confidential
Delightful onboarding
Integrated experiences
No code flow
Advanced flow
Prototype and deploy
Seamlessly build and manage edge AI solutions

Automotive /
Transportation
Factory automation
Cabin intelligence
Driver distraction
Passenger detection
Conversational AI
Command & control
Sensor data efficiency
Manufacturing
Predictive
maintenance
Field service
Worker safety & loss
prevention
Factory automation &
defect detection
Incident response
Automated supply
chain & assembly
Retail
Space & assortment
Traffic patterns
Personalization
Inventory
management
Shrinkage reduction
Optimal product
placement
Smart City/
Buildings
Security & surveillance
Access control via
custom command
Energy management
Transportation &
traffic management
Utilities management
Monitoring &
workplace safety
Healthcare
Patient recognition &
monitoring
Supply chain &
operational efficiency
Identification of
patient issues
Waiting room
prioritization
Scheduling &
reminders

Time spent in a queue Vehicle detection with parking stall alerting
Dangerous zone detection
Security and surveillance

Mixed Reality Development with Digital Twins

Most comfortable and
immersive mixed reality
experience available
Largest ecosystem of 1st & 3rd
Party mixed reality solutions
The reliability, security, and
scalability of cloud and AI
services from Azure

Vision
Hearing
Speech
Mobility
Blind on one or both eye, amblyopia, color blind,
low peripheral vision, low contrast, limited field of
view in progressive lenses
Deaf or decreased hearing on one side or both,
limited hearing in certain frequencies
Mute, language/accent, speech aid like
electrolarynx user/voice amplifier, speech disorder
Wheelchair user, neck injury
Permanent
Missing or damaged Rx glasses, device display
issues (brightness, color), injury
Blocked by other communication device or ear
protection, muted audio volume
Face mask, sore throat, post dental surgery
Injury, fatigued, arthritis, surgery recovery
Temporary
Low visibility environment (factory or exhibition hall
that is too bright), outdoor, distracted, fog, dirty
lens
Noisy environment, broken headset speaker, quiet
location
Noisy environment, quiet location, broken mic
Tight environment, environmental changes
Situational
Cognitive Dementia, ADHD, Mild Cognitive Impairment Injury, stressed, fatigued, medicated state Multi-tasking, instructor in classroom, demo in
crowded environment
Mixed Reality Persona Spectrum
Hand Missing arms or fingers Injury, fatigued, arthritis, surgery recovery Hands are occupied, broken input device,
gloves/hand protection

Multi-user construction visualization
Building Mixed Reality Experiences
Immersive marketing and communications 3D Mapping and planning with geospatial data
IOT data visualization Mixed reality training systems Interactive installation design

Design Monitor Operation
Mixed Reality Metaverse Application Design Flow
Microsoft Mesh Azure Digital Twins Remote Assist
Azure IoT Data Explorer
Spatial Anchor
Teams
Spatial Map
Holographic Guides
Vision AI

Here can be anywhere
Feel presence Connect from anywhere
Experience together

Accelerate development of collaborative
Mixed Reality solutions with AI powered
tools.
Reach users on multiple platforms and
devices.
Scale apps confidently by benefitting
from Azure’s global infrastructure that
powers Mesh.
Immersive Presence Spatial Maps
Holographic Rendering Multiuser sync
Core Capabilities

53
w
w
w
.
d
a
t
a
m
e
s
h
.
c
o
m
Mixed Reality Digital Twins Execution Runtime
BI Report
IoT Telemetry
UI Widget
3D Model

54
w
w
w
.
d
a
t
a
m
e
s
h
.
c
o
m Digital Twins MR Design Studio
• Visual Design
• Tool Assistant
• Report Integration
• IOT Integration
• Parameter Tuning
• Scene Editor

MR Spatial
Computing
55
Azure Spatial Anchors
Azure Object Anchors Azure Remote Rendering

56
Azure Spatial
Anchors SDK
(Android,
iOS,
Hololens,
Linux (new!))
Session:
Image features,
image poses
Query Returns:
relative anchor
6 DoF pose
Query: anchor ID
Create Anchor:
desired relative pose
Create Anchor Returns:
anchor ID
Images,
poses from
AR
Image
features,
poses from
Head
Tracking
Undistorted
images,
poses from
own SLAM
system

Robots of the Future
Now: mostly logistics
(move from A to B) Future: robots with spatial intelligence
Warehouse Search and Rescue
Construction
Future: humans and robots working together

Retail Store Scenario
• Store Shelf Design
• Virtual Interior Design
• Retail IoT Monitoring
• Warehousing

Digital Twins Realtime Feeds from IoT Sensors

MR AI Model Training and Identification
Model Training
Custom vision
Object Anchor
Label&Training
MR Toolkit UI Render
Object Detect + Object Tracking
IoT Edge
Inference

NVIDIA Isaac Sim
Azure Digital Twins
A Z U R E D I G I T A L
T W I N S G R A P H
Data Model Twin
IoT Hub
with Digital Twins in Simulation

MR Application Development Framework

MRTK – Mixed Reality ToolKit for MR development
• Provides the cross-platform input system and
building blocks for spatial interactions and UI.
• Enables rapid prototyping via in-editor
simulation that allows you to see changes
immediately.
• Operates as an extensible framework that
provides developers the ability to swap out
core components.
• Supports a wide range of platforms,
microsoft/MixedRealityToolkit-Unity: Mixed Reality Toolkit (MRTK) provides a set of components and features to accelerate cross-platform MR app development in Unity. (github.com)

MR Toolkit In Unity Application
• Spatial Awareness
Profile
• MR Toolkit Preview
• MR Toolkit in Unity
• UI Component
• Inspector

MRTK Pre-built UI Block - Prefabs
• The MRTK Toolbox is a Unity
editor window utility that makes
it easy to discover and spawn
MRTK UX prefab components
into the current scene.
• Items can be filtered in view by
using the search bar at the top of
the window.
• The toolbox window is designed
to spawn MRTK out-of-box
prefabs into the current scene

Real-life Hologram in Mixed Reality

Dynamics 365 Business Applications
Empower employees and optimize operations with
Technicians solve problems in real-time with the
help of remote experts
Managers walk the job site without being on site
Remote Assist Guides
More quickly train/upskill employees
with hands-on learning
Analyze data to optimize business processes

What is Azure
Communication
Services?
Voice & Video Calling
SMS Telephony
Chat

Mixed Reality Streaming with ACS

Customer use cases
EDGE creates a new
generation of innovative,
healthy and sustainable
buildings.
The EDGE software platform
delivers advanced data
analytics through simple user
interfaces.
The Wizata Platform
empowers the manufacturing
industry to drive its digital
transformation.
It brings together Digital Twin,
Data Explorer and AI Solution
Builder functionality.
Bosch delivers Smart
Solutions and Services for
commercial buildings
By applying semantic models
in the Digital Twins service,
Bosch gains powerful insights
cross domains for a wide
range of building types
WillowTwinTM enables owners
and operators of infrastructure
to manage with greater
efficiency.
It drives operational
improvements at scale and
provide their occupants or
users with an enhanced
experience.

Partner use cases
Twin Builder: Physics-Based
Digital Twins
Ansys used Azure Digital
Twins to make it even easier
to deploy physics-based
Digital Twin models for
enhanced predictive and
prescriptive maintenance of
physical assets and
equipment.
iTwin: Infrastructure Digital
Twins
Benefiting from Microsoft
Azure Digital Twins, Bentley’s
iTwin users can now rapidly
process and make sense of
huge amounts of sensor data,
produce critical insights, and
gain quick decision
making capabilities.

CONST
CONST2
CONST
CONST3
CONST
CONST5
V_water
V_gasoil
View2
average
StaticMixer_Gasoil2
PULSE2
mflow_1
mflow_2
liquidFraction1
mflow_out
scalar_outputs1
Y
t
DATAPAIRS1
valveOpening
mflow_out
vflow_out
inletPressure
PumpingLine1
valveOpening
mflow_out
vflow_out
inletPressure
PumpingLine2
Demo: Refinery Gasoline Blending Process
Challenge: Efficient blending is critical to make target gasoline
grades. With existing solutions, blend quality can typically only be
determined after the blending process has completed. This leads to
blend downgrades or fixes, costing time and money
Solution: A Simulation-Based Digital Twin of the blending process
augments available sensor streams with virtual sensors that help
better predict blend quality. In addition, issues such as insufficient
pressure/flow can be quickly detected and remedied in near real-
time to ensure efficient blending
Results: The solution should help refinery customers realize
operational improvements in the range of 10%, representing savings
of tens of millions of dollars per year per refinery

Display
Reality
Data Tiles
Microsoft & Bentley Systems: An Example Digital Twin Architecture
Reality Data Service
Background Map
Service (Bing)
Tiles Tiles
1
Display
Background
Map Tiles
2
App Backend
(iModel.js)
Tiles
JSON
Display iModel
Tiles
Properties
3
iModelHub
Azure Cloud Service
Engineering
Tool A
Engineering
Tool B
Desktop tools from
Bentley / 3rd Parties
A
B
Project
Start
Current
Status
ADT Export Agent
(iModel.js)
Azure Digital Twins
Pull ADT
Properties/Telemetry
4
Display Time Series
Derived Values, Telemetry
5
On demand
Azure Event Hub
Persist historical values
in Azure Time
Series Insights
6
Author
1
Align
2
Synchronize
3
Sync subset
to DTDL
4
Driven by pace of
engineering change
Update ADT – Derived
Values &Telemetry
5
Trigger Azure Function
With Telemetry
3
Continuous /
real-time
Azure IoT Hub
Simulated Sensors
Compute Derived
Values
4
Send Telemetry
to IoT Hub
2
Generate Simulated
Sensor Values
(Telemetry)
1
App Frontend
(iModel.js)
DTDL

Metaverse and Digital Twins on Enterprise-Public.pdf

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie Metaverse and Digital Twins on Enterprise-Public.pdf

Ähnlich wie Metaverse and Digital Twins on Enterprise-Public.pdf (20)

Mehr von 湯米吳 Tommy Wu

Mehr von 湯米吳 Tommy Wu (10)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Metaverse and Digital Twins on Enterprise-Public.pdf