23. End-to-End Pipeline for AI on the Edge
アーキテクチャ: テレメトリー
Edge
IoT Hub
Web Service
Stream
Analytics
Azure SQL
Video Storage
Camera1
Camera2
Camera3
10 Mb/s
Dashboard
AML Service
IoT Edge
24. End-to-End Pipeline for AI on the Edge
アーキテクチャ: 再トレーニング
Edge
IoT Hub
Web Service
Stream
Analytics
Azure SQL
10 Mb/s
Location
Data Box Disk, or
direct data upload
Physical
Transfer
Dashboard
External Storage
AML Service
IoT EdgeVideo Storage
Camera2
Camera1
Camera3
31. Azure Time Series Insights
Core Scenarios: Data Exploration and Anomaly Detection
• No upfront data preparation needed
• Connect to billions of events in Azure IoT Hub or Azure Event Hub, and
visualize & analyze billions of events to spot anomalies and discover hidden
trends in your data
• Simple and easy to use exploration experience, while at the same time
providing granular text-based querying for advanced users who are familiar
with SQL
• Perform DevOps analysis to
get to the root cause of a
bug in an IoT solution or
identify areas to investigate
for data science initiatives
32. Azure Time Series Insights
Core Scenarios: Operational Intelligence and Advanced Analytics
33. TSI High Level Architecture
COLLECT
PROCESS
STORE
ANALYZE
Data Processing Engine
Query API
TSI
Explorer
Time Series IDs
Analytics and Model Query
3rd Party
App
Model Query
ConnecttoData
Source
Device Telemetry
Time Series Routed to Warm / Cold
Query across Warm / Cold
Model Update Sync
Time Series Model
Update API
Warm Store
(up to 30d data
retention)
Cold Store
(infinite data
retention)
Time Series
Model Store
(Instances, Types,
Vars, Hierarchy)
In preview as of last year
Releasing to preview today
34.
35. Azure Time Series Insights ロードマップ
産業用IoT分析プラットフォームと、ユーザー エクスペリエンスを継続して強化
36. Azure Time Series Insightsの東日本リージョン展開は、2020年第一四半期
https://azure.microsoft.com/ja-jp/global-infrastructure/services/?products=time-series-insights®ions=japan-east,japan-west より抜粋 (2019/12/15現在)
40. 典型的な IoT ソリューション
THINGS INSIGHTS ACTIONS
Power BI
PowerApps Web Apps
Mobile Apps
Manage
View and manage solutions
Azure Sphere
Secured MCU Secured OS Cloud Security
Business Integration
Connect to business apps & services
Office 365
Dynamics 365
Edge Modules:
• Protocol Adaptation
• Functions
• Stream Analytics
• Machine Learning
• AI
Azure
IoT Edge
• Integrated view for CISO & SecOps personas to review enterprise security posture, including IoT solutions.
• Holistic view of IoT solution security posture for DevOps and IoT solution managers to review and manage day to day security status
Azure Security
Center for IoT
3rd Party
Azure IoT Device SDK
3rd Party Industry specific sensors & devices
(RTOS, Linux, Windows, Android, iOS)
IoT Hub
Container
Registry
Kubernetes
Service
Compute
(VMs)
Content
Delivery
Network
Data
Explorer
Front Door
Resource
Manager
(ARM)
Storage
Domain
Name
System
Microsoft
Flow
Key Vault
Service Bus
Application
Insights
Functions
SQL Azure
Cosmos DB
Web Apps
Azure Stream
Analytics
Event Hub
Device
Provisioning
Service Time Series
Insights
Maps
41. IoTの簡素化 - Azure IoT Central
THINGS INSIGHTS ACTIONS
Power BI
PowerApps Web Apps
Mobile Apps
Manage
View and manage solutions
Azure Sphere
Secured MCU Secured OS Cloud Security
Business Integration
Connect to business apps & services
Office 365
Dynamics 365
Edge Modules:
• Protocol Adaptation
• Functions
• Stream Analytics
• Machine Learning
• AI
Azure
IoT Edge
• Integrated view for CISO & SecOps personas to review enterprise security posture, including IoT solutions.
• Holistic view of IoT solution security posture for DevOps and IoT solution managers to review and manage day to day security status
Azure Security
Center for IoT
3rd Party
Azure IoT Device SDK
3rd Party Industry specific sensors & devices
(RTOS, Linux, Windows, Android, iOS)
IoT Hub
Container
Registry
Kubernetes
Service
Compute
(VMs)
Content
Delivery
Network
Data
Explorer
Front Door
Resource
Manager
(ARM)
Storage
Domain
Name
System
Microsoft
Flow
Key Vault
Service Bus
Application
Insights
Functions
SQL Azure
Cosmos DB
Web Apps
Azure Stream
Analytics
Event Hub
Device
Provisioning
Service Time Series
Insights
MapsSimplify production-ready IoT solution development
• Simplify setup, reduce management burden, operational
costs, and overhead of a typical IoT project.
• Bring solutions to market faster, while staying focused on
your customers
Azure IoT Central
Build with Azure IoT Central, our IoT App Platform
42. Azure IoT Central
セキュアで、ビジネスの成長に合わせて成長でき、既存のビジネス アプリケーションと統合できる、
IoT アプリケーション プラットフォーム サービス
Get Connected
Connect IoT devices to the
cloud faster than with any
other platform
Stay Connected
Reconfigure and update
devices with centralized
device management
Device connectivity and
management
Telemetry ingestion and
command & control
White Labeling
Multitenancy
Edge support
Plug-and-Play
Extensibility & Customization
IoT Central public APIs
Industry-focused
Application Templates
Monitoring rules &
triggered actions
User roles and
permissions
Dashboards, visualization
& insights
End to End Security
Transform
Bridge the gap with
connectors and
extensibility APIs
43. App templates are tools to help
partners & solution builders
kickstart IoT solution development
Use or sell to customers directly
or through AppSource
Your brand, your SaaS
App templates consist of:
• Sample operator dashboards
• Sample device templates
• Simulated devices
• Pre-configured rules and jobs
• Rich documentation including tutorials
• Brand templates using white labeling features
44. • Digital distribution center
• In-store analytics
• Checkout, Condition
monitoring
• Connected logistics
• Smart inventory management
Retail
• Continuous patient
monitoring
Healthcare
• Water quality monitoring
• Water consumption
monitoring
• Connected waste
management
Government
• Smart meter analytics
• Solar power monitoring
Energy
45. They consist of:
• Sample operator dashboards
• Sample device templates
• Simulated devices
• Pre-configured rules and jobs
• Rich documentation, including
tutorials
Brand using the white labeling feature.
Sell to customers directly or through AppSource.
Your brand, your SaaS!
App templates are tools to help solution
builders kickstart IoT solution development
52. Azure IoT Central
Solution builders
Get Connected
Connect IoT devices to the cloud
faster than with any other platform
Stay Connected
Reconfigure and update devices with
centralized device management
Transform
Bridge the gap with connectors
and extensibility APIs
53. Azure IoT Edgeデバイスの例: Lenovo + NVIDIA
マイクロソフト、Lenovo、NVIDIA は、Azure IoT Edge に高度な AI をもたらすべく提携
Tesla T4
SE350 Edge Server EPC300 Edge Gateway
IoT510-C カメラ
製品概要: https://www.lenovo.com/jp/ja/data-center/servers/edge/ThinkSystem-SE350/p/77TM7DSSE35
66. ###################################################################
Brute Force Password Guessing
###################################################################
Mon Oct 28 17:02:02 UTC 2019 Using real Mirai credentials to try to connect...
Mon Oct 28 17:02:02 UTC 2019 Trying to connect to target with username root and password root...
Permission denied, please try again.
Mon Oct 28 17:02:06 UTC 2019 Trying to connect to target with username root and password user...
Permission denied, please try again.
Mon Oct 28 17:02:10 UTC 2019 Trying to connect to target with username root and password anko...
Permission denied, please try again.
Mon Oct 28 17:02:13 UTC 2019 Trying to connect to target with username root and password 0...
Permission denied, please try again.
Mon Oct 28 17:02:17 UTC 2019 Trying to connect to target with username root and password vizxv...
Permission denied, please try again.
Mon Oct 28 17:02:23 UTC 2019 Trying to connect to target with username root and password root...
Permission denied, please try again.
………[after more similar trials]………………………………………………………………..
Mon Oct 28 17:03:10 UTC 2019 Trying to connect to target with username ubuntu and password password...
Permission denied, please try again.
Mon Oct 28 17:03:14 UTC 2019 Trying to connect to target with username ubuntu and password ******...
Mon Oct 28 17:03:17 UTC 2019 Successfully connected to the device
total 16
-rw-r--r-- 1 root root 98 Oct 28 08:32 README
drwxr-xr-x 2 root root 4096 Oct 28 08:32 helloworld
-rwxr-xr-x 1 root root 121 Oct 28 08:32 helloworld.py
-rw-r--r-- 1 root root 1029 Oct 28 08:32 setup.py
Connection to target closed.
░▀█░░░░█▀█░█▀█░█▀▀░█▀▀░█░█░█▀█░█▀▄░█▀▄░░░█▀▀░█▀█░█░█░█▀█░█▀▄
░░█░░░░█▀▀░█▀█░▀▀█░▀▀█░█▄█░█░█░█▀▄░█░█░░░█▀▀░█░█░█░█░█░█░█░█
░▀▀▀░░░▀░░░▀░▀░▀▀▀░▀▀▀░▀░▀░▀▀▀░▀░▀░▀▀░░░░▀░░░▀▀▀░▀▀▀░▀░▀░▀▀░
67. ░▀█░░░░█▀█░█▀█░█▀▀░█▀▀░█░█░█▀█░█▀▄░█▀▄░░░█▀▀░█▀█░█░█░█▀█░█▀▄
░░█░░░░█▀▀░█▀█░▀▀█░▀▀█░█▄█░█░█░█▀▄░█░█░░░█▀▀░█░█░█░█░█░█░█░█
░▀▀▀░░░▀░░░▀░▀░▀▀▀░▀▀▀░▀░▀░▀▀▀░▀░▀░▀▀░░░░▀░░░▀▀▀░▀▀▀░▀░▀░▀▀░
###################################################################
Covering traces in System Log Files
###################################################################
Mon Oct 28 17:03:22 UTC 2019 Removing system logs...
Mon Oct 28 17:03:25 UTC 2019 Removed system logs
###################################################################
Extracting Second Payload and Infecting Device
###################################################################
Mon Oct 28 17:03:25 UTC 2019 Downloading second payload from actor loader...
Mon Oct 28 17:03:25 UTC 2019 Extracting second payload and making it executable...
Mon Oct 28 17:03:33 UTC 2019 Installing and running malicious payload...
░▀▀▄░░░█▀▄░█▀▀░█░█░▀█▀░█▀▀░█▀▀░░░▀█▀░█▀█░█▀▀░█▀▀░█▀▀░▀█▀░█▀▀░█▀▄
░▄▀░░░░█░█░█▀▀░▀▄▀░░█░░█░░░█▀▀░░░░█░░█░█░█▀▀░█▀▀░█░░░░█░░█▀▀░█░█
░▀▀▀░░░▀▀░░▀▀▀░░▀░░▀▀▀░▀▀▀░▀▀▀░░░▀▀▀░▀░▀░▀░░░▀▀▀░▀▀▀░░▀░░▀▀▀░▀▀░
###################################################################
Getting device information
###################################################################
Mon Oct 28 17:03:35 UTC 2019 Conducting analysis of host data...
Linux ubuntu-vm 5.0.0-1022-azure #23~18.04.1-Ubuntu SMP Mon Sep 30 19:47:06 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Mon Oct 28 17:03:35 UTC 2019 Got host data
###################################################################
Create User and Escalate Privilege
###################################################################
Mon Oct 28 17:03:35 UTC 2019 Adding user named privilegeduser10317 with privilege root to the system...
Mon Oct 28 17:03:36 UTC 2019 Successfully added user named privilegeduser10317 with privilege root to the system
68. ░▀▀█░░░█▀▀░▄▀░░█▀▀░░░█▀▀░█▀█░█▀█░█▀█░█▀▀░█▀▀░▀█▀░█▀▀░█▀▄
░░▀▄░░░█░░░▄█▀░█░░░░░█░░░█░█░█░█░█░█░█▀▀░█░░░░█░░█▀▀░█░█
░▀▀░░░░▀▀▀░░▀▀░▀▀▀░░░▀▀▀░▀▀▀░▀░▀░▀░▀░▀▀▀░▀▀▀░░▀░░▀▀▀░▀▀░
###################################################################
Communicating with CnC for getting attack commands
###################################################################
Mon Oct 28 17:03:36 UTC 2019 Opening reverse shell...
Mon Oct 28 17:03:36 UTC 2019 Reverse shell established
Mon Oct 28 17:03:36 UTC 2019 Communicating with CnC server...
Mon Oct 28 17:03:36 UTC 2019 Listening to CnC for future attack commands...
###################################################################
Covering Tracks - Deleting Logs and Executables
###################################################################
Mon Oct 28 17:03:36 UTC 2019 Deleting history files...
Mon Oct 28 17:03:36 UTC 2019 Deleted history files
###################################################################
Installing (Fake) Crypto Currency miner
###################################################################
Mon Oct 28 17:03:36 UTC 2019 Setting up crypto miner...
Mon Oct 28 17:03:36 UTC 2019 Cloning into 'cpuminer'...
Mon Oct 28 17:03:36 UTC 2019 Mining crypto with device resources
77. The Industrial Grade Azure RTOS
leverages the near-wire-speed
performance and small footprint
of NetX Duo, along with the IoT
cloud protocol Message Queue
Telemetry Transport (MQTT) to
publish and subscribe data to the
Microsoft Azure cloud. All data in
both directions is secured by
NETX Secure TLS. Any physical
layer transport layer is supported ,
e.g., WiFi,802.15.4 radio, and more.
Azure RTOS: エッジ デバイス用のシームレスなクラウドへの接続性
81. Mixed Reality ハードウェア
Azure Kinect DK出荷予定のアナウンス
2010 Kinect 360 released for Xbox 360
2012 Kinect for Windows v1 released
- Skeleton tracking part of SDK
- Skeleton 1.0 composed of 20 joints/landmarks
2013 Kinect One released as part of Xbox One
2014 Kinect for Windows v2 released
- Improved body tracking part of SDK
- Skeleton 2.0 composed of 25 joints/landmarks
2018 Project Kinect for Azure announced
2019 Azure Kinect DK launched at MWC19
- New body tracking SDK
- Skeleton 3.0 composed of at least 28 joints/landmarks
2020 Azure Kinect Development Kitを日本、ドイツ、イギリスにて2020年3月より発売!
https://blogs.windows.com/japan/2019/11/11/azure-kinect-dk-announces-upcoming-market-availability/
82. Wednesday, 10:30 – 11:15 am (BRK2228)
Thursday, 9:00 – 10:15 am (BRK3281)
https://myignite.techcommunity.microsoft.com/sessions
83. Monday
Build your custom IoT solution with Azure IoT
Central
2:50 pm THR2248
Time Series Insights – end-to-end analytics for IoT
workloads
5:45 pm THR3146
Tuesday
AI at the Edge: using IoT Edge to remove latency,
cost, and privacy roadblocks to IoT deployments
1:15 pm THR2238
Unlocking Location Intelligence with Azure Maps 3:40 pm THR2261
Wednesday
Integrate devices to your solution quickly with IoT
Plug and Play
1:15 pm THR2254
Bring IT security practices to IoT: how to stop
threats and improve security posture
1:50 pm THR2291
https://myignite.techcommunity.microsoft.com/sessions