This talk was given at the Busan Eco Delta City(Korea National Pilot Smart City) technical workshop held on 18th July. I talked about introduction and history of mago3D, some core technologies, real cases, and lessons learnt in this workshop.

1. Introduction to mago3D, an Open Source Based
Digital Twin Platform
Sanghee Shin(shshin@gaia3d.com)
18th July 2019
<Busan Eco Delta City Technical Workshop>

2. MAGO
Goddess of earth
in Korean old myth

3. History
2014
Project started.
NSIP Program
2016
Live 3D Geo-Platform
Alpha version released.
2017
GeoBIM Platform
Version1.0 released.
2018
Digital Twin Platform
Successfully commercialized.
2019
Smart Spaces Platform
Version2.0 released.

4. Background – Paradigm Shift of Spatial IT
<Source: Steve Liang(2016)>

5. Background – Paradigm Shift of Spatial IT
<Source: Steve Liang(2016)>

6. Size of Space
Update Cycle
Small
1980
1990
2000
2010 ~
2020
Large
Static
Dynamic
<Source: Sagong, Hosang(2016), Policy Directions of Spatial Information for Hyper-connected Society>
Background – Paradigm Shift of Spatial IT

7. <Source: Sagong, Hosang(2007)>
Background – Paradigm Shift of Spatial IT

8. Background – Paradigm Shift of Spatial IT
Current Future
Concept Object Information Context Awareness
Data Consumer Prosumer/DIY
User Person Things
Visualization Real World Digital Twin
Application Base Map Key Factor for Fusion
Driving Entity Public Sector Private Sector
Space Outdoor Indoor + Outdoor +
Update Cycle Static Dynamic
<Source: Sagong, Hosang(2016), ‘Policy Directions of Spatial Information for Hyper-connected Society’ modified>

9. GeoBIM: Geospatial + BIM

10. <Image Source: http://geospatial.net >
Building Information Modeling (BIM)
is a digital representation of physical and
functional characteristics of a facility.
GeoBIM: Geospatial + BIM

11. GeoBIM Platform

12. GeoBIM Activities from Standard Bodies
GIS
CityGML
GeospatialInformation
GISStandards
IFC
BIM
OutdoorModel
IndoorModel
BIMStandards
Construction
DrawingsInfo.
In/Outdoor
GIModel
(GeospatialInformation
Model)

13. GeoBIM Activities from Private Companies

14. GeoBIM Activities from Open Source Communities – mago3D

15. Toward Digital Twin Platform!

16. Toward Digital Twin Platform!
Point
Cloud
Drone
Image
IoT
CAD
Live
Data
AEC Autonomous
Cars
GIS
BIM
CityGML
Bottle Neck!

17. Sensory Organs
Memories
Brain
IoT(Internet of Things)
Big Data
A. I.
Smartizen(10Bn) Smart Devices(100Bn) Smart Sensor(100Tn)
Toward Digital Twin Platform!

18. Digital Twins
Digital Twins
A digital twin is a virtual representation of a
physical object or system across its lifecycle,
using real-time data to enable understanding,
learning and reasoning.

19. Digital Twins
Concept: Digital Informational Construct
Vision: Create, Test, Build

20. Digital Twins
Level 1
3D Visualization
Level 2
Real-time Monitoring
Level 3
Analysis, Prediction
Optimization
<Source: Use the IoT Platform Reference Model to Plan Your IoT Business Solutions, Gartner>

21. Introduction – mago3D
mago3D is a platform for …
Visualizing massive and complex 3D objects including BIM
on a web browser
1
Seamless integration of BIM/AEC and 3D GIS in a single space2
Web based collaborative issue/process management4
‘Digital Twin’ that can create parallel worlds in a virtual reality
with numerous IoT, sensor data
3
= 3D + Web + Open Source

22. Introduction – Architecture of mago3D
mago3D.JS
Cesium/WWW
Client
internet
Web Server WAS
F4DStorage
mago
Content
Management
DataBase
F4D Converter
3 main cores of mago3D

23. Introduction – Overall System Components
DB Postgresql 9.6 + PostGIS
Web Server Nginx 1.12.1 / Apache 2.4
Language Java8
Framework Spring(Springboot) + Mybatis
Build
Gradle
Log
Logback/Log4j
2
Security
ESAPI
Report
Jasper/POI
View
JSP/JSTL
UI/UX
Jquery
Chart
Jqplot/Axisj
Template
Thymeleaf
Handlebars
Web Map Server GeoServer
OS Centos 7.2
WebGL Globe Cesium, World Wind, …
Cache EhCache, Redis
Container Docker
WAS Tomcat 8.5

24. Introduction – Core parts of mago3D
F4D Converter mago3D.js
mago3D.js
3D GIS Engines
Cesium
Web World Wind
API
API
service html
F4D Converter converts 3D formats(IFC, 3DS, OBJ, DAE, JT)
to 3D internet service format F4D. It carries out data size
reducing and pre-processing for fast rendering
A plug-in composed of pure javascript which enables 3D GIS
engines to handle large-sized and highly detailed AEC data
F4D Converter
F4D
.ifc
.3ds
.obj
.dae
.gml

25. Introduction – mago3D.JS
Cesium World Wind WebGL Globe

26. Key Algorithms
GeoBIM is too heavy due to so many vertices and triangles in so many objects.
This causes two major issues in handling GeoBIM in web browsers.
!
Network Traffic Rendering Speed

27. Key Algorithms
So we introduced 3 concepts to solve these issues.
1. Reducing file size 3. Preprocessing
for speed
2. Building rougher
LOD
making indices
used in culling
removing duplication

28. Key Algorithms
Step What is this? Used for
1. Model/Reference
A concept of writing 3D data that only one
geometry among multiple geometries
congruent with each other is written.
reducing data size of semantic
data(ex. BIM/CAD, 3D data by
modeling)
2. NSM(Net Surface Mesh)
This is composed of 2 steps.
1. building meshes with regularly gridded
vertices on surfaces of raw 3D model.
2. triangle reduction.
making rougher LOD
※ 2nd step is separately applied
in simplifying targets in case of
triangular meshes such like TIN
or random-shaped 3D data
3. Visibility/Spatial index
Visibility index is for occlusion culling and
spatial index is for frustum culling in indoor
camera working.
carrying out a serial combination
of 2 cullings for fast
determination of targets to be
shown
Let’s look into more concretely.

29. With 4 geometric meshes - 4 models 23 objects are created. - 23 references
Image source : www.vecteezy.com
Key Algorithms : F4D, lightweight service format
Example of Model-Reference

30. 1. Build a triangular mesh based on the grid structure from the original three-dimensional data.
Key Algorithms : F4D, lightweight service format

31. Key Algorithms : F4D, lightweight service format

32. 1. When a camera position and
2. the viewing direction of it are setup,
3. mago3D does frustum culling on spatial indices
4. and do occlusion culling on the result of the
frustum culling.
5. Finally mago3d finds targets to be rendered.
(intersection between two indices)
→ It possible to select targets to be rendered
without any complicated geometric operation in
run-time.
How to use both indices
Key Algorithms : F4D, lightweight service format

33. mago3D runs on any device
Results: Accessible from any device, anytime, anywhere

34. Results: BIM(Indoor/Outdoor) Integration
Seamless integration of indoor and outdoor space
on the same platform
Scene from indoor to outdoor through windows Scene from outdoor to indoor through windows

35. Results: MEP Integration
Integration of large size MEP and 3D GIS on a web browser

36. Results: AEC Integration
Integration of large size AEC and 3D GIS on a web browser

37. Results: CityGML Integration
Integration of large size CityGML and 3D GIS on a web browser

38. Results: Point Cloud Integration
Integration of large size Point Cloud and 3D GIS on a web browser

39. Results: OGC WPS Integration
Integration of OGC Web Processing Service

40. Results: Various API supported (OpenAPIs)
APIs are supported for developing application
systems(currently 29 APIs) moving/rotating
a full building
moving objects &
viewing attributes registration/monitoring/search of issues

41. Real Cases – Ship Building Industry
Yards
Cranes
Office Buildings
Factories
Docks
BlocksShips
Smart Welding Machine Virtual Yard on Web Browser!
1,500 EA25 EA250 EA75 EA
25 EA
15,000 EA 1,700 EA
3 EA
• Project Name: Ship Building Process Management System
• 3D Models in Service

42. Real Cases – Seoul C-ITS
• Project Name: Seoul C-ITS Command & Control Center

43. Real Cases – KOPRI(Korea Polar Research Institute)
• Project Name: King Sejong Research Base Facility Management System

44. Real Cases – National Institute of Advanced Industrial Science and Technology, Japan

45. Real Cases – OpenIndoorMap Project

46. Real Cases – Live Drone Map Project
<Realtime geo-referencing>

47. Real Cases: Point Cloud Integration
23

48. Real Cases: Weather/Climate/Air Pollution/CFD

49. Real Cases – Others

50. What I’ve learnt from real projects
• Visualizing large and complex objects is still challenging.
• Many clients want to see *PRETTY* picture!
• After seeing the pretty picture, many clients want a functionality that can be done through 2D or
2.5D.
• 3D analysis, 3D simulation are among wish list that clients want to see on top of full of mago3D
platform.
• It’s still doubtful how 3D gives any real benefits over 2D.
• 3D is expensive and BIM is more expensive!
• Standards are not widely accepted across industries.
• Standard based modular and distributed architecture is very important for extensible system.

51. In Future
51
{Indoor, Outdoor}
{Static, Dynamic}
{Objects, Phenomena}
{Overground, Underground}
{Multi-Sensor, Multi-Source}
mago3D

52. In Future – Digital Twin based Smart City Platform
<Source: ITU Focus Group on Smart Sustainable Cities>

53. In Future – Digital Twin based Smart City Platform
<Source: ISO/IEC JTC1/WG11>
Stakeholders
Vision & Outcomes
Business Process Framework
Knowledge Management Framework
Engineering Framework

54. In Future – Digital Twin based Smart City Platform
<Source: OGC Smart Cities Spatial Information Framework>

55. Summary
Summary of mago3D!
• BIM/AEC and 3D GIS integration in a single space
• Web based – no need to install additional program
• Massive and complex 3D objects visualization
• Open source – Apache and AGPL license
• Supports industry standard formats(CityGML, IndoorGML, IFC, 3DS, DAE, GLTF…)
• In-Browser 3D objects moving/rotation/heading adjustment
• Highly extensible architecture
• Will be a ‘Digital Twin based Smart Spaces’ platform!
55

56. For more information, please visit http://mago3d.net
All the source codes are here: https://github.com/Gaia3D/mago3d
Thank you!
33
This research was supported by a grant(number:19NSIP-B080778-06) from National
Spatial Information Research Program (NSIP) funded by Ministry of Land, Infrastructure
and Transport of Korean government.
Sanghee Shin shshin@gaia3d.com