Weitere ähnliche Inhalte Ähnlich wie Presentation (10) Presentation1. The Potential of the 3D Internet
in the Cultural Heritage Domain
André Stork, Dieter Fellner
Fraunhofer IGD
http://www.igd.fraunhofer.de
GRIS / TU Darmstadt
http://www.gris.tu-darmstadt.de
© 2012 D. Fellner
1 EuroMed, 30.10.2012 – A. Stork / D. Fellner
3. 3D Cultural Heritage Artifacts
• worldwide
many
hundreds of
millions of
CH objects
137 million objects
© 2012 D. Fellner
3 EuroMed, 30.10.2012 – A. Stork / D. Fellner
4. 3D Cultural Heritage Artifacts: precious & fragile
• Stadtarchiv Köln
30 shelf-km
collapse 3/2009
• Herzogin Anna Amalia Bibliothek
Weimar
© 2012 D. Fellner
4 EuroMed, 30.10.2012 – A. Stork / D. Fellner
5. 3D Cultural Heritage Artifacts
• Cultural heritage exhibits
from all over the world
• Artifacts dating back 6000
years in human history
• More than 175 years of
museum history
• ~ 6 million artifacts
• 120.000 new objects per year
© 2012 D. Fellner
5 EuroMed, 30.10.2012 – A. Stork / D. Fellner
6. 3D Cultural Heritage Artifacts
• Let‘s do some calculations …
• If we would like to scan only the new objects …
• 120.000 / 365 days / 24 h / 60 minutes =
• 0,22 obj/min
• 4,38 min/object
• Houston, we have a problem!
© 2012 D. Fellner
• Why? …
6 EuroMed, 30.10.2012 – A. Stork / D. Fellner
7. 3D geometry digitization: state of the art
3D Artifact Digital Replica
© 2012 D. Fellner
7 EuroMed, 30.10.2012 – A. Stork / D. Fellner
8. 3D material acquisition: state of the art
• BTF-Dome (TU Bonn)
© 2012 D. Fellner
8 EuroMed, 30.10.2012 – A. Stork / D. Fellner
9. V&A study: Geometry with texture (no complex materials)
[h]
25
20
15
10
5
© 2012 D. Fellner
Digitization [h] Postprocessing [h] (Study: Victoria & Albert Museum)
9 EuroMed, 30.10.2012 – A. Stork / D. Fellner
10. 3D Digitization & Documentation
The model
© 2012 D. Fellner
10 EuroMed, 30.10.2012 – A. Stork / D. Fellner
11. Time Budget: Geometry & Texture PLUS Material ̶ today
Geometry and Material acquisition Postprocessing
texture
acquisition
12 h 16 h 8h
= 36 hours
Preparation Return
© 2012 D. Fellner
11 EuroMed, 30.10.2012 – A. Stork / D. Fellner
12. 3D Cultural Heritage Artifacts
• 3D acquisition challenges:
• faster acquisition
• optically complicated objects
• spatially varying materials
• translucent / transparent materials
• cost reduction
• ease of use
• develop and establish workflows
• transfer of knowledge and guidelines
© 2012 D. Fellner
• projects with critical mass
12 EuroMed, 30.10.2012 – A. Stork / D. Fellner
13. 3D Cultural Heritage Artifacts
• technical approaches
• fast cameras
• faster projectors (even more important)
• automation (e.g. scan planning)
• post-processing (registration, stitching, cleaning, etc.)
• new sensors and sensor fusion
• potential organizational solutions
• ‚standardized‘ workflows
© 2012 D. Fellner
• rights management
13 EuroMed, 30.10.2012 – A. Stork / D. Fellner
14. What to do with all the
digital 3D artefacts?
© 2012 D. Fellner
14 EuroMed, 30.10.2012 – A. Stork / D. Fellner
15. Acquisition /
Research
Digitization
Documentation Sales &
Shipping
Preservation
Exhibition PR & Marketing
Education Entertainment
© 2012 D. Fellner
15 EuroMed, 30.10.2012 – A. Stork / D. Fellner
17. 3D-centered documentation
• 3D linking with
• media data
• meta data
• provenance data
© 2012 D. Fellner
17 EuroMed, 30.10.2012 – A. Stork / D. Fellner
18. 3D-centered documentation
Repository
© 2012 D. Fellner
existing existing
resources resources
18 EuroMed, 30.10.2012 – A. Stork / D. Fellner
19. 3D-centered documentation
Repository
© 2012 D. Fellner
existing existing
resources resources
19 EuroMed, 30.10.2012 – A. Stork / D. Fellner
20. Annotation tools: state of the art
• structured information for describing the intrinsic structure of
the digital 3D shape
• (Papaleo and De Floriani 2010, Attene et al. 2009).
© 2012 D. Fellner
20 EuroMed, 30.10.2012 – A. Stork / D. Fellner
21. Annotation tools: state of the art
• segmenting, and structuring
• these are driven by different principles
• (Attene at al. 2006, Shamir 2008 and Chen et al. 2009)
vs.
© 2012 D. Fellner
complexity
segmentation benchmark (geometry and texture)
21 EuroMed, 30.10.2012 – A. Stork / D. Fellner
22. 3D documentation
• need for more sophisticated 3D annotation and segmentation
• requirements
• segment object by
• shape, texture/material, topology
• surface or volume selection
• link arbitrary media data (text, pictures, video, audio, …)
• establish multi-lateral relationships
• easy-to-use
© 2012 D. Fellner
22 EuroMed, 30.10.2012 – A. Stork / D. Fellner
24. Annotation tools
• future challenges and potential technical solutions
• human-assisted segmentation algorithms
• machine learning
• steering
• improved user interfaces
• gestures, drawing metaphors, etc.
• crowd sourcing / collaboration
• accessibility via 3D internet
© 2012 D. Fellner
24 EuroMed, 30.10.2012 – A. Stork / D. Fellner
25. 3D Internet and Europeana
© 2012 D. Fellner
25 EuroMed, 30.10.2012 – A. Stork / D. Fellner
26. 3D Internet: 3D Information inside the Web
• from websites to web applications
• increasing interest in 3D for
• product presentation
• visualization of abstract information
(e.g. time lines)
• enriching experience of Cultural Heritage
• enhancing user experience with more
sophisticated visualizations
Example 3D-COFORM:
• today: Adobe Flash-based sites with videos scanned historic 3D object
• tomorrow: Immersive 3D inside browsers
26 EuroMed, 30.10.2012 – A. Stork / D. Fellner
28. 3D Internet: X3DOM – Declarative (X)3D in HTML5
• allows utilizing JavaScript and DOM infrastructure for 3D
• brings together both worlds
• declarative content design as known from web design
• “old-school” imperative approaches known from game engine
development
<html>
<body>
<h1>Hello X3DOM World</h1>
<x3d>
<scene>
<shape>
<box></box>
</shape>
</scene>
</x3d>
</body>
</html>
28 EuroMed, 30.10.2012 – A. Stork / D. Fellner
29. 3D Internet: X3DOM – Declarative (X)3D in HTML5
• X3DOM := X3D + DOM
• DOM-based integration
framework for declarative
3D graphics in HTML5
• seamless integration of
3D contents in Web Browser
29 EuroMed, 30.10.2012 – A. Stork / D. Fellner
30. 3D Internet
© 2012 D. Fellner
http://www.3dcoform.eu/
x3domCatalog/
30 EuroMed, 30.10.2012 – A. Stork / D. Fellner
31. 3D Internet
© 2012 D. Fellner
http://www.3dcoform.eu/
x3domCatalog/
31 EuroMed, 30.10.2012 – A. Stork / D. Fellner
32. 3D Internet: the way of 3D to Europeana
Images
Legacy
3D-COFORM
© 2012 D. Fellner
Integrated Viewer Browser (IVB)
3D model
32 EuroMed, 30.10.2012 – A. Stork / D. Fellner
33. 3D Internet: the way of 3D to Europeana
UUID
dc:identifier
URI
europeana
3D
:ty pe
… …
ESE format
3D-COFORM IVB
© 2012 D. Fellner
3D model
33 EuroMed, 30.10.2012 – A. Stork / D. Fellner
34. 3D Internet: the way of 3D to Europeana
© 2012 D. Fellner
Europeana 3D Web presentation
34 EuroMed, 30.10.2012 – A. Stork / D. Fellner
35. 3D Internet
• future challenges and potential technical solutions
• automation
• Internet 3D search engines (shape retrieval)
• combined search
• meta data, shape, material, …
• organizational challenges
• rights management
• access, use, distribution, …
© 2012 D. Fellner
35 EuroMed, 30.10.2012 – A. Stork / D. Fellner
36. Conclusion
• 3D Internet can tremendously affect accessibility to
virtual 3D CH artefacts
• 3D Internet base technology exists
• WebGl, X3D, HTML5
• persisting technical challenges Cloud
• economic acquisition Computing
• organizational challenges
• future synergies
• linked open data Mobile 3D
• Cloud Computing devices Internet
• mobile devices
36 EuroMed, 30.10.2012 – A. Stork / D. Fellner
37. Thank you for your attention
Andre.Stork@igd.fraunhofer.de
www.igd.fraunhofer.de
www.3d-coform.eu
http://x3dom.org
© 2012 D. Fellner
37 EuroMed, 30.10.2012 – A. Stork / D. Fellner