5-minute intro to Stetl an Open Source lightweight framework for handling the conversion and transformation (ETL) of in particular complex/rich GML. Stetl uses and combines existing tools like GDAL/OGR and XSLT. Python is used as glue. Users configure an ETL-process chain through a configuration. More at http://stetl.org

1. Taming Rich GML
with Stetl
Just van den Broecke
5 minute presentation at OSGeo.nl Stammtisch Wageningen
November 7, 2012
www.osgeo.nl
www.justobjects.nl

2. We have a
Problem

3. The Rich GML
Problem

4. Rich GML = Complex Mess

5. INSPIRE
BAG
BGT
Top10NL
.

7. The Streetname!

8. Complex
Model
Transformations

9. Millions
of
Objects

10. 10s of Millions
of
<Elements>

11. Multiple
Transformation
Steps

12. Solution is
Spatial ETL

13. A.K.A.

14. ThankYou
for your
Attention!

15. But...
....FOSS ? ... Stetl...?

16. FOSS ETL - High Level

17. FOSS ETL - Lower Level
But Each Powerful by Itself
ogr2ogr

18. FOSS ETL - DIY ? (No!)

19. FOSS ETL - How to Combine?
=+ + ?
ogr2ogr

20. FOSS ETL - Add Python to Equation
=+ + ?( )
ogr2ogr

21. =+ +
Stetl
( )
ogr2ogr

22. Stetl
=
Simple
Streaming
Spatial
Speedy
ETL

23. Process Chain
Input Filter Output
gml
Filter

24. Speed: Streaming
Input Filter Output
gml

25. Speed: Going Native
Input Filter Output
gml
ogr2ogr stETL
Native C Libs/Progs
Calls

26. Example: GML to PostGIS
Reader
XML
Splitter
ogr2ogr
gml

27. Example: INSPIRE Model Transform
ogr2ogr XSLT Writer
gml

28. Example: deegree Store
ogr2ogr XSLT
deegree
Writer

29. Process Chain - How?
Input Filters Output

30. Example: XML to Shape
The Source

31. Example: XML to Shape
First: XSLT Transform to GML

32. Example: XML to Shape
XML
Input
XSLT ogr2ogr

33. Example: XML to Shape
The Stetl Chain Config File
Process
Chain
Reader
XSLT
ogr2ogr

34. ThankYou !
http://stetl.org