This document discusses common architectures for processing, aggregating, and presenting complex data and content. It provides examples of TenForce projects involving mobile multimedia content delivery, European Union publications, financial risk management, Linked Open Data, and open data support. The document recommends taking an agile approach, focusing on data and metadata quality, and mastering metadata standards.
EDF2013: Invited Talk Bastiaan Deblieck: Who remembers EDP?
1. EDP?
Architectures for
Data and Content Processing
Bastiaan Deblieck,TenForce Business Unit Manager Semantic Technology
2013 TenForce 1
2. Message
IT architectures
for processing, aggregating
and presenting results
from complex, divers content
and data
share common features
2013 TenForce 2
3. TenForce
• Founded in 2001, in Belgium
• 40 people
• Semantic TechnologySofware services for EC and B2B
Publisher
– Publishing, Knowledge Management Technology, Open Data, ...
• Platform for delivering multimedia content to mobile devices
• Software Product:
Quality Assurance, Audits, Safety, Health, Project Management,
Scrum
• International customer base:
Belgium, Netherlands, Germany, France, Italy, Greece, EC
2012 TenForce 3
7. History
Object Web- Linked
SGML XML
Orientation services Data
2013 TenForce 7
8. Basic Architecture
Data/Content
Sources Processing Generic Layer Presentation
Model/Schema/Voc/Taxo
Corporate Feed
ERP web services
CRM
Accounting linked data
... Generic
Metadata SPARQL endpoint
Store
WWW Feed API
LOD/dataweb Portals
API Widgets
Generic Visualizations
Content/Data
CMS Feed Store
DMS
emails
Search
2013 TenForce 8
9. Advantages
• Flexibility
– Modular approach
– Seperation of data/content & metadata (enrichment)
• Scalability
– Can grow on all levels
– When virtual, this is even easy
2013 TenForce 9
11. Mobile Multimedia Content
Newspaper
Magazines
Video
• Multimedia Content Management +
Business Processes +
Integration with Telecom Platform
• Payable & DRM
• Mainly open source components
• Mobile platform: iOS & Android
• Linux, hosted, redundant
• 9 months lead time
• Around 10 FTE
2013 TenForce 11
12. EC Publications Office - Cellar
Common Portal
EU Portal
EUR-Lex TED CORDIS
Bookshop
Common search service
Index and
Search
Common indexes
Archive Common Metadata Content
Common Content Repository
Long term CELLAR
CELLAR Repository and
preservation
(CCR) (CMR) Metadata
MDR/
RECORD
Validation Metadata production Post-production
EUROVOC
Official General
pub-
Tendering
pub- CORDIS
External Production
documents sources
lications lications
2013 TenForce 12
13. Financial Risk Management
Data/Content
Sources Processing Generic Layer Presentation
Model/Schema/Voc/Taxo
Corporate Feed
ERP web services
CRM
Accounting linked data
... Generic
Metadata SPARQL endpoint
Store
WWW Feed API
LOD/dataweb Portals
API Widgets
Generic Visualizations
Content/Data
CMS Feed Store
DMS
emails
Search
2013 TenForce 13
14. LOD2
Data/Content
Sources Processing Generic Layer Presentation
Model/Schema/Voc/Taxo
Corporate Feed
ERP web services
CRM SILK
Accounting linked data
... Generic
Metadata SPARQL endpoint
Store
WWW Feed API
LOD/dataweb Portals
API Widgets
Generic Visualizations
Content/Data
CMS Feed Store
DMS
emails
Search
2013 TenForce 14
15. Open Data Support
• 2013 – 2016
• Repository for Open Data
Existing Open
Data Portal
Pan-European
Data Portal ODIPP
2013 TenForce 15
17. Projects: Recommendations
• Agile, Scrum
• Information analysis and design and software architecture
• Don’t forget the process
• Data, data, data or content, content content
– Assure internal consistency
– “Match” data/content and meta data
– Deal with classic problems
2013 TenForce 17
18. Projects: Recommendations
• Master the metadata
– Foundation for linking, connecting, aggretating, understanding
– Meta data standards facilitate, but are no guarantee
– Has to be of high quality
2013 TenForce 18