1. European Research Council
DIADEM domain-centric intelligent automated
data extraction methodology
DIADEM:
Prototype 0.1
Tim Furche
Oxford University Computing Laboratories, DIADEM group

2. DIADEM 0.1
DIADEM DIADEM 0.1: Promises
Fact finders for all structural and visual information (Giovanni)
Fact finders for all major entity types with their relationships (Omer)
Annotation model for semi-formal vocabularies such as ID and CLASS
(Omer)
Fact finders for classifying web pages and major web blocks (Andrey)
Rule-based form analyzer full form model including form filling, form
submission and dependency information as needed (Xiaonan)
Rule-based result and details page analyzer (Cheng)
Site ana­lyzer that is able to produce a navigation model (Christian)
Generator for (OXPath) extraction programs (Tim)
DIADEM 0.1 • DIADEM team meeting • January 20th, 2010 © DIADEM team 2

3. DIADEM 0.1: January Milestone
DIADEM Infrastructure
Browser API
decide on the DIADEM 0.1 browser
extend the browser API as needed by the navigation & probing
Determine the (initial) platform(s)
Interface-Types: DLV-Wrapper API
Testing, documentation, experimental campaign
DIADEM 0.1 • DIADEM team meeting • January 20th, 2010 © DIADEM team 3

4. DIADEM 0.1: January Milestone
DIADEM NLP: Textual Clues & Descriptions
Label and values for form, result page & navigation
ontology concepts
Gazetteers for form and result page labels
Techniques for annotating values of domain concepts
Analysis of free text descriptions
based on ontology
exploiting the repeated structure
consistency with structural clues
DIADEM 0.1 • DIADEM team meeting • January 20th, 2010 © DIADEM team 4

5. DIADEM 0.1: January Milestone
DIADEM ML: Non-Textual & Navigation Blocks
Ontology of the non-textual and navigation blocks
Recognizing and classifying non-textual blocks
description images
advertisement
featured results
Recognizing and classifying navigation blocks
next iteration
menu blocks
DIADEM 0.1 • DIADEM team meeting • January 20th, 2010 © DIADEM team 5

6. DIADEM 0.1: January Milestone
DIADEM Form Analysis & Submission
From label, value, and group annotations to classifications
Form submission
boolean dependencies among form fields
required fields
identifying the submission action
from form values to field domains
field values not included in select
maximizing result coverage
Optional: integrating visual clues
DIADEM 0.1 • DIADEM team meeting • January 20th, 2010 © DIADEM team 6

7. DIADEM 0.1: January Milestone
DIADEM Result & Details Page Analysis
Ontology of real-estate result page records
Records annotated by ontology concepts
flat records, probably no out-of-record clues
optional: details pages
Ontology-driven segmentation (schema of the records)
Structured label-value attributes, free-text description (NLP)
optional: identifying multiple attributes in (short) free-text
DIADEM 0.1 • DIADEM team meeting • January 20th, 2010 © DIADEM team 7

8. DIADEM 0.1: January Milestone
DIADEM PDF Detail Pages
Layout analysis
Semantic annotations for PDFs
Extracting description title
Extracting description texts
Basic document structure (footers, headers, …)
optional: towards a HTML representation of PDF real estate records
DIADEM 0.1 • DIADEM team meeting • January 20th, 2010 © DIADEM team 8

9. DIADEM 0.1: January Milestone
DIADEM Probing & Navigation
Ontology of navigation element and page types
Given a URL navigate to and identify form pages
Given the form model, exhaustively query the form to get result pages
maximizing coverage
next page iteration
optional: details pages
collect location clues (out-of-record clues)
DIADEM 0.1 • DIADEM team meeting • January 20th, 2010 © DIADEM team 9

10. DIADEM 0.1: January Milestone
DIADEM OXPath Generator
Navigation expression to the form
(from the navigation model)
Filling the form (maximizing the result coverage)
(from the form & navigation model)
generation of the needed form filling bindings in the host language
Iterating over the result pages & result records
extracting the attributes
(from the result page & navigation model)
DIADEM 0.1 • DIADEM team meeting • January 20th, 2010 © DIADEM team 10

11. DIADEM 0.1: January Milestone
DIADEM OXPath Engine
Tight integration with the OXPath generator and navigation model
support for all needed actions
e.g.: selecting values based on regular expressions
OXPath host language
for filling multiple form values
DIADEM 0.1 • DIADEM team meeting • January 20th, 2010 © DIADEM team 11

12. DIADEM 0.1: January Milestone
DIADEM Integration
DIADEM 0.1 • DIADEM team meeting • January 20th, 2010 © DIADEM team 12

13. DIADEM DIADEM 0.1
Interfaces: Jan 27th, 2011
7
Prototypes: Feb 4th, 2011
15
DIADEM 0.1: March 15th, 2011
52