SlideShare ist ein Scribd-Unternehmen logo
1 von 29
Downloaden Sie, um offline zu lesen
© Fraunhofer SCAI
Text Mining at work: critical assessment
of the completeness and correctness of
knowledge-based, computable disease
models for the pharmaceutical industry
Prof. Martin Hofmann-Apitius
Head of the Department of Bioinformatics
Fraunhofer Institute for Algorithms and
Scientific Computing (SCAI)
II-SDV conference, Nice, April 16, 2013
© Fraunhofer SCAI
Where do I come from?  Fraunhofer Society
  Founded 1949
  Europe´s largest applied research organisation
  60 Research Institutes (7 Institutes in the US)
  17.000 Employees
 Annual Budget about 1,5 Billion Euro
  Financial model: 2/4 industry collaborations
1/4 public funding
1/4 institutional funding
*Joseph von Fraunhofer (1787 – 1826 )
Scientist, Inventor and Entrepreneur
© Fraunhofer SCAI
The Fraunhofer Institute Center Schloss Birlinghoven
  Largest research centre for informatics and applied mathematics in Germany
  Around 700 employees, thereof 500 scientists, approx. 200 students and
trainees
© Fraunhofer SCAI
What science are we doing?
SCAI Department of Bioinformatics: R&D in a nutshell
Fraunhofer SCAI Department of Bioinformatics R&D activities:
1.  Information extraction in the life sciences:
I.  Text Mining - Recognition of named entities & relationships in text
II.  Image Mining - Reconstruction of chemical information from
chemical structure depictions
2.  Disease modelling (focus on neurodegenerative diseases)
3.  eScience, Grid-/Cloud- Computing and HPC (Cluster)
Seite 5
My Dream: Direct Usage of Unstructured
Information Sources for Disease Modelling
From Text Mining Technology
to
Modelling of Neurodegenerative Diseases
Seite 6
Why Modelling of Neurodegeneration?
In 2009 the Federal Government of Germany decided to start a new research centre
that focuses on translational research on neurodegenerative diseases. In fact,
neurodegenerative diseases (Alzheimer, Parkinson, Multiple Sclerosis; Epilepsy;
„rare“ NDDs) are a major societal challenge:
The total costs of Alzheimer is estimated to exceed 20 trillion US$ in the US in the
years between 2020 - 2050. (source: Alzheimer.org). Current costs / year in the
US (according to Alzheimer.org): 183 billion US$
The incidence rate of Alzheimer and other dementias is almost 50% in the population
older than 85 years. Next generation will regularly have a life span of >100 years.
page 7
-29 %
-13 % -11 %
-20 %
+66 %
Changes in selected causes of death in USA , 2000-20101
1 www.alz.org
Diseases specific mortality rate
page 8
Non textual information – an example
Seite 9
Modelling Alzheimer´s Disease: Tools
-  An ontology capturing relevant knowledge on Alzheimer´s Disease (ADO;
Malhotra et al., “Alzheimer´s & Dementia”, in press)
-  An ontology representing brain regions and cell types (BRCO)
-  An excellent machinery for biomedical text mining (ProMiner – UIMA
enabled) with top performing gene and protein name recognition
-  A biomarker terminology that identifies biomarker candidates in the
scientific literature (Younesi et al., BMC Med. Inf. Dec. Making (2012))
-  A powerful formalism to capture knowledge and model it as a network of
causal and correlative relationships: BEL (biological expression language)
© Fraunhofer SCAI
Capturing Knowledge for Disease Models: BEL
Biological	
  Expression	
  Language	
  (BEL)	
  
BEL	
  is	
  a	
  language	
  for	
  represen1ng	
  scien1fic	
  findings	
  
(e.g.	
  what	
  you	
  would	
  read	
  in	
  a	
  journal	
  ar1cle)	
  in	
  a	
  
computable	
  form	
  
•  Captures	
  qualita1ve	
  causal	
  and	
  correla1ve	
  
rela1onships	
  in	
  context	
  
–  Biological	
  &	
  experimental	
  system	
  in	
  which	
  the	
  
rela1onships	
  were	
  observed	
  
–  Literature	
  cited	
  
–  Cura1on	
  process	
  
© 2012, Open BEL Community 11
Advantages	
  of	
  BEL	
  as	
  a	
  Language	
  
•  Standard	
  is	
  small	
  and	
  easy	
  to	
  learn	
  
•  Easy	
  to	
  read	
  and	
  use	
  
•  Computable	
  
–  Forms	
  a	
  graph-­‐based	
  knowledge	
  base	
  
•  Supports	
  both	
  causal	
  and	
  correla1ve	
  rela1onships	
  as	
  well	
  as	
  
nega1ve	
  rela1onships	
  
–  Suitable	
  for	
  recording	
  a	
  variety	
  of	
  experimental	
  and	
  clinical	
  findings	
  
•  Can	
  be	
  used	
  with	
  almost	
  any	
  set	
  of	
  vocabularies	
  and	
  
ontologies	
  
–  Highly	
  adaptable	
  and	
  easy	
  to	
  adopt	
  
•  Can	
  be	
  easily	
  extended	
  to	
  annotate	
  findings	
  with	
  use-­‐specific	
  
contexts	
  such	
  as	
  experimental	
  and	
  clinical	
  parameters	
  
© 2012, Open BEL Community 12
BEL	
  Language	
  Structure	
  
© 2012, Open BEL Community 13
“PMA	
  increases	
  the	
  kinase	
  ac1vity	
  of	
  p38	
  MAPKs”	
  
BEL	
  Forms	
  Graphs	
  
© 2012, Open BEL Community 14
subject	
  
object/
subject	
  
object	
  
predicate	
  
predicate	
  
•  Subject-­‐predicate-­‐object	
  “triples”	
  
•  Object	
  of	
  one	
  triple	
  can	
  be	
  subject	
  of	
  another	
  
•  PuRng	
  them	
  together	
  makes	
  arbitrarily	
  large	
  
knowledge	
  graphs	
  
•  Reasoning	
  over	
  causal	
  rela1onships	
  becomes	
  a	
  
graph	
  traversal	
  
©	
  2012,	
  Selventa.	
  All	
  Rights	
  Reserved.	
  
Example	
  3	
  
SET	
  Citation={"PubMed","Trends	
  Neurosci.	
  2008	
  Sep;31(9):454-­‐63.	
  Epub	
  2008	
  Jul	
  
31","18675468"}	
  
SET	
  Evidence	
  =	
  "In	
  healthy	
  neurons	
  the	
  axon	
  contains	
  relatively	
  high	
  amounts	
  of	
  
microtubules	
  which	
  are	
  stabilized	
  by	
  the	
  protein	
  tau."	
  
SET	
  Cell	
  =	
  "Neurons"	
  
SET	
  CellStructure	
  =	
  "Axons"	
  
•  Op1on	
  1	
  –	
  Use	
  associa1on	
  to	
  connect	
  Tau	
  and	
  microtubules	
  
–  p(HGNC:MAPT)	
  -­‐-­‐	
  a(MESHCL:Microtubules)	
  
•  Op1on	
  2	
  –	
  More	
  detailed	
  rela1onships,	
  provide	
  causal	
  flow	
  and	
  binding	
  
informa1on	
  
–  p(HGNC:MAPT)	
  =|	
  bp(GO:"microtubule	
  depolymerization")	
  
–  bp(GO:"microtubule	
  depolymerization")	
  =|	
  a(MESHCL:Microtubules)	
  
–  complex(p(HGNC:MAPT),	
  a(MESHCL:Microtubules))	
  
15	
  
©	
  2012,	
  Selventa.	
  All	
  Rights	
  Reserved.	
  
Example	
  3	
  	
  
•  Op1on	
  1	
  –	
  Use	
  associa1on	
  to	
  connect	
  Tau	
  and	
  microtubules	
  
–  p(HGNC:MAPT)	
  -­‐-­‐	
  a(MESHCL:Microtubules)	
  
•  Visualized	
  in	
  Cytoscape	
  
with	
  Phase	
  III	
  
•  Note	
  expansion	
  of	
  
associa1on	
  to	
  include	
  
reciprocal	
  rela1onship	
  
–  a(MESHCL:Microtubules)	
  	
  
	
  -­‐-­‐	
  p(HGNC:MAPT)	
  
•  Note	
  gene	
  ac1va1on	
  
pathway	
  
–  g(EG:4137)	
  transcribedTo	
  	
  r(EG:
4137)	
  
–  r(EG:4137)	
  translatedTo	
  	
  p(EG:
4137)	
  
16	
  
©	
  2012,	
  Selventa.	
  All	
  Rights	
  Reserved.	
  
Example	
  3	
  
•  Visualized	
  in	
  Cytoscape	
  with	
  
Phase	
  III	
  
•  Note	
  expansion	
  of	
  complex	
  
with	
  hasComponent	
  
rela1onships	
  
–  complex(p(HGNC:MAPT),	
  	
  
a(MESHCL:Microtubules))	
  	
  
hasComponent	
  a(MESHCL:Microtubules)	
  
–  complex(p(HGNC:MAPT),	
  	
  
a(MESHCL:Microtubules))	
  	
  
hasComponent	
  p(HGNC:MAPT)	
  
17	
  
•  Op1on	
  2	
  –	
  More	
  detailed	
  rela1onships	
  provide	
  causal	
  flow	
  and	
  binding	
  
informa1on	
  
–  p(HGNC:MAPT)	
  =|	
  bp(GO:"microtubule	
  depolymerization")	
  
–  bp(GO:"microtubule	
  depolymerization")	
  =|	
  a(MESHCL:Microtubules)	
  
–  complex(p(HGNC:MAPT),	
  a(MESHCL:Microtubules))	
  
© Fraunhofer SCAI
An OpenBEL Model for APP Physiology
-  Two models:
-  Human APP “normal physiology“
-  Human APP “Alzheimer Disease Condition”
-  Modelling principles:
-  No mixing of rodent and human physiology
-  Only causal and correlative relationships
-  Issues: integration of genetics and proteolytic processing
© Fraunhofer SCAI
APP Model Statistics:
-  Human APP “normal physiology“
-  8 modules representing defined pathway context
-  965 BEL statements
-  682 nodes and 1387 edges
-  Human APP “Alzheimer Disease Condition”
-  8 modules representing defined pathway context
-  1035 BEL statements
-  1301 nodes and 3116 edges
Seite 20
Screenshot of the APP openBEL Model
Seite 21
IMPROVER:
An Industrial Initiative for the Verification of
Systems Biology Models
Seite 22
IMPROVER: An Industrial Initiative for the Assessment of the
Quality and
Seite 23
Seite 24
Seite 25
Automated Recognition and Extraction of Causal Statements
Seite 26
How do we Assess the Completeness and
Correctness of Systems Biology Models?
Seite 27
Features for a Scoring Function
  xxxxxxxxxxxxxxxxxxxxx
  xxxxxxxxxxxxxxxxxxxxx
  xxxxxxxxxxxxxxxxxxxxx
  xxxxxxxxxxxxxxxxxxxxx
© Fraunhofer SCAI
The Scoring Function at Work
Picture deleted ..... Sorry
Results too recent to share them with a wider community
We are willing and happy to share our results through a journal
publication within the next year
© Fraunhofer SCAI
Take Home Message
  Text Mining Technology allows for direct usage of extracted information
for systems biology models / disease models
  The Biological Expression Language BEL is an easy-to-learn formalism
ideally suited for capturing knowledge and knowledge – based modeling
of complex diseases
  The industrial IMPROVER challenge addresses the issue of systems
biology model verification, SCAI contributes a BEL extraction engine
  Fraunhofer SCAI has developed a complex scoring function to assess
the completeness and correctness of disease models

Weitere ähnliche Inhalte

Andere mochten auch

II-SDV 2013 Pharmaceutical Companies and Social Media: Developing New Strategies
II-SDV 2013 Pharmaceutical Companies and Social Media: Developing New StrategiesII-SDV 2013 Pharmaceutical Companies and Social Media: Developing New Strategies
II-SDV 2013 Pharmaceutical Companies and Social Media: Developing New Strategies
Dr. Haxel Consult
 
II-SDV 2013 Text Mining Diverse Data
II-SDV 2013 Text Mining Diverse DataII-SDV 2013 Text Mining Diverse Data
II-SDV 2013 Text Mining Diverse Data
Dr. Haxel Consult
 
II-SDV 2013 Challenges in Visualizing Pharmaceutical Business Information
II-SDV 2013 Challenges in Visualizing Pharmaceutical Business InformationII-SDV 2013 Challenges in Visualizing Pharmaceutical Business Information
II-SDV 2013 Challenges in Visualizing Pharmaceutical Business Information
Dr. Haxel Consult
 
II-SDV 2013 Customized Newsletters - Strategies to Improved Current Awareness
II-SDV 2013 Customized Newsletters - Strategies to Improved Current AwarenessII-SDV 2013 Customized Newsletters - Strategies to Improved Current Awareness
II-SDV 2013 Customized Newsletters - Strategies to Improved Current Awareness
Dr. Haxel Consult
 
II-SDV 2013 Tweet Mining: Is it Useful and Should we Bother?
II-SDV 2013 Tweet Mining: Is it Useful and Should we Bother? II-SDV 2013 Tweet Mining: Is it Useful and Should we Bother?
II-SDV 2013 Tweet Mining: Is it Useful and Should we Bother?
Dr. Haxel Consult
 
II-SDV 2013 Finding Stories and Telling Stories: Two Sides of Data Visualization
II-SDV 2013 Finding Stories and Telling Stories: Two Sides of Data VisualizationII-SDV 2013 Finding Stories and Telling Stories: Two Sides of Data Visualization
II-SDV 2013 Finding Stories and Telling Stories: Two Sides of Data Visualization
Dr. Haxel Consult
 
II-SDV 2013 Key Success Factors in the Setup of Cutting-Edge Patent Intellige...
II-SDV 2013 Key Success Factors in the Setup of Cutting-Edge Patent Intellige...II-SDV 2013 Key Success Factors in the Setup of Cutting-Edge Patent Intellige...
II-SDV 2013 Key Success Factors in the Setup of Cutting-Edge Patent Intellige...
Dr. Haxel Consult
 

Andere mochten auch (8)

II-SDV 2013 Pharmaceutical Companies and Social Media: Developing New Strategies
II-SDV 2013 Pharmaceutical Companies and Social Media: Developing New StrategiesII-SDV 2013 Pharmaceutical Companies and Social Media: Developing New Strategies
II-SDV 2013 Pharmaceutical Companies and Social Media: Developing New Strategies
 
II-SDV 2013 Text Mining Diverse Data
II-SDV 2013 Text Mining Diverse DataII-SDV 2013 Text Mining Diverse Data
II-SDV 2013 Text Mining Diverse Data
 
II-SDV 2013 Challenges in Visualizing Pharmaceutical Business Information
II-SDV 2013 Challenges in Visualizing Pharmaceutical Business InformationII-SDV 2013 Challenges in Visualizing Pharmaceutical Business Information
II-SDV 2013 Challenges in Visualizing Pharmaceutical Business Information
 
II-SDV 2013 Customized Newsletters - Strategies to Improved Current Awareness
II-SDV 2013 Customized Newsletters - Strategies to Improved Current AwarenessII-SDV 2013 Customized Newsletters - Strategies to Improved Current Awareness
II-SDV 2013 Customized Newsletters - Strategies to Improved Current Awareness
 
II-SDV 2013 Tweet Mining: Is it Useful and Should we Bother?
II-SDV 2013 Tweet Mining: Is it Useful and Should we Bother? II-SDV 2013 Tweet Mining: Is it Useful and Should we Bother?
II-SDV 2013 Tweet Mining: Is it Useful and Should we Bother?
 
II-SDV 2013 Finding Stories and Telling Stories: Two Sides of Data Visualization
II-SDV 2013 Finding Stories and Telling Stories: Two Sides of Data VisualizationII-SDV 2013 Finding Stories and Telling Stories: Two Sides of Data Visualization
II-SDV 2013 Finding Stories and Telling Stories: Two Sides of Data Visualization
 
II-SDV 2013 Key Success Factors in the Setup of Cutting-Edge Patent Intellige...
II-SDV 2013 Key Success Factors in the Setup of Cutting-Edge Patent Intellige...II-SDV 2013 Key Success Factors in the Setup of Cutting-Edge Patent Intellige...
II-SDV 2013 Key Success Factors in the Setup of Cutting-Edge Patent Intellige...
 
II-SDV 2017 in Nice - The International Information Conference on Search, Dat...
II-SDV 2017 in Nice - The International Information Conference on Search, Dat...II-SDV 2017 in Nice - The International Information Conference on Search, Dat...
II-SDV 2017 in Nice - The International Information Conference on Search, Dat...
 

Ähnlich wie II-SDV 2013 Text Mining at Work: Critical Assessment of the Completeness and Correctness of Knowledge-Based, Computable Disease Models for the Pharmaceutical Industry

Apollo and i5K: Collaborative Curation and Interactive Analysis of Genomes
Apollo and i5K: Collaborative Curation and Interactive Analysis of GenomesApollo and i5K: Collaborative Curation and Interactive Analysis of Genomes
Apollo and i5K: Collaborative Curation and Interactive Analysis of Genomes
Monica Munoz-Torres
 
Conference-The-future-will-be-digital-and-biology-but who-will-lead-watson-go...
Conference-The-future-will-be-digital-and-biology-but who-will-lead-watson-go...Conference-The-future-will-be-digital-and-biology-but who-will-lead-watson-go...
Conference-The-future-will-be-digital-and-biology-but who-will-lead-watson-go...
Manuel GEA - Bio-Modeling Systems
 
Overall presentation Matram project
Overall presentation Matram project Overall presentation Matram project
Overall presentation Matram project
RaphaelGirod
 
Brain-Bladder Axis in Tissue Growth and Remodelling (Miftahof, Roustem N Prof...
Brain-Bladder Axis in Tissue Growth and Remodelling (Miftahof, Roustem N Prof...Brain-Bladder Axis in Tissue Growth and Remodelling (Miftahof, Roustem N Prof...
Brain-Bladder Axis in Tissue Growth and Remodelling (Miftahof, Roustem N Prof...
SahilPatel909550
 
II-SDV 2012 From (Text) Mining to Models: Applying Large-Scale Text Mining on...
II-SDV 2012 From (Text) Mining to Models: Applying Large-Scale Text Mining on...II-SDV 2012 From (Text) Mining to Models: Applying Large-Scale Text Mining on...
II-SDV 2012 From (Text) Mining to Models: Applying Large-Scale Text Mining on...
Dr. Haxel Consult
 

Ähnlich wie II-SDV 2013 Text Mining at Work: Critical Assessment of the Completeness and Correctness of Knowledge-Based, Computable Disease Models for the Pharmaceutical Industry (20)

2011-10-11 Open PHACTS at BioIT World Europe
2011-10-11 Open PHACTS at BioIT World Europe2011-10-11 Open PHACTS at BioIT World Europe
2011-10-11 Open PHACTS at BioIT World Europe
 
Pathology is being disrupted by Data Integration, AI & Blockchain
Pathology is being disrupted by Data Integration, AI & BlockchainPathology is being disrupted by Data Integration, AI & Blockchain
Pathology is being disrupted by Data Integration, AI & Blockchain
 
Machine learning in biology
Machine learning in biologyMachine learning in biology
Machine learning in biology
 
ICSB 2013 - Visits Abroad Report
ICSB 2013 - Visits Abroad ReportICSB 2013 - Visits Abroad Report
ICSB 2013 - Visits Abroad Report
 
Big datasets
Big datasetsBig datasets
Big datasets
 
Apollo and i5K: Collaborative Curation and Interactive Analysis of Genomes
Apollo and i5K: Collaborative Curation and Interactive Analysis of GenomesApollo and i5K: Collaborative Curation and Interactive Analysis of Genomes
Apollo and i5K: Collaborative Curation and Interactive Analysis of Genomes
 
Conference-The-future-will-be-digital-and-biology-but who-will-lead-watson-go...
Conference-The-future-will-be-digital-and-biology-but who-will-lead-watson-go...Conference-The-future-will-be-digital-and-biology-but who-will-lead-watson-go...
Conference-The-future-will-be-digital-and-biology-but who-will-lead-watson-go...
 
Genomics and Proteomics - Impact on Drug Discovery
Genomics and Proteomics - Impact on Drug DiscoveryGenomics and Proteomics - Impact on Drug Discovery
Genomics and Proteomics - Impact on Drug Discovery
 
How can we har­ness the Human Brain Project to max­i­mize its future health a...
How can we har­ness the Human Brain Project to max­i­mize its future health a...How can we har­ness the Human Brain Project to max­i­mize its future health a...
How can we har­ness the Human Brain Project to max­i­mize its future health a...
 
Overall presentation Matram project
Overall presentation Matram project Overall presentation Matram project
Overall presentation Matram project
 
Data analysis & integration challenges in genomics
Data analysis & integration challenges in genomicsData analysis & integration challenges in genomics
Data analysis & integration challenges in genomics
 
Molecular modelling for in silico drug discovery
Molecular modelling for in silico drug discoveryMolecular modelling for in silico drug discovery
Molecular modelling for in silico drug discovery
 
Evolution 2013: Prof. Dr. Georges De Moor, EuroRec on Liberating Health Data ...
Evolution 2013: Prof. Dr. Georges De Moor, EuroRec on Liberating Health Data ...Evolution 2013: Prof. Dr. Georges De Moor, EuroRec on Liberating Health Data ...
Evolution 2013: Prof. Dr. Georges De Moor, EuroRec on Liberating Health Data ...
 
Brain-Bladder Axis in Tissue Growth and Remodelling (Miftahof, Roustem N Prof...
Brain-Bladder Axis in Tissue Growth and Remodelling (Miftahof, Roustem N Prof...Brain-Bladder Axis in Tissue Growth and Remodelling (Miftahof, Roustem N Prof...
Brain-Bladder Axis in Tissue Growth and Remodelling (Miftahof, Roustem N Prof...
 
Artigo salivaprint
Artigo salivaprintArtigo salivaprint
Artigo salivaprint
 
II-SDV 2012 From (Text) Mining to Models: Applying Large-Scale Text Mining on...
II-SDV 2012 From (Text) Mining to Models: Applying Large-Scale Text Mining on...II-SDV 2012 From (Text) Mining to Models: Applying Large-Scale Text Mining on...
II-SDV 2012 From (Text) Mining to Models: Applying Large-Scale Text Mining on...
 
EUSFLAT 2019: explainable neuro fuzzy recurrent neural network to predict col...
EUSFLAT 2019: explainable neuro fuzzy recurrent neural network to predict col...EUSFLAT 2019: explainable neuro fuzzy recurrent neural network to predict col...
EUSFLAT 2019: explainable neuro fuzzy recurrent neural network to predict col...
 
A Cell-Cycle Knowledge Integration Framework
A Cell-Cycle Knowledge Integration FrameworkA Cell-Cycle Knowledge Integration Framework
A Cell-Cycle Knowledge Integration Framework
 
computer simulations.pptx
computer simulations.pptxcomputer simulations.pptx
computer simulations.pptx
 
2011-11-28 Open PHACTS at RSC CICAG
2011-11-28 Open PHACTS at RSC CICAG2011-11-28 Open PHACTS at RSC CICAG
2011-11-28 Open PHACTS at RSC CICAG
 

Mehr von Dr. Haxel Consult

AI-SDV 2022: The race to net zero: Tracking the green industrial revolution t...
AI-SDV 2022: The race to net zero: Tracking the green industrial revolution t...AI-SDV 2022: The race to net zero: Tracking the green industrial revolution t...
AI-SDV 2022: The race to net zero: Tracking the green industrial revolution t...
Dr. Haxel Consult
 
AI-SDV 2022: Domain Knowledge makes Artificial Intelligence Smart Linda Ander...
AI-SDV 2022: Domain Knowledge makes Artificial Intelligence Smart Linda Ander...AI-SDV 2022: Domain Knowledge makes Artificial Intelligence Smart Linda Ander...
AI-SDV 2022: Domain Knowledge makes Artificial Intelligence Smart Linda Ander...
Dr. Haxel Consult
 
AI-SDV 2022: Where’s the one about…? Looney Tunes® Revisited Jay Ven Eman (CE...
AI-SDV 2022: Where’s the one about…? Looney Tunes® Revisited Jay Ven Eman (CE...AI-SDV 2022: Where’s the one about…? Looney Tunes® Revisited Jay Ven Eman (CE...
AI-SDV 2022: Where’s the one about…? Looney Tunes® Revisited Jay Ven Eman (CE...
Dr. Haxel Consult
 

Mehr von Dr. Haxel Consult (20)

AI-SDV 2022: Henry Chang Patent Intelligence and Engineering Management
AI-SDV 2022: Henry Chang Patent Intelligence and Engineering ManagementAI-SDV 2022: Henry Chang Patent Intelligence and Engineering Management
AI-SDV 2022: Henry Chang Patent Intelligence and Engineering Management
 
AI-SDV 2022: Creation and updating of large Knowledge Graphs through NLP Anal...
AI-SDV 2022: Creation and updating of large Knowledge Graphs through NLP Anal...AI-SDV 2022: Creation and updating of large Knowledge Graphs through NLP Anal...
AI-SDV 2022: Creation and updating of large Knowledge Graphs through NLP Anal...
 
AI-SDV 2022: The race to net zero: Tracking the green industrial revolution t...
AI-SDV 2022: The race to net zero: Tracking the green industrial revolution t...AI-SDV 2022: The race to net zero: Tracking the green industrial revolution t...
AI-SDV 2022: The race to net zero: Tracking the green industrial revolution t...
 
AI-SDV 2022: Accommodating the Deep Learning Revolution by a Development Proc...
AI-SDV 2022: Accommodating the Deep Learning Revolution by a Development Proc...AI-SDV 2022: Accommodating the Deep Learning Revolution by a Development Proc...
AI-SDV 2022: Accommodating the Deep Learning Revolution by a Development Proc...
 
AI-SDV 2022: Domain Knowledge makes Artificial Intelligence Smart Linda Ander...
AI-SDV 2022: Domain Knowledge makes Artificial Intelligence Smart Linda Ander...AI-SDV 2022: Domain Knowledge makes Artificial Intelligence Smart Linda Ander...
AI-SDV 2022: Domain Knowledge makes Artificial Intelligence Smart Linda Ander...
 
AI-SDV 2022: Embedding-based Search Vs. Relevancy Search: comparing the new w...
AI-SDV 2022: Embedding-based Search Vs. Relevancy Search: comparing the new w...AI-SDV 2022: Embedding-based Search Vs. Relevancy Search: comparing the new w...
AI-SDV 2022: Embedding-based Search Vs. Relevancy Search: comparing the new w...
 
AI-SDV 2022: Rolling out web crawling at Boehringer Ingelheim - 10 years of e...
AI-SDV 2022: Rolling out web crawling at Boehringer Ingelheim - 10 years of e...AI-SDV 2022: Rolling out web crawling at Boehringer Ingelheim - 10 years of e...
AI-SDV 2022: Rolling out web crawling at Boehringer Ingelheim - 10 years of e...
 
AI-SDV 2022: Machine learning based patent categorization: A success story in...
AI-SDV 2022: Machine learning based patent categorization: A success story in...AI-SDV 2022: Machine learning based patent categorization: A success story in...
AI-SDV 2022: Machine learning based patent categorization: A success story in...
 
AI-SDV 2022: Machine learning based patent categorization: A success story in...
AI-SDV 2022: Machine learning based patent categorization: A success story in...AI-SDV 2022: Machine learning based patent categorization: A success story in...
AI-SDV 2022: Machine learning based patent categorization: A success story in...
 
AI-SDV 2022: Finding the WHAT – Will AI help? Nils Newman (Search Technology,...
AI-SDV 2022: Finding the WHAT – Will AI help? Nils Newman (Search Technology,...AI-SDV 2022: Finding the WHAT – Will AI help? Nils Newman (Search Technology,...
AI-SDV 2022: Finding the WHAT – Will AI help? Nils Newman (Search Technology,...
 
AI-SDV 2022: New Insights from Trademarks with Natural Language Processing Al...
AI-SDV 2022: New Insights from Trademarks with Natural Language Processing Al...AI-SDV 2022: New Insights from Trademarks with Natural Language Processing Al...
AI-SDV 2022: New Insights from Trademarks with Natural Language Processing Al...
 
AI-SDV 2022: Extracting information from tables in documents Holger Keibel (K...
AI-SDV 2022: Extracting information from tables in documents Holger Keibel (K...AI-SDV 2022: Extracting information from tables in documents Holger Keibel (K...
AI-SDV 2022: Extracting information from tables in documents Holger Keibel (K...
 
AI-SDV 2022: Scientific publishing in the age of data mining and artificial i...
AI-SDV 2022: Scientific publishing in the age of data mining and artificial i...AI-SDV 2022: Scientific publishing in the age of data mining and artificial i...
AI-SDV 2022: Scientific publishing in the age of data mining and artificial i...
 
AI-SDV 2022: AI developments and usability Linus Wretblad (IPscreener / Uppdr...
AI-SDV 2022: AI developments and usability Linus Wretblad (IPscreener / Uppdr...AI-SDV 2022: AI developments and usability Linus Wretblad (IPscreener / Uppdr...
AI-SDV 2022: AI developments and usability Linus Wretblad (IPscreener / Uppdr...
 
AI-SDV 2022: Where’s the one about…? Looney Tunes® Revisited Jay Ven Eman (CE...
AI-SDV 2022: Where’s the one about…? Looney Tunes® Revisited Jay Ven Eman (CE...AI-SDV 2022: Where’s the one about…? Looney Tunes® Revisited Jay Ven Eman (CE...
AI-SDV 2022: Where’s the one about…? Looney Tunes® Revisited Jay Ven Eman (CE...
 
AI-SDV 2022: Copyright Clearance Center
AI-SDV 2022: Copyright Clearance CenterAI-SDV 2022: Copyright Clearance Center
AI-SDV 2022: Copyright Clearance Center
 
AI-SDV 2022: Lighthouse IP
AI-SDV 2022: Lighthouse IPAI-SDV 2022: Lighthouse IP
AI-SDV 2022: Lighthouse IP
 
AI-SDV 2022: New Product Introductions: CENTREDOC
AI-SDV 2022: New Product Introductions: CENTREDOCAI-SDV 2022: New Product Introductions: CENTREDOC
AI-SDV 2022: New Product Introductions: CENTREDOC
 
AI-SDV 2022: Possibilities and limitations of AI-boosted multi-categorization...
AI-SDV 2022: Possibilities and limitations of AI-boosted multi-categorization...AI-SDV 2022: Possibilities and limitations of AI-boosted multi-categorization...
AI-SDV 2022: Possibilities and limitations of AI-boosted multi-categorization...
 
AI-SDV 2022: Big data analytics platform at Bayer – Turning bits into insight...
AI-SDV 2022: Big data analytics platform at Bayer – Turning bits into insight...AI-SDV 2022: Big data analytics platform at Bayer – Turning bits into insight...
AI-SDV 2022: Big data analytics platform at Bayer – Turning bits into insight...
 

Kürzlich hochgeladen

Indian Escort in Abu DHabi 0508644382 Abu Dhabi Escorts
Indian Escort in Abu DHabi 0508644382 Abu Dhabi EscortsIndian Escort in Abu DHabi 0508644382 Abu Dhabi Escorts
Indian Escort in Abu DHabi 0508644382 Abu Dhabi Escorts
Monica Sydney
 
Abu Dhabi Escorts Service 0508644382 Escorts in Abu Dhabi
Abu Dhabi Escorts Service 0508644382 Escorts in Abu DhabiAbu Dhabi Escorts Service 0508644382 Escorts in Abu Dhabi
Abu Dhabi Escorts Service 0508644382 Escorts in Abu Dhabi
Monica Sydney
 
在线制作约克大学毕业证(yu毕业证)在读证明认证可查
在线制作约克大学毕业证(yu毕业证)在读证明认证可查在线制作约克大学毕业证(yu毕业证)在读证明认证可查
在线制作约克大学毕业证(yu毕业证)在读证明认证可查
ydyuyu
 
Russian Escort Abu Dhabi 0503464457 Abu DHabi Escorts
Russian Escort Abu Dhabi 0503464457 Abu DHabi EscortsRussian Escort Abu Dhabi 0503464457 Abu DHabi Escorts
Russian Escort Abu Dhabi 0503464457 Abu DHabi Escorts
Monica Sydney
 
一比一原版(Curtin毕业证书)科廷大学毕业证原件一模一样
一比一原版(Curtin毕业证书)科廷大学毕业证原件一模一样一比一原版(Curtin毕业证书)科廷大学毕业证原件一模一样
一比一原版(Curtin毕业证书)科廷大学毕业证原件一模一样
ayvbos
 
一比一原版(Offer)康考迪亚大学毕业证学位证靠谱定制
一比一原版(Offer)康考迪亚大学毕业证学位证靠谱定制一比一原版(Offer)康考迪亚大学毕业证学位证靠谱定制
一比一原版(Offer)康考迪亚大学毕业证学位证靠谱定制
pxcywzqs
 
Russian Call girls in Abu Dhabi 0508644382 Abu Dhabi Call girls
Russian Call girls in Abu Dhabi 0508644382 Abu Dhabi Call girlsRussian Call girls in Abu Dhabi 0508644382 Abu Dhabi Call girls
Russian Call girls in Abu Dhabi 0508644382 Abu Dhabi Call girls
Monica Sydney
 
call girls in Anand Vihar (delhi) call me [🔝9953056974🔝] escort service 24X7
call girls in Anand Vihar (delhi) call me [🔝9953056974🔝] escort service 24X7call girls in Anand Vihar (delhi) call me [🔝9953056974🔝] escort service 24X7
call girls in Anand Vihar (delhi) call me [🔝9953056974🔝] escort service 24X7
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
pdfcoffee.com_business-ethics-q3m7-pdf-free.pdf
pdfcoffee.com_business-ethics-q3m7-pdf-free.pdfpdfcoffee.com_business-ethics-q3m7-pdf-free.pdf
pdfcoffee.com_business-ethics-q3m7-pdf-free.pdf
JOHNBEBONYAP1
 

Kürzlich hochgeladen (20)

Trump Diapers Over Dems t shirts Sweatshirt
Trump Diapers Over Dems t shirts SweatshirtTrump Diapers Over Dems t shirts Sweatshirt
Trump Diapers Over Dems t shirts Sweatshirt
 
Indian Escort in Abu DHabi 0508644382 Abu Dhabi Escorts
Indian Escort in Abu DHabi 0508644382 Abu Dhabi EscortsIndian Escort in Abu DHabi 0508644382 Abu Dhabi Escorts
Indian Escort in Abu DHabi 0508644382 Abu Dhabi Escorts
 
Tadepalligudem Escorts Service Girl ^ 9332606886, WhatsApp Anytime Tadepallig...
Tadepalligudem Escorts Service Girl ^ 9332606886, WhatsApp Anytime Tadepallig...Tadepalligudem Escorts Service Girl ^ 9332606886, WhatsApp Anytime Tadepallig...
Tadepalligudem Escorts Service Girl ^ 9332606886, WhatsApp Anytime Tadepallig...
 
20240510 QFM016 Irresponsible AI Reading List April 2024.pdf
20240510 QFM016 Irresponsible AI Reading List April 2024.pdf20240510 QFM016 Irresponsible AI Reading List April 2024.pdf
20240510 QFM016 Irresponsible AI Reading List April 2024.pdf
 
APNIC Updates presented by Paul Wilson at ARIN 53
APNIC Updates presented by Paul Wilson at ARIN 53APNIC Updates presented by Paul Wilson at ARIN 53
APNIC Updates presented by Paul Wilson at ARIN 53
 
20240507 QFM013 Machine Intelligence Reading List April 2024.pdf
20240507 QFM013 Machine Intelligence Reading List April 2024.pdf20240507 QFM013 Machine Intelligence Reading List April 2024.pdf
20240507 QFM013 Machine Intelligence Reading List April 2024.pdf
 
Abu Dhabi Escorts Service 0508644382 Escorts in Abu Dhabi
Abu Dhabi Escorts Service 0508644382 Escorts in Abu DhabiAbu Dhabi Escorts Service 0508644382 Escorts in Abu Dhabi
Abu Dhabi Escorts Service 0508644382 Escorts in Abu Dhabi
 
在线制作约克大学毕业证(yu毕业证)在读证明认证可查
在线制作约克大学毕业证(yu毕业证)在读证明认证可查在线制作约克大学毕业证(yu毕业证)在读证明认证可查
在线制作约克大学毕业证(yu毕业证)在读证明认证可查
 
Local Call Girls in Seoni 9332606886 HOT & SEXY Models beautiful and charmin...
Local Call Girls in Seoni  9332606886 HOT & SEXY Models beautiful and charmin...Local Call Girls in Seoni  9332606886 HOT & SEXY Models beautiful and charmin...
Local Call Girls in Seoni 9332606886 HOT & SEXY Models beautiful and charmin...
 
Meaning of On page SEO & its process in detail.
Meaning of On page SEO & its process in detail.Meaning of On page SEO & its process in detail.
Meaning of On page SEO & its process in detail.
 
Best SEO Services Company in Dallas | Best SEO Agency Dallas
Best SEO Services Company in Dallas | Best SEO Agency DallasBest SEO Services Company in Dallas | Best SEO Agency Dallas
Best SEO Services Company in Dallas | Best SEO Agency Dallas
 
Russian Escort Abu Dhabi 0503464457 Abu DHabi Escorts
Russian Escort Abu Dhabi 0503464457 Abu DHabi EscortsRussian Escort Abu Dhabi 0503464457 Abu DHabi Escorts
Russian Escort Abu Dhabi 0503464457 Abu DHabi Escorts
 
Call girls Service in Ajman 0505086370 Ajman call girls
Call girls Service in Ajman 0505086370 Ajman call girlsCall girls Service in Ajman 0505086370 Ajman call girls
Call girls Service in Ajman 0505086370 Ajman call girls
 
一比一原版(Curtin毕业证书)科廷大学毕业证原件一模一样
一比一原版(Curtin毕业证书)科廷大学毕业证原件一模一样一比一原版(Curtin毕业证书)科廷大学毕业证原件一模一样
一比一原版(Curtin毕业证书)科廷大学毕业证原件一模一样
 
Real Men Wear Diapers T Shirts sweatshirt
Real Men Wear Diapers T Shirts sweatshirtReal Men Wear Diapers T Shirts sweatshirt
Real Men Wear Diapers T Shirts sweatshirt
 
一比一原版(Offer)康考迪亚大学毕业证学位证靠谱定制
一比一原版(Offer)康考迪亚大学毕业证学位证靠谱定制一比一原版(Offer)康考迪亚大学毕业证学位证靠谱定制
一比一原版(Offer)康考迪亚大学毕业证学位证靠谱定制
 
Russian Call girls in Abu Dhabi 0508644382 Abu Dhabi Call girls
Russian Call girls in Abu Dhabi 0508644382 Abu Dhabi Call girlsRussian Call girls in Abu Dhabi 0508644382 Abu Dhabi Call girls
Russian Call girls in Abu Dhabi 0508644382 Abu Dhabi Call girls
 
call girls in Anand Vihar (delhi) call me [🔝9953056974🔝] escort service 24X7
call girls in Anand Vihar (delhi) call me [🔝9953056974🔝] escort service 24X7call girls in Anand Vihar (delhi) call me [🔝9953056974🔝] escort service 24X7
call girls in Anand Vihar (delhi) call me [🔝9953056974🔝] escort service 24X7
 
20240509 QFM015 Engineering Leadership Reading List April 2024.pdf
20240509 QFM015 Engineering Leadership Reading List April 2024.pdf20240509 QFM015 Engineering Leadership Reading List April 2024.pdf
20240509 QFM015 Engineering Leadership Reading List April 2024.pdf
 
pdfcoffee.com_business-ethics-q3m7-pdf-free.pdf
pdfcoffee.com_business-ethics-q3m7-pdf-free.pdfpdfcoffee.com_business-ethics-q3m7-pdf-free.pdf
pdfcoffee.com_business-ethics-q3m7-pdf-free.pdf
 

II-SDV 2013 Text Mining at Work: Critical Assessment of the Completeness and Correctness of Knowledge-Based, Computable Disease Models for the Pharmaceutical Industry

  • 1. © Fraunhofer SCAI Text Mining at work: critical assessment of the completeness and correctness of knowledge-based, computable disease models for the pharmaceutical industry Prof. Martin Hofmann-Apitius Head of the Department of Bioinformatics Fraunhofer Institute for Algorithms and Scientific Computing (SCAI) II-SDV conference, Nice, April 16, 2013
  • 2. © Fraunhofer SCAI Where do I come from?  Fraunhofer Society   Founded 1949   Europe´s largest applied research organisation   60 Research Institutes (7 Institutes in the US)   17.000 Employees  Annual Budget about 1,5 Billion Euro   Financial model: 2/4 industry collaborations 1/4 public funding 1/4 institutional funding *Joseph von Fraunhofer (1787 – 1826 ) Scientist, Inventor and Entrepreneur
  • 3. © Fraunhofer SCAI The Fraunhofer Institute Center Schloss Birlinghoven   Largest research centre for informatics and applied mathematics in Germany   Around 700 employees, thereof 500 scientists, approx. 200 students and trainees
  • 4. © Fraunhofer SCAI What science are we doing? SCAI Department of Bioinformatics: R&D in a nutshell Fraunhofer SCAI Department of Bioinformatics R&D activities: 1.  Information extraction in the life sciences: I.  Text Mining - Recognition of named entities & relationships in text II.  Image Mining - Reconstruction of chemical information from chemical structure depictions 2.  Disease modelling (focus on neurodegenerative diseases) 3.  eScience, Grid-/Cloud- Computing and HPC (Cluster)
  • 5. Seite 5 My Dream: Direct Usage of Unstructured Information Sources for Disease Modelling From Text Mining Technology to Modelling of Neurodegenerative Diseases
  • 6. Seite 6 Why Modelling of Neurodegeneration? In 2009 the Federal Government of Germany decided to start a new research centre that focuses on translational research on neurodegenerative diseases. In fact, neurodegenerative diseases (Alzheimer, Parkinson, Multiple Sclerosis; Epilepsy; „rare“ NDDs) are a major societal challenge: The total costs of Alzheimer is estimated to exceed 20 trillion US$ in the US in the years between 2020 - 2050. (source: Alzheimer.org). Current costs / year in the US (according to Alzheimer.org): 183 billion US$ The incidence rate of Alzheimer and other dementias is almost 50% in the population older than 85 years. Next generation will regularly have a life span of >100 years.
  • 7. page 7 -29 % -13 % -11 % -20 % +66 % Changes in selected causes of death in USA , 2000-20101 1 www.alz.org Diseases specific mortality rate
  • 8. page 8 Non textual information – an example
  • 9. Seite 9 Modelling Alzheimer´s Disease: Tools -  An ontology capturing relevant knowledge on Alzheimer´s Disease (ADO; Malhotra et al., “Alzheimer´s & Dementia”, in press) -  An ontology representing brain regions and cell types (BRCO) -  An excellent machinery for biomedical text mining (ProMiner – UIMA enabled) with top performing gene and protein name recognition -  A biomarker terminology that identifies biomarker candidates in the scientific literature (Younesi et al., BMC Med. Inf. Dec. Making (2012)) -  A powerful formalism to capture knowledge and model it as a network of causal and correlative relationships: BEL (biological expression language)
  • 10. © Fraunhofer SCAI Capturing Knowledge for Disease Models: BEL
  • 11. Biological  Expression  Language  (BEL)   BEL  is  a  language  for  represen1ng  scien1fic  findings   (e.g.  what  you  would  read  in  a  journal  ar1cle)  in  a   computable  form   •  Captures  qualita1ve  causal  and  correla1ve   rela1onships  in  context   –  Biological  &  experimental  system  in  which  the   rela1onships  were  observed   –  Literature  cited   –  Cura1on  process   © 2012, Open BEL Community 11
  • 12. Advantages  of  BEL  as  a  Language   •  Standard  is  small  and  easy  to  learn   •  Easy  to  read  and  use   •  Computable   –  Forms  a  graph-­‐based  knowledge  base   •  Supports  both  causal  and  correla1ve  rela1onships  as  well  as   nega1ve  rela1onships   –  Suitable  for  recording  a  variety  of  experimental  and  clinical  findings   •  Can  be  used  with  almost  any  set  of  vocabularies  and   ontologies   –  Highly  adaptable  and  easy  to  adopt   •  Can  be  easily  extended  to  annotate  findings  with  use-­‐specific   contexts  such  as  experimental  and  clinical  parameters   © 2012, Open BEL Community 12
  • 13. BEL  Language  Structure   © 2012, Open BEL Community 13 “PMA  increases  the  kinase  ac1vity  of  p38  MAPKs”  
  • 14. BEL  Forms  Graphs   © 2012, Open BEL Community 14 subject   object/ subject   object   predicate   predicate   •  Subject-­‐predicate-­‐object  “triples”   •  Object  of  one  triple  can  be  subject  of  another   •  PuRng  them  together  makes  arbitrarily  large   knowledge  graphs   •  Reasoning  over  causal  rela1onships  becomes  a   graph  traversal  
  • 15. ©  2012,  Selventa.  All  Rights  Reserved.   Example  3   SET  Citation={"PubMed","Trends  Neurosci.  2008  Sep;31(9):454-­‐63.  Epub  2008  Jul   31","18675468"}   SET  Evidence  =  "In  healthy  neurons  the  axon  contains  relatively  high  amounts  of   microtubules  which  are  stabilized  by  the  protein  tau."   SET  Cell  =  "Neurons"   SET  CellStructure  =  "Axons"   •  Op1on  1  –  Use  associa1on  to  connect  Tau  and  microtubules   –  p(HGNC:MAPT)  -­‐-­‐  a(MESHCL:Microtubules)   •  Op1on  2  –  More  detailed  rela1onships,  provide  causal  flow  and  binding   informa1on   –  p(HGNC:MAPT)  =|  bp(GO:"microtubule  depolymerization")   –  bp(GO:"microtubule  depolymerization")  =|  a(MESHCL:Microtubules)   –  complex(p(HGNC:MAPT),  a(MESHCL:Microtubules))   15  
  • 16. ©  2012,  Selventa.  All  Rights  Reserved.   Example  3     •  Op1on  1  –  Use  associa1on  to  connect  Tau  and  microtubules   –  p(HGNC:MAPT)  -­‐-­‐  a(MESHCL:Microtubules)   •  Visualized  in  Cytoscape   with  Phase  III   •  Note  expansion  of   associa1on  to  include   reciprocal  rela1onship   –  a(MESHCL:Microtubules)      -­‐-­‐  p(HGNC:MAPT)   •  Note  gene  ac1va1on   pathway   –  g(EG:4137)  transcribedTo    r(EG: 4137)   –  r(EG:4137)  translatedTo    p(EG: 4137)   16  
  • 17. ©  2012,  Selventa.  All  Rights  Reserved.   Example  3   •  Visualized  in  Cytoscape  with   Phase  III   •  Note  expansion  of  complex   with  hasComponent   rela1onships   –  complex(p(HGNC:MAPT),     a(MESHCL:Microtubules))     hasComponent  a(MESHCL:Microtubules)   –  complex(p(HGNC:MAPT),     a(MESHCL:Microtubules))     hasComponent  p(HGNC:MAPT)   17   •  Op1on  2  –  More  detailed  rela1onships  provide  causal  flow  and  binding   informa1on   –  p(HGNC:MAPT)  =|  bp(GO:"microtubule  depolymerization")   –  bp(GO:"microtubule  depolymerization")  =|  a(MESHCL:Microtubules)   –  complex(p(HGNC:MAPT),  a(MESHCL:Microtubules))  
  • 18. © Fraunhofer SCAI An OpenBEL Model for APP Physiology -  Two models: -  Human APP “normal physiology“ -  Human APP “Alzheimer Disease Condition” -  Modelling principles: -  No mixing of rodent and human physiology -  Only causal and correlative relationships -  Issues: integration of genetics and proteolytic processing
  • 19. © Fraunhofer SCAI APP Model Statistics: -  Human APP “normal physiology“ -  8 modules representing defined pathway context -  965 BEL statements -  682 nodes and 1387 edges -  Human APP “Alzheimer Disease Condition” -  8 modules representing defined pathway context -  1035 BEL statements -  1301 nodes and 3116 edges
  • 20. Seite 20 Screenshot of the APP openBEL Model
  • 21. Seite 21 IMPROVER: An Industrial Initiative for the Verification of Systems Biology Models
  • 22. Seite 22 IMPROVER: An Industrial Initiative for the Assessment of the Quality and
  • 25. Seite 25 Automated Recognition and Extraction of Causal Statements
  • 26. Seite 26 How do we Assess the Completeness and Correctness of Systems Biology Models?
  • 27. Seite 27 Features for a Scoring Function   xxxxxxxxxxxxxxxxxxxxx   xxxxxxxxxxxxxxxxxxxxx   xxxxxxxxxxxxxxxxxxxxx   xxxxxxxxxxxxxxxxxxxxx
  • 28. © Fraunhofer SCAI The Scoring Function at Work Picture deleted ..... Sorry Results too recent to share them with a wider community We are willing and happy to share our results through a journal publication within the next year
  • 29. © Fraunhofer SCAI Take Home Message   Text Mining Technology allows for direct usage of extracted information for systems biology models / disease models   The Biological Expression Language BEL is an easy-to-learn formalism ideally suited for capturing knowledge and knowledge – based modeling of complex diseases   The industrial IMPROVER challenge addresses the issue of systems biology model verification, SCAI contributes a BEL extraction engine   Fraunhofer SCAI has developed a complex scoring function to assess the completeness and correctness of disease models