SlideShare ist ein Scribd-Unternehmen logo
1 von 44
Downloaden Sie, um offline zu lesen
Causality in Complex
Networks
Sebastian Benthall
D-Lab
Why causality?
Causal relations are scientifically interesting
because when exposed, they are:
● a reliable mechanism
● that supports intervention
By understanding causality, we can predict and
control. This is the interest behind causal
knowledge.
Why this talk?
● A “working group” talk - I don’t claim to be an
expert
● I’m working through research problems that
are challenging to me
● I’m presenting this work in progress both to
inform and solicit feedback
● You are welcome to do the same with your
work!
Potential outcomes
The Rubin Causal Model (RCM) or potential
outcomes framework is ascendant.
Potential outcomes
“The causal effect of a treatment on a single
individual or unit of observation is the
comparison (e.g., difference) between the
value of the outcome if the unit is treated
and the value of the outcome if the unit is not
treated.” (Angrist, Imbens, and Rubin, 1996)
Potential outcomes
“The causal effect of a treatment on a single
individual or unit of observation is the
comparison (e.g., difference) between the
value of the outcome if the unit is treated
and the value of the outcome if the unit is not
treated.” (Angrist, Imbens, and Rubin, 1996)
Potential outcomes
Average effect: (10+9+7+12)/4 = 9.5
Controlled Outcome - Yi
(0)
Treated Outcome - Yi
(1)
Causal Effect of
Treatment Yi
(1) - Y(0)
Alice 20 30 10
Bob 15 24 9
Cathy 10 17 7
David 22 34 12
Potential outcomes
You only ever see some of these. This has been called the
Fundamental Problem of Causal Inference
Controlled Outcome - Yi
(0)
Treated Outcome - Yi
(1)
Causal Effect of
Treatment Yi
(1) - Y(0)
Alice 20 30 10
Bob 15 24 9
Cathy 10 17 7
David 22 34 12
Potential outcomes
Stable Unit Treatment Value Assumption
"the [potential outcome] observation on one
unit should be unaffected by the particular
assignment of treatments to the other units"
Potential outcomes
Controlled Outcome - Yi
(0) Treated Outcome - Yi
(1) Causal Effect of Treatment
Yi
(1) - Y(0)
Alice 20 30 10
Bob, if
Alice in
not
treated
15 24 9
Bob, if
Alice is
treated
18 29 11
Cathy 10 17 7
David 22 34 12
Potential outcomes
So for every unit, we have to map out all the
variables that can have an effect on the
potential outcomes.
Spouse treated
Unit treated
Outcome
Potential outcomes
So for every unit, we have to map out all the
variables that can have an effect on the
potential outcomes.
A great tool for this: Pearl’s causal networks.
Causal networks
Pearl, Causality, http://bayes.cs.ucla.edu/BOOK-2K/
Note
There are differences between Pearl and
Rubin’s frameworks but their core concepts are
compatible,
so says Andrew Gelman, 2009:
http://andrewgelman.com/2009/07/07/more_on_pearls/
Causal networks
N.B.
An interesting thing about causal networks is
that the conditional probability distributions can
be arbitrarily complex.
Also, variables need not just be whole numbers
or scalars. They could be a matrix.
Complex networks
Now I’m going to talk about networks that are
not causal networks.
Sometimes in the literature these are called
complex networks.
from http://www.spandidos-publications.com/ijo/43/6/1737
from http:
//noduslabs.
com/radar/type
s-networks-
random-small-
world-scale-
free/
Complex networks
There are lots of different kinds of networks
observed in nature and society.
They can differ substantially in their emergent
properties.
Complex networks
def: emergent property
“An emergent property is a property which a collection or
complex system has, but which the individual members do
not have. A failure to realize that a property is emergent,
or supervenient, leads to the fallacy of division.”
Degree Distribution
from http://www.alexeikurakin.
org/main/lecture4Ext.html
Assortativity
from
http://iopscience.iop.org/1742-
5468/2008/03/P03008/figures
How to make a graph
Different processes for generating graphs have
result in graphs with different properties.
How to make a graph
● Erdős–Rényi (ER) model: G(n,p): Create n
nodes and create edges with probability p
● Barabási–Albert (BA) model:
○ Begin with a fully connected network of m0
nodes
○ Each new node is connected to m (< m0
) node
probability proportional to degree ki
of each node i
How to predict a graph
The distribution of degree of an Erdős–Rényi
graph is binomial.
The distribution of degree of a Barabási–
Albert (BA) graph is scale-free/power-law.
Bayes Theorem
Recall Bayes Theorem:
P(H|D) ∝ P(D|H) P(H)
Bayes Theorem
Recall Bayes Theorem:
P(H|D) ∝ P(D|H) P(H)
If we can show a difference in the
likelihood
of data under different hypotheses, we can
learn something
What process created this graph?
What process created this graph?
Histogram of observed
node degrees d
What process created this graph?
Can in principle compare P(d|ER) and P(d|BA).
What process created this graph?
● We can in principle statistically distinguish
hypotheses about generative processes
based on emergent properties.
● Is this a causal inference?
Ways to model this
Process Graph
Ways to model this
All the logic of graph generation is buried in the
conditional probability function P(B|A).
A
Process
B
Graph
Ways to model this
All the logic of graph generation is buried in the
conditional probability function P(B|A).
“Logical causation” allows no intervention!
A
Process
B
Graph
Ways to model this
The Barabási–Albert (BA) model suggests this
interpretation of graph changing over time.
You can model time series data like this.
B0
B1
B2
B3
B4
Ways to model this
Now we can model a stable transition function
within the graph and external causes.
B0
B1
B2
B3
B4
C
Ways to model this
In other words,
endogenous process + exogenous shocks
B0
B1
B2
B3
B4
C
Tools in the toolbox
If we want to understand the effect of a kind of
exogenous shock,
and we know the endogenous process,
then we can look for natural experiments that
expose the treated outcome.
Tools in the toolbox
To know the endogenous process, then
compute the likelihood of emergent properties.
B0
B1
B2
B3
B4
EEE E E
Problems
● The vastness of the hypothesis space of
graph generation processes
● Related: how do you choose a prior?
Problems
● Computing the likelihood of a graph’s
emergent properties given a particular
generation process is
○ tricky math
○ maybe computationally hard
Dissatisfactions
● We have continued to bury much of the
mechanism of interest in the conditional
probability function.
● Suppose we want to cash this out as a finer-
grained mechanism that supports finer
interventions
● Can we think at multiple levels of abstraction
at once?
Thanks! Contact me at: sb at ischool dot berkeley dot edu

Weitere ähnliche Inhalte

Was ist angesagt?

Module 6: Ensemble Algorithms
Module 6:  Ensemble AlgorithmsModule 6:  Ensemble Algorithms
Module 6: Ensemble AlgorithmsSara Hooker
 
Regression, Multiple regression in statistics
Regression, Multiple regression in statistics Regression, Multiple regression in statistics
Regression, Multiple regression in statistics Rashna Asif
 
Module 1.2 data preparation
Module 1.2  data preparationModule 1.2  data preparation
Module 1.2 data preparationSara Hooker
 
Alleviating Privacy Attacks Using Causal Models
Alleviating Privacy Attacks Using Causal ModelsAlleviating Privacy Attacks Using Causal Models
Alleviating Privacy Attacks Using Causal ModelsAmit Sharma
 
Module 4: Model Selection and Evaluation
Module 4: Model Selection and EvaluationModule 4: Model Selection and Evaluation
Module 4: Model Selection and EvaluationSara Hooker
 
Module 5: Decision Trees
Module 5: Decision TreesModule 5: Decision Trees
Module 5: Decision TreesSara Hooker
 
Module 2: Machine Learning Deep Dive
Module 2:  Machine Learning Deep DiveModule 2:  Machine Learning Deep Dive
Module 2: Machine Learning Deep DiveSara Hooker
 
Item Analysis: Classical and Beyond
Item Analysis: Classical and BeyondItem Analysis: Classical and Beyond
Item Analysis: Classical and BeyondMhairi Mcalpine
 
Multiple Linear Regression
Multiple Linear RegressionMultiple Linear Regression
Multiple Linear RegressionIndus University
 
Module 7: Unsupervised Learning
Module 7:  Unsupervised LearningModule 7:  Unsupervised Learning
Module 7: Unsupervised LearningSara Hooker
 
To combine forecasts or to combine forecast models?
To combine forecasts or to combine forecast models?To combine forecasts or to combine forecast models?
To combine forecasts or to combine forecast models?Devon K. Barrow
 
Building classification model, tree model, confusion matrix and prediction ac...
Building classification model, tree model, confusion matrix and prediction ac...Building classification model, tree model, confusion matrix and prediction ac...
Building classification model, tree model, confusion matrix and prediction ac...National Cheng Kung University
 
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!Sri Ambati
 
Endogeneity and Entrepreneurship Research
Endogeneity and Entrepreneurship ResearchEndogeneity and Entrepreneurship Research
Endogeneity and Entrepreneurship ResearchBrian Anderson
 
Introduction to Item Response Theory
Introduction to Item Response TheoryIntroduction to Item Response Theory
Introduction to Item Response TheoryOpenThink Labs
 
The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1Carlo Magno
 
Missing Data and data imputation techniques
Missing Data and data imputation techniquesMissing Data and data imputation techniques
Missing Data and data imputation techniquesOmar F. Althuwaynee
 

Was ist angesagt? (20)

Module 6: Ensemble Algorithms
Module 6:  Ensemble AlgorithmsModule 6:  Ensemble Algorithms
Module 6: Ensemble Algorithms
 
Regression, Multiple regression in statistics
Regression, Multiple regression in statistics Regression, Multiple regression in statistics
Regression, Multiple regression in statistics
 
Module 1.2 data preparation
Module 1.2  data preparationModule 1.2  data preparation
Module 1.2 data preparation
 
Alleviating Privacy Attacks Using Causal Models
Alleviating Privacy Attacks Using Causal ModelsAlleviating Privacy Attacks Using Causal Models
Alleviating Privacy Attacks Using Causal Models
 
Module 4: Model Selection and Evaluation
Module 4: Model Selection and EvaluationModule 4: Model Selection and Evaluation
Module 4: Model Selection and Evaluation
 
Module 5: Decision Trees
Module 5: Decision TreesModule 5: Decision Trees
Module 5: Decision Trees
 
Module 2: Machine Learning Deep Dive
Module 2:  Machine Learning Deep DiveModule 2:  Machine Learning Deep Dive
Module 2: Machine Learning Deep Dive
 
Chapter 4R Part II
Chapter 4R Part IIChapter 4R Part II
Chapter 4R Part II
 
Matrix Diagram2001
Matrix Diagram2001Matrix Diagram2001
Matrix Diagram2001
 
Item Analysis: Classical and Beyond
Item Analysis: Classical and BeyondItem Analysis: Classical and Beyond
Item Analysis: Classical and Beyond
 
Multiple Linear Regression
Multiple Linear RegressionMultiple Linear Regression
Multiple Linear Regression
 
Module 7: Unsupervised Learning
Module 7:  Unsupervised LearningModule 7:  Unsupervised Learning
Module 7: Unsupervised Learning
 
To combine forecasts or to combine forecast models?
To combine forecasts or to combine forecast models?To combine forecasts or to combine forecast models?
To combine forecasts or to combine forecast models?
 
Building classification model, tree model, confusion matrix and prediction ac...
Building classification model, tree model, confusion matrix and prediction ac...Building classification model, tree model, confusion matrix and prediction ac...
Building classification model, tree model, confusion matrix and prediction ac...
 
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
 
Endogeneity and Entrepreneurship Research
Endogeneity and Entrepreneurship ResearchEndogeneity and Entrepreneurship Research
Endogeneity and Entrepreneurship Research
 
Introduction to Item Response Theory
Introduction to Item Response TheoryIntroduction to Item Response Theory
Introduction to Item Response Theory
 
The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1
 
Missing Data and data imputation techniques
Missing Data and data imputation techniquesMissing Data and data imputation techniques
Missing Data and data imputation techniques
 
Irt assessment
Irt assessmentIrt assessment
Irt assessment
 

Andere mochten auch

The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...
The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...
The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...Catarina Moreira
 
10-Interpretation& Causality by Mehdi Ehtesham
10-Interpretation& Causality  by Mehdi Ehtesham10-Interpretation& Causality  by Mehdi Ehtesham
10-Interpretation& Causality by Mehdi EhteshamResearchGuru
 
Virtual World Data Visualization
Virtual World Data VisualizationVirtual World Data Visualization
Virtual World Data VisualizationMelanie Swan
 
DIYgenomics: An Open Platform for Democratizing the Genome
DIYgenomics: An Open Platform for Democratizing the GenomeDIYgenomics: An Open Platform for Democratizing the Genome
DIYgenomics: An Open Platform for Democratizing the GenomeMelanie Swan
 
Prediction Markets - Singularity University 2013
Prediction Markets - Singularity University 2013Prediction Markets - Singularity University 2013
Prediction Markets - Singularity University 2013Melanie Swan
 
Ibc cell therapy clinical development conference (arlington va september 10 ...
Ibc cell therapy clinical development conference (arlington va  september 10 ...Ibc cell therapy clinical development conference (arlington va  september 10 ...
Ibc cell therapy clinical development conference (arlington va september 10 ...Proteus Venture Partners
 
Introduction to Supervised ML Concepts and Algorithms
Introduction to Supervised ML Concepts and AlgorithmsIntroduction to Supervised ML Concepts and Algorithms
Introduction to Supervised ML Concepts and AlgorithmsNBER
 
Personal Genomes: what can I do with my data?
Personal Genomes: what can I do with my data?Personal Genomes: what can I do with my data?
Personal Genomes: what can I do with my data?Melanie Swan
 
Dublin2016 balancing
Dublin2016 balancingDublin2016 balancing
Dublin2016 balancingHelen Barrett
 
Anterior temporal lobectomy
Anterior temporal lobectomyAnterior temporal lobectomy
Anterior temporal lobectomyApoorv Pandey
 
The Poetic Prosthetic
The Poetic Prosthetic The Poetic Prosthetic
The Poetic Prosthetic Melanie Swan
 
Blockchain Smartnetworks
Blockchain Smartnetworks Blockchain Smartnetworks
Blockchain Smartnetworks Melanie Swan
 
Facial nerve by Dr. Apoorv
Facial nerve by Dr. ApoorvFacial nerve by Dr. Apoorv
Facial nerve by Dr. ApoorvApoorv Pandey
 
Philosophy of Technology
Philosophy of TechnologyPhilosophy of Technology
Philosophy of TechnologyMelanie Swan
 
Managing Agility: From Complex To Simple
Managing Agility: From Complex To SimpleManaging Agility: From Complex To Simple
Managing Agility: From Complex To SimpleJurgen Appelo
 

Andere mochten auch (20)

Causal Bayesian Networks
Causal Bayesian NetworksCausal Bayesian Networks
Causal Bayesian Networks
 
The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...
The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...
The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...
 
10-Interpretation& Causality by Mehdi Ehtesham
10-Interpretation& Causality  by Mehdi Ehtesham10-Interpretation& Causality  by Mehdi Ehtesham
10-Interpretation& Causality by Mehdi Ehtesham
 
Complexity Informed Psychotherapy
Complexity Informed PsychotherapyComplexity Informed Psychotherapy
Complexity Informed Psychotherapy
 
Virtual World Data Visualization
Virtual World Data VisualizationVirtual World Data Visualization
Virtual World Data Visualization
 
DIYgenomics: An Open Platform for Democratizing the Genome
DIYgenomics: An Open Platform for Democratizing the GenomeDIYgenomics: An Open Platform for Democratizing the Genome
DIYgenomics: An Open Platform for Democratizing the Genome
 
Prediction Markets - Singularity University 2013
Prediction Markets - Singularity University 2013Prediction Markets - Singularity University 2013
Prediction Markets - Singularity University 2013
 
Ibc cell therapy clinical development conference (arlington va september 10 ...
Ibc cell therapy clinical development conference (arlington va  september 10 ...Ibc cell therapy clinical development conference (arlington va  september 10 ...
Ibc cell therapy clinical development conference (arlington va september 10 ...
 
Virtual worlds
Virtual worlds Virtual worlds
Virtual worlds
 
Introduction to Supervised ML Concepts and Algorithms
Introduction to Supervised ML Concepts and AlgorithmsIntroduction to Supervised ML Concepts and Algorithms
Introduction to Supervised ML Concepts and Algorithms
 
Temporal bone1
Temporal bone1Temporal bone1
Temporal bone1
 
Personal Genomes: what can I do with my data?
Personal Genomes: what can I do with my data?Personal Genomes: what can I do with my data?
Personal Genomes: what can I do with my data?
 
Dublin2016 balancing
Dublin2016 balancingDublin2016 balancing
Dublin2016 balancing
 
Anterior temporal lobectomy
Anterior temporal lobectomyAnterior temporal lobectomy
Anterior temporal lobectomy
 
The Poetic Prosthetic
The Poetic Prosthetic The Poetic Prosthetic
The Poetic Prosthetic
 
Blockchain Smartnetworks
Blockchain Smartnetworks Blockchain Smartnetworks
Blockchain Smartnetworks
 
Facial nerve by Dr. Apoorv
Facial nerve by Dr. ApoorvFacial nerve by Dr. Apoorv
Facial nerve by Dr. Apoorv
 
Philosophy of Technology
Philosophy of TechnologyPhilosophy of Technology
Philosophy of Technology
 
Hippocampus
HippocampusHippocampus
Hippocampus
 
Managing Agility: From Complex To Simple
Managing Agility: From Complex To SimpleManaging Agility: From Complex To Simple
Managing Agility: From Complex To Simple
 

Ähnlich wie Causality in complex networks

Representing and generating uncertainty effectively presentatıon
Representing and generating uncertainty effectively presentatıonRepresenting and generating uncertainty effectively presentatıon
Representing and generating uncertainty effectively presentatıonAzdeen Najah
 
Neural Nets Deconstructed
Neural Nets DeconstructedNeural Nets Deconstructed
Neural Nets DeconstructedPaul Sterk
 
Joint contrastive learning with infinite possibilities
Joint contrastive learning with infinite possibilitiesJoint contrastive learning with infinite possibilities
Joint contrastive learning with infinite possibilitiestaeseon ryu
 
Recommendation systems in the scope of opinion formation: a model
Recommendation systems in the scope of opinion formation: a modelRecommendation systems in the scope of opinion formation: a model
Recommendation systems in the scope of opinion formation: a modelMarcel Blattner, PhD
 
For this assignment, use the aschooltest.sav dataset.The d
For this assignment, use the aschooltest.sav dataset.The dFor this assignment, use the aschooltest.sav dataset.The d
For this assignment, use the aschooltest.sav dataset.The dMerrileeDelvalle969
 
Deep VI with_beta_likelihood
Deep VI with_beta_likelihoodDeep VI with_beta_likelihood
Deep VI with_beta_likelihoodNatan Katz
 
causality_discussion_slides_final.pdf
causality_discussion_slides_final.pdfcausality_discussion_slides_final.pdf
causality_discussion_slides_final.pdfssuser8cde591
 
Building useful models for imbalanced datasets (without resampling)
Building useful models for imbalanced datasets (without resampling)Building useful models for imbalanced datasets (without resampling)
Building useful models for imbalanced datasets (without resampling)Greg Landrum
 
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...7 QC quality control (7 QC) tools for continuous improvement of manufacturing...
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...Chandan Sah
 
SPSS statistics - get help using SPSS
SPSS statistics - get help using SPSSSPSS statistics - get help using SPSS
SPSS statistics - get help using SPSScsula its training
 
Mixed Effects Models - Random Intercepts
Mixed Effects Models - Random InterceptsMixed Effects Models - Random Intercepts
Mixed Effects Models - Random InterceptsScott Fraundorf
 
Data Distribution &The Probability Distributions
Data Distribution &The Probability DistributionsData Distribution &The Probability Distributions
Data Distribution &The Probability Distributionsmahaaltememe
 
A Causal Framework for Meta-Analysis, drafty
A Causal Framework for Meta-Analysis, drafty A Causal Framework for Meta-Analysis, drafty
A Causal Framework for Meta-Analysis, drafty Wei Wang
 

Ähnlich wie Causality in complex networks (20)

Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...
Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...
Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...
 
Representing and generating uncertainty effectively presentatıon
Representing and generating uncertainty effectively presentatıonRepresenting and generating uncertainty effectively presentatıon
Representing and generating uncertainty effectively presentatıon
 
Neural Nets Deconstructed
Neural Nets DeconstructedNeural Nets Deconstructed
Neural Nets Deconstructed
 
Joint contrastive learning with infinite possibilities
Joint contrastive learning with infinite possibilitiesJoint contrastive learning with infinite possibilities
Joint contrastive learning with infinite possibilities
 
Recommendation systems in the scope of opinion formation: a model
Recommendation systems in the scope of opinion formation: a modelRecommendation systems in the scope of opinion formation: a model
Recommendation systems in the scope of opinion formation: a model
 
Class9_PCA_final.ppt
Class9_PCA_final.pptClass9_PCA_final.ppt
Class9_PCA_final.ppt
 
Lecture 1.pdf
Lecture 1.pdfLecture 1.pdf
Lecture 1.pdf
 
B. Liseo, Metodi inferenziali per dati integrati
B. Liseo, Metodi inferenziali per dati integratiB. Liseo, Metodi inferenziali per dati integrati
B. Liseo, Metodi inferenziali per dati integrati
 
For this assignment, use the aschooltest.sav dataset.The d
For this assignment, use the aschooltest.sav dataset.The dFor this assignment, use the aschooltest.sav dataset.The d
For this assignment, use the aschooltest.sav dataset.The d
 
XAI (IIT-Patna).pdf
XAI (IIT-Patna).pdfXAI (IIT-Patna).pdf
XAI (IIT-Patna).pdf
 
Bivariate Regression
Bivariate RegressionBivariate Regression
Bivariate Regression
 
Deep VI with_beta_likelihood
Deep VI with_beta_likelihoodDeep VI with_beta_likelihood
Deep VI with_beta_likelihood
 
causality_discussion_slides_final.pdf
causality_discussion_slides_final.pdfcausality_discussion_slides_final.pdf
causality_discussion_slides_final.pdf
 
Building useful models for imbalanced datasets (without resampling)
Building useful models for imbalanced datasets (without resampling)Building useful models for imbalanced datasets (without resampling)
Building useful models for imbalanced datasets (without resampling)
 
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...7 QC quality control (7 QC) tools for continuous improvement of manufacturing...
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...
 
SPSS statistics - get help using SPSS
SPSS statistics - get help using SPSSSPSS statistics - get help using SPSS
SPSS statistics - get help using SPSS
 
Mixed Effects Models - Random Intercepts
Mixed Effects Models - Random InterceptsMixed Effects Models - Random Intercepts
Mixed Effects Models - Random Intercepts
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
 
Data Distribution &The Probability Distributions
Data Distribution &The Probability DistributionsData Distribution &The Probability Distributions
Data Distribution &The Probability Distributions
 
A Causal Framework for Meta-Analysis, drafty
A Causal Framework for Meta-Analysis, drafty A Causal Framework for Meta-Analysis, drafty
A Causal Framework for Meta-Analysis, drafty
 

Mehr von Sebastian Benthall

Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...Sebastian Benthall
 
Designing digital publics for participatory parity
Designing digital publics for participatory parityDesigning digital publics for participatory parity
Designing digital publics for participatory paritySebastian Benthall
 
Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...Sebastian Benthall
 
GeoNode Motivation, Design, and Challenges
GeoNode Motivation, Design, and ChallengesGeoNode Motivation, Design, and Challenges
GeoNode Motivation, Design, and ChallengesSebastian Benthall
 
On Dretske's The Epistemology of Belief
On Dretske's The Epistemology of BeliefOn Dretske's The Epistemology of Belief
On Dretske's The Epistemology of BeliefSebastian Benthall
 
The Everything at Once Manifesto
The Everything at Once ManifestoThe Everything at Once Manifesto
The Everything at Once ManifestoSebastian Benthall
 
Spatial Data Infrastructure Best Practices with GeoNode
Spatial Data Infrastructure Best Practices with GeoNodeSpatial Data Infrastructure Best Practices with GeoNode
Spatial Data Infrastructure Best Practices with GeoNodeSebastian Benthall
 

Mehr von Sebastian Benthall (8)

Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...
 
Designing digital publics for participatory parity
Designing digital publics for participatory parityDesigning digital publics for participatory parity
Designing digital publics for participatory parity
 
Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...
 
GeoNode Motivation, Design, and Challenges
GeoNode Motivation, Design, and ChallengesGeoNode Motivation, Design, and Challenges
GeoNode Motivation, Design, and Challenges
 
On Dretske's The Epistemology of Belief
On Dretske's The Epistemology of BeliefOn Dretske's The Epistemology of Belief
On Dretske's The Epistemology of Belief
 
The Everything at Once Manifesto
The Everything at Once ManifestoThe Everything at Once Manifesto
The Everything at Once Manifesto
 
Geonode
GeonodeGeonode
Geonode
 
Spatial Data Infrastructure Best Practices with GeoNode
Spatial Data Infrastructure Best Practices with GeoNodeSpatial Data Infrastructure Best Practices with GeoNode
Spatial Data Infrastructure Best Practices with GeoNode
 

Kürzlich hochgeladen

Conjugation, transduction and transformation
Conjugation, transduction and transformationConjugation, transduction and transformation
Conjugation, transduction and transformationAreesha Ahmad
 
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate ProfessorThyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate Professormuralinath2
 
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit flypumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit flyPRADYUMMAURYA1
 
Forensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfForensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfrohankumarsinghrore1
 
GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)Areesha Ahmad
 
300003-World Science Day For Peace And Development.pptx
300003-World Science Day For Peace And Development.pptx300003-World Science Day For Peace And Development.pptx
300003-World Science Day For Peace And Development.pptxryanrooker
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsSérgio Sacani
 
Sector 62, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 62, Noida Call girls :8448380779 Model Escorts | 100% verifiedSector 62, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 62, Noida Call girls :8448380779 Model Escorts | 100% verifiedDelhi Call girls
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)Areesha Ahmad
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learninglevieagacer
 
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Monika Rani
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...chandars293
 
Digital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptxDigital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptxMohamedFarag457087
 
COST ESTIMATION FOR A RESEARCH PROJECT.pptx
COST ESTIMATION FOR A RESEARCH PROJECT.pptxCOST ESTIMATION FOR A RESEARCH PROJECT.pptx
COST ESTIMATION FOR A RESEARCH PROJECT.pptxFarihaAbdulRasheed
 
SAMASTIPUR CALL GIRL 7857803690 LOW PRICE ESCORT SERVICE
SAMASTIPUR CALL GIRL 7857803690  LOW PRICE  ESCORT SERVICESAMASTIPUR CALL GIRL 7857803690  LOW PRICE  ESCORT SERVICE
SAMASTIPUR CALL GIRL 7857803690 LOW PRICE ESCORT SERVICEayushi9330
 
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptxPSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptxSuji236384
 
Grade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsGrade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsOrtegaSyrineMay
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPirithiRaju
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.Nitya salvi
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)Areesha Ahmad
 

Kürzlich hochgeladen (20)

Conjugation, transduction and transformation
Conjugation, transduction and transformationConjugation, transduction and transformation
Conjugation, transduction and transformation
 
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate ProfessorThyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
 
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit flypumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
 
Forensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfForensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdf
 
GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)
 
300003-World Science Day For Peace And Development.pptx
300003-World Science Day For Peace And Development.pptx300003-World Science Day For Peace And Development.pptx
300003-World Science Day For Peace And Development.pptx
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
Sector 62, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 62, Noida Call girls :8448380779 Model Escorts | 100% verifiedSector 62, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 62, Noida Call girls :8448380779 Model Escorts | 100% verified
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learning
 
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
 
Digital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptxDigital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptx
 
COST ESTIMATION FOR A RESEARCH PROJECT.pptx
COST ESTIMATION FOR A RESEARCH PROJECT.pptxCOST ESTIMATION FOR A RESEARCH PROJECT.pptx
COST ESTIMATION FOR A RESEARCH PROJECT.pptx
 
SAMASTIPUR CALL GIRL 7857803690 LOW PRICE ESCORT SERVICE
SAMASTIPUR CALL GIRL 7857803690  LOW PRICE  ESCORT SERVICESAMASTIPUR CALL GIRL 7857803690  LOW PRICE  ESCORT SERVICE
SAMASTIPUR CALL GIRL 7857803690 LOW PRICE ESCORT SERVICE
 
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptxPSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
 
Grade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsGrade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its Functions
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 

Causality in complex networks

  • 2. Why causality? Causal relations are scientifically interesting because when exposed, they are: ● a reliable mechanism ● that supports intervention By understanding causality, we can predict and control. This is the interest behind causal knowledge.
  • 3. Why this talk? ● A “working group” talk - I don’t claim to be an expert ● I’m working through research problems that are challenging to me ● I’m presenting this work in progress both to inform and solicit feedback ● You are welcome to do the same with your work!
  • 4. Potential outcomes The Rubin Causal Model (RCM) or potential outcomes framework is ascendant.
  • 5. Potential outcomes “The causal effect of a treatment on a single individual or unit of observation is the comparison (e.g., difference) between the value of the outcome if the unit is treated and the value of the outcome if the unit is not treated.” (Angrist, Imbens, and Rubin, 1996)
  • 6. Potential outcomes “The causal effect of a treatment on a single individual or unit of observation is the comparison (e.g., difference) between the value of the outcome if the unit is treated and the value of the outcome if the unit is not treated.” (Angrist, Imbens, and Rubin, 1996)
  • 7. Potential outcomes Average effect: (10+9+7+12)/4 = 9.5 Controlled Outcome - Yi (0) Treated Outcome - Yi (1) Causal Effect of Treatment Yi (1) - Y(0) Alice 20 30 10 Bob 15 24 9 Cathy 10 17 7 David 22 34 12
  • 8. Potential outcomes You only ever see some of these. This has been called the Fundamental Problem of Causal Inference Controlled Outcome - Yi (0) Treated Outcome - Yi (1) Causal Effect of Treatment Yi (1) - Y(0) Alice 20 30 10 Bob 15 24 9 Cathy 10 17 7 David 22 34 12
  • 9. Potential outcomes Stable Unit Treatment Value Assumption "the [potential outcome] observation on one unit should be unaffected by the particular assignment of treatments to the other units"
  • 10. Potential outcomes Controlled Outcome - Yi (0) Treated Outcome - Yi (1) Causal Effect of Treatment Yi (1) - Y(0) Alice 20 30 10 Bob, if Alice in not treated 15 24 9 Bob, if Alice is treated 18 29 11 Cathy 10 17 7 David 22 34 12
  • 11. Potential outcomes So for every unit, we have to map out all the variables that can have an effect on the potential outcomes. Spouse treated Unit treated Outcome
  • 12. Potential outcomes So for every unit, we have to map out all the variables that can have an effect on the potential outcomes. A great tool for this: Pearl’s causal networks.
  • 13. Causal networks Pearl, Causality, http://bayes.cs.ucla.edu/BOOK-2K/
  • 14. Note There are differences between Pearl and Rubin’s frameworks but their core concepts are compatible, so says Andrew Gelman, 2009: http://andrewgelman.com/2009/07/07/more_on_pearls/
  • 15. Causal networks N.B. An interesting thing about causal networks is that the conditional probability distributions can be arbitrarily complex. Also, variables need not just be whole numbers or scalars. They could be a matrix.
  • 16. Complex networks Now I’m going to talk about networks that are not causal networks. Sometimes in the literature these are called complex networks.
  • 17.
  • 20. Complex networks There are lots of different kinds of networks observed in nature and society. They can differ substantially in their emergent properties.
  • 21. Complex networks def: emergent property “An emergent property is a property which a collection or complex system has, but which the individual members do not have. A failure to realize that a property is emergent, or supervenient, leads to the fallacy of division.”
  • 24. How to make a graph Different processes for generating graphs have result in graphs with different properties.
  • 25. How to make a graph ● Erdős–Rényi (ER) model: G(n,p): Create n nodes and create edges with probability p ● Barabási–Albert (BA) model: ○ Begin with a fully connected network of m0 nodes ○ Each new node is connected to m (< m0 ) node probability proportional to degree ki of each node i
  • 26. How to predict a graph The distribution of degree of an Erdős–Rényi graph is binomial. The distribution of degree of a Barabási– Albert (BA) graph is scale-free/power-law.
  • 27. Bayes Theorem Recall Bayes Theorem: P(H|D) ∝ P(D|H) P(H)
  • 28. Bayes Theorem Recall Bayes Theorem: P(H|D) ∝ P(D|H) P(H) If we can show a difference in the likelihood of data under different hypotheses, we can learn something
  • 29. What process created this graph?
  • 30. What process created this graph? Histogram of observed node degrees d
  • 31. What process created this graph? Can in principle compare P(d|ER) and P(d|BA).
  • 32. What process created this graph? ● We can in principle statistically distinguish hypotheses about generative processes based on emergent properties. ● Is this a causal inference?
  • 33. Ways to model this Process Graph
  • 34. Ways to model this All the logic of graph generation is buried in the conditional probability function P(B|A). A Process B Graph
  • 35. Ways to model this All the logic of graph generation is buried in the conditional probability function P(B|A). “Logical causation” allows no intervention! A Process B Graph
  • 36. Ways to model this The Barabási–Albert (BA) model suggests this interpretation of graph changing over time. You can model time series data like this. B0 B1 B2 B3 B4
  • 37. Ways to model this Now we can model a stable transition function within the graph and external causes. B0 B1 B2 B3 B4 C
  • 38. Ways to model this In other words, endogenous process + exogenous shocks B0 B1 B2 B3 B4 C
  • 39. Tools in the toolbox If we want to understand the effect of a kind of exogenous shock, and we know the endogenous process, then we can look for natural experiments that expose the treated outcome.
  • 40. Tools in the toolbox To know the endogenous process, then compute the likelihood of emergent properties. B0 B1 B2 B3 B4 EEE E E
  • 41. Problems ● The vastness of the hypothesis space of graph generation processes ● Related: how do you choose a prior?
  • 42. Problems ● Computing the likelihood of a graph’s emergent properties given a particular generation process is ○ tricky math ○ maybe computationally hard
  • 43. Dissatisfactions ● We have continued to bury much of the mechanism of interest in the conditional probability function. ● Suppose we want to cash this out as a finer- grained mechanism that supports finer interventions ● Can we think at multiple levels of abstraction at once?
  • 44. Thanks! Contact me at: sb at ischool dot berkeley dot edu