SlideShare ist ein Scribd-Unternehmen logo
1 von 147
Anonymizing Health Data
Webcast
Case Studies and Methods to Get You S
Khaled El Emam & Luk
Anonymizing Health Data
Part 1 of Webcast: Intro and Methodology
Part 2 of Webcast: A Look at Our Case Studies
Part 3 of Webcast: Questions and Answers
Khaled El Emam & Luk
Anonymizing Health Data
Part 1 of Webcast: Intro and Methodology
Khaled El Emam & Luk
Anonymizing Health Data
To Anonymize or not to Anonymize
Khaled El Emam & Luk
Anonymizing Health Data
Consent needs to be informed.
To Anonymize or not to Anonymize
Khaled El Emam & Luk
Anonymizing Health Data
Consent needs to be informed.
Not all health care providers are willing to
share their patient’s PHI.
To Anonymize or not to Anonymize
Khaled El Emam & Luk
Anonymizing Health Data
Consent needs to be informed.
Not all health care providers are willing to
share their patient’s PHI.
Anonymization allows for the sharing of health information.
To Anonymize or not to Anonymize
Khaled El Emam & Luk
Anonymizing Health Data
Consent needs to be informed.
Not all health care providers are willing to
share their patient’s PHI.
Anonymization allows for the sharing of health information.
To Anonymize or not to Anonymize
Compelling financial case. Breach cost ~$200 per patient.
Khaled El Emam & Luk
Anonymizing Health Data
Consent needs to be informed.
Not all health care providers are willing to
share their patient’s PHI.
Anonymization allows for the sharing of health information.
To Anonymize or not to Anonymize
Compelling financial case. Breach cost ~$200 per patient.
Khaled El Emam & Luk
Anonymizing Health Data
Consent needs to be informed.
Not all health care providers are willing to
share their patient’s PHI.
Anonymization allows for the sharing of health information.
To Anonymize or not to Anonymize
Privacy protective behaviors by patients.
Compelling financial case. Breach cost ~$200 per patient.
Khaled El Emam & Luk
Anonymizing Health Data
Masking Standards
Khaled El Emam & Luk
Anonymizing Health Data
Masking Standards
First name, last name, SSN.
Khaled El Emam & Luk
Anonymizing Health Data
Masking Standards
Distortion of data—no analytics.
First name, last name, SSN.
Khaled El Emam & Luk
Anonymizing Health Data
Masking Standards
Creating pseudonyms.
First name, last name, SSN.
Distortion of data—no analytics.
Khaled El Emam & Luk
Anonymizing Health Data
Masking Standards
Removing a whole field.
Creating pseudonyms.
First name, last name, SSN.
Distortion of data—no analytics.
Khaled El Emam & Luk
Anonymizing Health Data
Masking Standards
Removing a whole field.
Creating pseudonyms.
Replacing actual values with random ones.
First name, last name, SSN.
Distortion of data—no analytics.
Khaled El Emam & Luk
Anonymizing Health Data
De-identification Standards
Khaled El Emam & Luk
Anonymizing Health Data
De-identification Standards
Age, sex, race, address, income.
Khaled El Emam & Luk
Anonymizing Health Data
Minimal distortion of data—for analytics.
Age, sex, race, address, income.
De-identification Standards
Khaled El Emam & Luk
Anonymizing Health Data
Minimal distortion of data—for analytics.
Age, sex, race, address, income.
De-identification Standards
Safe Harbor in HIPAA Privacy Rule.
Khaled El Emam & Luk
Anonymizing Health Data
What’s “Actual Knowledge”?
Privacy Rule
Safe Harbor
Khaled El Emam & Luk
Anonymizing Health Data
What’s “Actual Knowledge”?
Info, alone or in combo, that could identify
an individual.
Khaled El Emam & Luk
Anonymizing Health Data
What’s “Actual Knowledge”?
Info, alone or in combo, that could identify
an individual.
Has to be specific to the data set—not
theoretical.
Khaled El Emam & Luk
Anonymizing Health Data
What’s “Actual Knowledge”?
Info, alone or in combo, that could identify
an individual.
Has to be specific to the data set—not
theoretical.
Occupation Mayor of Gotham.
Khaled El Emam & Luk
Anonymizing Health Data
Heuristics, or rules of thumb.
Minimal distortion of data—for analytics.
Age, sex, race, address, income.
Safe Harbor in HIPAA Privacy Rule.
De-identification Standards
Khaled El Emam & Luk
Anonymizing Health Data
Heuristics, or rules of thumb.
Statistical method in HIPAA Privacy Rule.
Minimal distortion of data—for analytics.
Age, sex, race, address, income.
Safe Harbor in HIPAA Privacy Rule.
De-identification Standards
Khaled El Emam & Luk
Anonymizing Health Data
De-identification Myths
Khaled El Emam & Luk
Anonymizing Health Data
De-identification Myths
Myth: It’s possible to re-identify most, if not
all, data.
Khaled El Emam & Luk
Anonymizing Health Data
De-identification Myths
Myth: It’s possible to re-identify most, if not
all, data.
Using robust methods, evidence suggests risk
can be very small.
Khaled El Emam & Luk
Anonymizing Health Data
De-identification Myths
Myth: It’s possible to re-identify most, if not
all, data.
Myth: Genomic sequences are not
identifiable, or are easy to re-identify.
Using robust methods, evidence suggests risk
can be very small.
Khaled El Emam & Luk
Anonymizing Health Data
De-identification Myths
Myth: It’s possible to re-identify most, if not
all, data.
Myth: Genomic sequences are not
identifiable, or are easy to re-identify.
In some cases can re-identify, difficult to de-
identify using our methods.
Using robust methods, evidence suggests risk
can be very small.
Khaled El Emam & Luk
Anonymizing Health Data
A Risk-based De-identification Methodology
Khaled El Emam & Luk
Anonymizing Health Data
A Risk-based De-identification Methodology
The risk of re-identification can be quantified.
Khaled El Emam & Luk
Anonymizing Health Data
A Risk-based De-identification Methodology
The risk of re-identification can be quantified.
The Goldilocks principle:
balancing privacy with data utility.
Khaled El Emam & Luk
Anonymizing Health Data
Khaled El Emam & Luk
Anonymizing Health Data
A Risk-based De-identification Methodology
The risk of re-identification can be quantified.
The Goldilocks principle:
balancing privacy with data utility.
The re-identification risk needs to be very small.
Khaled El Emam & Luk
Anonymizing Health Data
A Risk-based De-identification Methodology
The risk of re-identification can be quantified.
The Goldilocks principle:
balancing privacy with data utility.
De-identification involves a mix of technical, contractual,
and other measures.
The re-identification risk needs to be very small.
Khaled El Emam & Luk
Anonymizing Health Data
Steps in the De-identification Methodology
Step 1: Select Direct and Indirect Identifiers
Step 2: Setting the Threshold
Step 3: Examining Plausible Attacks
Step 4: De-identifying the Data
Step 5: Documenting the Process
Khaled El Emam & Luk
Anonymizing Health Data
Step 1: Select Direct and Indirect Identifiers
Khaled El Emam & Luk
Anonymizing Health Data
Direct identifiers: name, telephone number, health
insurance card number, medical record number.
Step 1: Select Direct and Indirect Identifiers
Khaled El Emam & Luk
Anonymizing Health Data
Direct identifiers: name, telephone number, health
insurance card number, medical record number.
Indirect identifiers, or quasi-identifiers: sex, date of birth,
ethnicity, locations, event dates, medical codes.
Step 1: Select Direct and Indirect Identifiers
Khaled El Emam & Luk
Anonymizing Health Data
Step 2: Setting the Threshold
Khaled El Emam & Luk
Anonymizing Health Data
Maximum acceptable risk for sharing data.
Step 2: Setting the Threshold
Khaled El Emam & Luk
Anonymizing Health Data
Maximum acceptable risk for sharing data.
Needs to be quantitative and defensible.
Step 2: Setting the Threshold
Khaled El Emam & Luk
Anonymizing Health Data
Maximum acceptable risk for sharing data.
Needs to be quantitative and defensible.
Is the data in going to be in the public domain?
Step 2: Setting the Threshold
Khaled El Emam & Luk
Anonymizing Health Data
Maximum acceptable risk for sharing data.
Needs to be quantitative and defensible.
Is the data in going to be in the public domain?
Extent of invasion-of-privacy when data was shared?
Step 2: Setting the Threshold
Khaled El Emam & Luk
Anonymizing Health Data
Step 3: Examining Plausible Attacks
Khaled El Emam & Luk
Anonymizing Health Data
Recipient deliberately attempts to re-identify the data.
Step 3: Examining Plausible Attacks
Khaled El Emam & Luk
Anonymizing Health Data
Recipient deliberately attempts to re-identify the data.
Recipient inadvertently re-identifies the data.
“Holly Smokes, I know her!”
Step 3: Examining Plausible Attacks
Khaled El Emam & Luk
Anonymizing Health Data
Recipient deliberately attempts to re-identify the data.
Recipient inadvertently re-identifies the data.
Data breach at recipient’s site, “data gone wild”.
Step 3: Examining Plausible Attacks
Khaled El Emam & Luk
Anonymizing Health Data
Recipient deliberately attempts to re-identify the data.
Data breach at recipient’s site, “data gone wild”.
Adversary launches a demonstration attack on the data.
Step 3: Examining Plausible Attacks
Khaled El Emam & Luk
Recipient inadvertently re-identifies the data.
Anonymizing Health Data
Step 4: De-identifying the Data
Khaled El Emam & Luk
Anonymizing Health Data
Step 4: De-identifying the Data
Generalization: reducing the precision of a field.
Dates converted to month/year, or year.
Khaled El Emam & Luk
Anonymizing Health Data
Step 4: De-identifying the Data
Generalization: reducing the precision of a field.
Suppression: replacing a cell with NULL.
Unique 55-year old female in birth registry.
Khaled El Emam & Luk
Anonymizing Health Data
Step 4: De-identifying the Data
Generalization: reducing the precision of a field.
Suppression: replacing a cell with NULL.
Sub-sampling: releasing a simple random sample.
50% of data set instead of all data.
Khaled El Emam & Luk
Anonymizing Health Data
Step 5: Documenting the Process
Khaled El Emam & Luk
Anonymizing Health Data
Step 5: Documenting the Process
Process documentation—a methodology text.
Khaled El Emam & Luk
Anonymizing Health Data
Step 5: Documenting the Process
Results documentation—data set, risk thresholds,
assumptions, evidence of low risk.
Khaled El Emam & Luk
Process documentation—a methodology text.
Anonymizing Health Data
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Pr(re-id, attempt) = Pr(attempt) Pr(re-id | attempt)
Khaled El Emam & Luk
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
T2: Inadvertent Attempt (“Holly Smokes, I know her!”)
Pr(re-id, acquaintance) = Pr(acquaintance) Pr(re-id | acquaintance)
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
T2: Inadvertent Attempt (“Holly Smokes, I know her!”)
T3: Data Breach (“data gone wild”)
Pr(re-id, breach) = Pr(breach) Pr(re-id | breach)
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
T2: Inadvertent Attempt (“Holly Smokes, I know her!”)
T3: Data Breach (“data gone wild”)
T4: Public Data (demonstration attack)
Pr(re-id), based on data set only
Anonymizing Health Data
Choosing Thresholds
Khaled El Emam & Luk
Anonymizing Health Data
Choosing Thresholds
Khaled El Emam & Luk
Many precedents going back multiple decades.
Anonymizing Health Data
Choosing Thresholds
Khaled El Emam & Luk
Many precedents going back multiple decades.
Recommended by regulators.
Anonymizing Health Data
Choosing Thresholds
Khaled El Emam & Luk
Many precedents going back multiple decades.
Recommended by regulators.
All based on max risk though.
Anonymizing Health Data
Choosing Thresholds
Khaled El Emam & Luk
Many precedents going back multiple decades.
Recommended by regulators.
All based on max risk though.
Anonymizing Health Data
Part 2 of Webcast: A Look at Our Case Studies
Khaled El Emam & Luk
Anonymizing Health Data
Cross Sectional Data: Research Registries
Khaled El Emam & Luk
Anonymizing Health Data
Cross Sectional Data: Research Registries
Khaled El Emam & Luk
Better Outcomes Registry & Network (BORN)
of Ontario
Anonymizing Health Data
Cross Sectional Data: Research Registries
Khaled El Emam & Luk
Better Outcomes Registry & Network (BORN)
of Ontario
140,000 births per year.
Anonymizing Health Data
Cross Sectional Data: Research Registries
Khaled El Emam & Luk
Better Outcomes Registry & Network (BORN)
of Ontario
140,000 births per year.
Cross-sectional—mothers not traced over time.
Anonymizing Health Data
Cross Sectional Data: Research Registries
Khaled El Emam & Luk
Better Outcomes Registry & Network (BORN)
of Ontario
140,000 births per year.
Cross-sectional—mothers not traced over time.
Process of getting de-identified data from a
research registry.
Anonymizing Health Data
Cross Sectional Data: Research Registries
Khaled El Emam & Luk
Better Outcomes Registry & Network (BORN)
of Ontario
140,000 births per year.
Cross-sectional—mothers not traced over time.
Process of getting de-identified data from a
research registry.
Anonymizing Health Data
Researcher Ronnie wants data!
Khaled El Emam & Luk
Anonymizing Health Data
Researcher Ronnie wants data!
Khaled El Emam & Luk
919,710 records
from 2005-2011
Anonymizing Health Data
Researcher Ronnie wants data!
Khaled El Emam & Luk
919,710 records
from 2005-2011
Anonymizing Health Data
Choosing Thresholds
Khaled El Emam & Luk
Anonymizing Health Data
Choosing Thresholds
Khaled El Emam & Luk
Average risk of 0.1 for Researcher Ronnie
(and the data he specifically requested).
Anonymizing Health Data
Choosing Thresholds
Khaled El Emam & Luk
0.05 if there were highly sensitive variables
(congenital anomalies, mental health problems).
Average risk of 0.1 for Researcher Ronnie
Anonymizing Health Data
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
Low motives and capacity
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
Low motives and capacity; low mitigating controls.
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
Pr(attempt) = 0.4
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
T2: Inadvertent Attempt (“Holly Smokes, I know her!”)
119,785 births out of a 4,478,500 women ( = 0.027)
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
T2: Inadvertent Attempt (“Holly Smokes, I know her!”)
Pr(aquaintance) = 1- (1-0.027)150/2 = 0.87
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
T2: Inadvertent Attempt (“Holly Smokes, I know her!”)
T3: Data Breach (“data gone wild”)
Based on historical data.
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
T2: Inadvertent Attempt (“Holly Smokes, I know her!”)
T3: Data Breach (“data gone wild”)
Pr(breach)=0.27
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
T2: Inadvertent Attempt (“Holly Smokes, I know her!”)
T3: Data Breach (“data gone wild”)
T4: Public Data (demonstration attack)
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
T2: Inadvertent Attempt (“Holly Smokes, I know her!”)
T3: Data Breach (“data gone wild”)
Overall risk
Pr(re-id, T) = Pr(T) x Pr(re-id | T) ≤ 0.1
Anonymizing Health Data
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
T2: Inadvertent Attempt (“Holly Smokes, I know her!”)
Pr(aquaintance) = 1- (1-0.027)150/2 = 0.87
Overall risk
Pr(re-id, acquaintance) = 0.87 Pr(re-id | acquaintance) ≤ 0.1
Anonymizing Health Data
De-identifying the Data Set
Khaled El Emam & Luk
Anonymizing Health Data
Meeting Thresholds: k-anonymity
Khaled El Emam & Luk
k
Anonymizing Health Data
Meeting Thresholds: k-anonymity
Khaled El Emam & Luk
Anonymizing Health Data
De-identifying the Data Set
Khaled El Emam & Luk
MDOB in 1-yy; BDOB in wk/yy; MPC of 1 char.
Anonymizing Health Data
De-identifying the Data Set
Khaled El Emam & Luk
MDOB in 1-yy; BDOB in wk/yy; MPC of 1 char.
MDOB in 10-yy; BDOB in qtr/yy; MPC of 3 chars.
Anonymizing Health Data
De-identifying the Data Set
Khaled El Emam & Luk
MDOB in 1-yy; BDOB in wk/yy; MPC of 1 char.
MDOB in 10-yy; BDOB in qtr/yy; MPC of 3 chars.
MDOB in 10-yy; BDOB in mm/yy; MPC of 3 chars.
Anonymizing Health Data
Year on Year: Re-using Risk Analyses
Khaled El Emam & Luk
Anonymizing Health Data
Year on Year: Re-using Risk Analyses
Khaled El Emam & Luk
In 2006 Researcher Ronnie asks for 2005.
Anonymizing Health Data
Year on Year: Re-using Risk Analyses
Khaled El Emam & Luk
In 2006 Researcher Ronnie asks for 2005—deleted.
In 2007 Researcher Ronnie asks for 2006.
Anonymizing Health Data
Year on Year: Re-using Risk Analyses
Khaled El Emam & Luk
In 2006 Researcher Ronnie asks for 2005.
In 2007 Researcher Ronnie asks for 2006—deleted.
In 2008 Researcher Ronnie asks for 2007.
Anonymizing Health Data
Year on Year: Re-using Risk Analyses
Khaled El Emam & Luk
In 2006 Researcher Ronnie asks for 2005.
In 2007 Researcher Ronnie asks for 2006.
In 2008 Researcher Ronnie asks for 2007—deleted.
In 2009 Researcher Ronnie asks for 2008.
Anonymizing Health Data
Year on Year: Re-using Risk Analyses
Khaled El Emam & Luk
In 2006 Researcher Ronnie asks for 2005.
In 2007 Researcher Ronnie asks for 2006.
In 2008 Researcher Ronnie asks for 2007.
In 2009 Researcher Ronnie asks for 2008—deleted.
In 2010 Researcher Ronnie asks for 2009.
Anonymizing Health Data
Year on Year: Re-using Risk Analyses
Khaled El Emam & Luk
In 2006 Researcher Ronnie asks for 2005.
In 2007 Researcher Ronnie asks for 2006.
In 2008 Researcher Ronnie asks for 2007.
In 2009 Researcher Ronnie asks for 2008—deleted.
In 2010 Researcher Ronnie asks for 2009.
Can we use the same de-identification scheme every year?
Anonymizing Health Data
Khaled El Emam & Luk
Anonymizing Health Data
Khaled El Emam & Luk
Anonymizing Health Data
Year on Year: Re-using Risk Analyses
Khaled El Emam & Luk
BORN data pertains to very stable populations.
Anonymizing Health Data
Year on Year: Re-using Risk Analyses
Khaled El Emam & Luk
BORN data pertains to very stable populations.
No dramatic changes in the number or characteristics of
births from 2005-2010.
Anonymizing Health Data
Year on Year: Re-using Risk Analyses
Khaled El Emam & Luk
BORN data pertains to very stable populations.
No dramatic changes in the number or characteristics of
births from 2005-2010.
Revisit de-identification scheme every 18 to 24 months.
Anonymizing Health Data
Year on Year: Re-using Risk Analyses
Khaled El Emam & Luk
BORN data pertains to very stable populations.
No dramatic changes in the number or characteristics of
births from 2005-2010.
Revisit de-identification scheme every 18 to 24 months.
Revisit if any new quasi-identifiers are added or changed.
Anonymizing Health Data
Longitudinal Discharge Abstract Data:
State Inpatient Databases
Khaled El Emam & Luk
Anonymizing Health Data
Longitudinal Discharge Abstract Data:
State Inpatient Databases
Khaled El Emam & Luk
Linking a patient’s records over time.
Anonymizing Health Data
Longitudinal Discharge Abstract Data:
State Inpatient Databases
Khaled El Emam & Luk
Linking a patient’s records over time.
Need to be de-identified differently.
Anonymizing Health Data
Meeting Thresholds: k-anonymity?
Khaled El Emam & Luk
k?
Anonymizing Health Data
Meeting Thresholds: k-anonymity?
Khaled El Emam & Luk
Anonymizing Health Data
Meeting Thresholds: k-anonymity?
Khaled El Emam & Luk
Anonymizing Health Data
De-identifying Under Complete Knowledge
Khaled El Emam & Luk
Anonymizing Health Data
De-identifying Under Complete Knowledge
Khaled El Emam & Luk
Anonymizing Health Data
De-identifying Under Complete Knowledge
Khaled El Emam & Luk
Anonymizing Health Data
De-identifying Under Complete Knowledge
Khaled El Emam & Luk
Anonymizing Health Data
State Inpatient Database (SID) of California
Khaled El Emam & Luk
Anonymizing Health Data
State Inpatient Database (SID) of California
Khaled El Emam & Luk
Researcher Ronnie wants public data!
Anonymizing Health Data
State Inpatient Database (SID) of California
Khaled El Emam & Luk
Researcher Ronnie wants public data!
Anonymizing Health Data
State Inpatient Database (SID) of California
Khaled El Emam & Luk
Anonymizing Health Data
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
Anonymizing Health Data
T1:Deliberate Attempt
Measuring Risk Under Plausible Attacks
Khaled El Emam & Luk
T2: Inadvertent Attempt (“Holly Smokes, I know her!”)
T3: Data Breach (“data gone wild”)
T4: Public Data (demonstration attack)
Pr(re-id) ≤ 0.09 (maximum risk)
Anonymizing Health Data
De-identifying the Data Set
Khaled El Emam & Luk
Anonymizing Health Data
De-identifying the Data Set
Khaled El Emam & Luk
BirthYear in 5-yy (cut at 1910-);
AdmissionYear unchanged;
DaysSinceLastService in 28-dd (cut at 7-, 182+);
LengthOfStay same as DaysSinceLastService.
Anonymizing Health Data
De-identifying the Data Set
Khaled El Emam & Luk
BirthYear in 5-yy (cut at 1910-);
AdmissionYear unchanged;
DaysSinceLastService in 28-dd (cut at 7-, 182+);
LengthOfStay same as DaysSinceLastService.
Anonymizing Health Data
Connected Variables
Khaled El Emam & Luk
Anonymizing Health Data
Connected Variables
Khaled El Emam & Luk
QI to QI
Anonymizing Health Data
Connected Variables
Khaled El Emam & Luk
QI to QI
Similar QI?
Same generalization and suppression.
Anonymizing Health Data
Connected Variables
Khaled El Emam & Luk
QI to QI
Similar QI?
Same generalization and suppression.
QI to non-QI
Anonymizing Health Data
Connected Variables
Khaled El Emam & Luk
QI to QI
Similar QI?
Same generalization and suppression.
QI to non-QI
Non-QI is revealing?
Same suppression so both are removed.
Anonymizing Health Data
Other Issues Regarding Longitudinal Data
Khaled El Emam & Luk
Anonymizing Health Data
Other Issues Regarding Longitudinal Data
Khaled El Emam & Luk
Date shifting—maintaining order of records.
Anonymizing Health Data
Other Issues Regarding Longitudinal Data
Khaled El Emam & Luk
Date shifting—maintaining order of records.
Long tails—truncation of records.
Anonymizing Health Data
Other Issues Regarding Longitudinal Data
Khaled El Emam & Luk
Date shifting—maintaining order of records.
Long tails—truncation of records.
Adversary power—assumption of knowledge.
Anonymizing Health Data
Other Concerns to Think About
Khaled El Emam & Luk
Anonymizing Health Data
Other Concerns to Think About
Khaled El Emam & Luk
Free-form text—anonymization.
Anonymizing Health Data
Other Concerns to Think About
Khaled El Emam & Luk
Free-form text—anonymization.
Geospatial information—aggregation and
geoproxy risk.
Anonymizing Health Data
Other Concerns to Think About
Khaled El Emam & Luk
Free-form text—anonymization.
Geospatial information—aggregation and
geoproxy risk.
Medical codes—generalization, suppression,
shuffling (yes, as in cards).
Anonymizing Health Data
Other Concerns to Think About
Khaled El Emam & Luk
Free-form text—anonymization.
Geospatial information—aggregation and
geoproxy risk.
Medical codes—generalization, suppression,
shuffling (yes, as in cards).
Secure linking—linking data through
encryption before anonymization.
Anonymizing Health Data
Part 3 of Webcast: Questions and Answers
Khaled El Emam & Luk
Anonymizing Health Data
Khaled El Emam & Luk
More Comments or Questions: Contact us!
Anonymizing Health Data
Khaled El Emam & Luk
Khaled El Emam: kelemam@privacyanalytics.ca
Luk Arbuckle: larbuckle@privacyanalytics.ca
More Comments or Questions: Contact us!

Weitere ähnliche Inhalte

Was ist angesagt?

Everything You Need to Know about DPF But Are Afraid to Ask.pdf
Everything You Need to Know about DPF But Are Afraid to Ask.pdfEverything You Need to Know about DPF But Are Afraid to Ask.pdf
Everything You Need to Know about DPF But Are Afraid to Ask.pdfTrustArc
 
Everything you Need to Know about The Data Protection Officer Role
Everything you Need to Know about The Data Protection Officer Role Everything you Need to Know about The Data Protection Officer Role
Everything you Need to Know about The Data Protection Officer Role HackerOne
 
KVKK Genel sunum - KiĹźisel Veriler
KVKK Genel sunum - KiĹźisel VerilerKVKK Genel sunum - KiĹźisel Veriler
KVKK Genel sunum - KiĹźisel VerilerĂ–mer Ă–zer
 
Metadata Strategies
Metadata StrategiesMetadata Strategies
Metadata StrategiesDATAVERSITY
 
Data Privacy: What you need to know about privacy, from compliance to ethics
Data Privacy: What you need to know about privacy, from compliance to ethicsData Privacy: What you need to know about privacy, from compliance to ethics
Data Privacy: What you need to know about privacy, from compliance to ethicsAT Internet
 
GDPR Basics - General Data Protection Regulation
GDPR Basics - General Data Protection RegulationGDPR Basics - General Data Protection Regulation
GDPR Basics - General Data Protection RegulationVicky Dallas
 
Urgensi RUU Perlindungan Data Pribadi
Urgensi RUU Perlindungan Data PribadiUrgensi RUU Perlindungan Data Pribadi
Urgensi RUU Perlindungan Data PribadiEryk Budi Pratama
 
Funciones de un ceo, cio y el encargado de seguridad en informática
Funciones de un ceo, cio  y el encargado de seguridad en informáticaFunciones de un ceo, cio  y el encargado de seguridad en informática
Funciones de un ceo, cio y el encargado de seguridad en informáticaCarlos Andres Perez Cabrales
 
Data mining with differential privacy
Data mining with differential privacy Data mining with differential privacy
Data mining with differential privacy Wei-Yuan Chang
 
EY: Why graph technology makes sense for fraud detection and customer 360 pro...
EY: Why graph technology makes sense for fraud detection and customer 360 pro...EY: Why graph technology makes sense for fraud detection and customer 360 pro...
EY: Why graph technology makes sense for fraud detection and customer 360 pro...Neo4j
 
Data Protection Presentation
Data Protection PresentationData Protection Presentation
Data Protection PresentationIBM Business Insight
 
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...Alan McSweeney
 
UAE-Personal-Data-Protection-Law.pdf
UAE-Personal-Data-Protection-Law.pdfUAE-Personal-Data-Protection-Law.pdf
UAE-Personal-Data-Protection-Law.pdfDaviesParker
 
Data & Privacy: Striking the Right Balance - Jonny Leroy
Data & Privacy: Striking the Right Balance - Jonny LeroyData & Privacy: Striking the Right Balance - Jonny Leroy
Data & Privacy: Striking the Right Balance - Jonny LeroyThoughtworks
 
AVG 7 stappenplan.pptx voor slideshare
AVG 7 stappenplan.pptx voor slideshareAVG 7 stappenplan.pptx voor slideshare
AVG 7 stappenplan.pptx voor slideshareVIPLansingerland
 
Data Loss Threats and Mitigations
Data Loss Threats and MitigationsData Loss Threats and Mitigations
Data Loss Threats and MitigationsApril Mardock CISSP
 

Was ist angesagt? (20)

Privacy by design
Privacy by designPrivacy by design
Privacy by design
 
Everything You Need to Know about DPF But Are Afraid to Ask.pdf
Everything You Need to Know about DPF But Are Afraid to Ask.pdfEverything You Need to Know about DPF But Are Afraid to Ask.pdf
Everything You Need to Know about DPF But Are Afraid to Ask.pdf
 
Everything you Need to Know about The Data Protection Officer Role
Everything you Need to Know about The Data Protection Officer Role Everything you Need to Know about The Data Protection Officer Role
Everything you Need to Know about The Data Protection Officer Role
 
kvkk sunum
kvkk sunumkvkk sunum
kvkk sunum
 
KVKK Genel sunum - KiĹźisel Veriler
KVKK Genel sunum - KiĹźisel VerilerKVKK Genel sunum - KiĹźisel Veriler
KVKK Genel sunum - KiĹźisel Veriler
 
Metadata Strategies
Metadata StrategiesMetadata Strategies
Metadata Strategies
 
Data ethics
Data ethicsData ethics
Data ethics
 
Data Privacy: What you need to know about privacy, from compliance to ethics
Data Privacy: What you need to know about privacy, from compliance to ethicsData Privacy: What you need to know about privacy, from compliance to ethics
Data Privacy: What you need to know about privacy, from compliance to ethics
 
GDPR Basics - General Data Protection Regulation
GDPR Basics - General Data Protection RegulationGDPR Basics - General Data Protection Regulation
GDPR Basics - General Data Protection Regulation
 
Urgensi RUU Perlindungan Data Pribadi
Urgensi RUU Perlindungan Data PribadiUrgensi RUU Perlindungan Data Pribadi
Urgensi RUU Perlindungan Data Pribadi
 
Funciones de un ceo, cio y el encargado de seguridad en informática
Funciones de un ceo, cio  y el encargado de seguridad en informáticaFunciones de un ceo, cio  y el encargado de seguridad en informática
Funciones de un ceo, cio y el encargado de seguridad en informática
 
Data mining with differential privacy
Data mining with differential privacy Data mining with differential privacy
Data mining with differential privacy
 
EY: Why graph technology makes sense for fraud detection and customer 360 pro...
EY: Why graph technology makes sense for fraud detection and customer 360 pro...EY: Why graph technology makes sense for fraud detection and customer 360 pro...
EY: Why graph technology makes sense for fraud detection and customer 360 pro...
 
Data Protection Presentation
Data Protection PresentationData Protection Presentation
Data Protection Presentation
 
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
 
UAE-Personal-Data-Protection-Law.pdf
UAE-Personal-Data-Protection-Law.pdfUAE-Personal-Data-Protection-Law.pdf
UAE-Personal-Data-Protection-Law.pdf
 
Data & Privacy: Striking the Right Balance - Jonny Leroy
Data & Privacy: Striking the Right Balance - Jonny LeroyData & Privacy: Striking the Right Balance - Jonny Leroy
Data & Privacy: Striking the Right Balance - Jonny Leroy
 
AVG 7 stappenplan.pptx voor slideshare
AVG 7 stappenplan.pptx voor slideshareAVG 7 stappenplan.pptx voor slideshare
AVG 7 stappenplan.pptx voor slideshare
 
Insider threat
Insider threatInsider threat
Insider threat
 
Data Loss Threats and Mitigations
Data Loss Threats and MitigationsData Loss Threats and Mitigations
Data Loss Threats and Mitigations
 

Ă„hnlich wie Anonymizing Health Data

O'Reilly Webcast: Anonymizing Health Data
O'Reilly Webcast: Anonymizing Health DataO'Reilly Webcast: Anonymizing Health Data
O'Reilly Webcast: Anonymizing Health DataLuk Arbuckle
 
bwmedicalidt
bwmedicalidtbwmedicalidt
bwmedicalidtKara Hayden
 
DEF CON 23 - CHRIS ROCK - i will kill you how to get away with mu
DEF CON 23 - CHRIS ROCK - i will kill you how to get away with muDEF CON 23 - CHRIS ROCK - i will kill you how to get away with mu
DEF CON 23 - CHRIS ROCK - i will kill you how to get away with muFelipe Prado
 
Can I share this? Curating sensitive data
Can I share this? Curating sensitive dataCan I share this? Curating sensitive data
Can I share this? Curating sensitive dataGraham Smith
 
What To Do if You Were Scammed
What To Do if You Were ScammedWhat To Do if You Were Scammed
What To Do if You Were ScammedMary Gathege
 
Wk1 dq2
Wk1 dq2Wk1 dq2
Wk1 dq2Bridget_R
 
Wk1 dq2
Wk1 dq2Wk1 dq2
Wk1 dq2Bridget_R
 
Adult protection and safeguarding presentation
Adult protection and safeguarding presentationAdult protection and safeguarding presentation
Adult protection and safeguarding presentationJulian Dodd
 
Fifth Annual Study on Medical Identity Theft
Fifth Annual Study on Medical Identity TheftFifth Annual Study on Medical Identity Theft
Fifth Annual Study on Medical Identity Theft- Mark - Fullbright
 
Debix OnCall Healthcare
Debix OnCall HealthcareDebix OnCall Healthcare
Debix OnCall Healthcareitsmecramer
 
Sylvia hipaa powerpoint presentation 2010(1)
Sylvia hipaa powerpoint presentation 2010(1)Sylvia hipaa powerpoint presentation 2010(1)
Sylvia hipaa powerpoint presentation 2010(1)bholmes
 
Data Breach Notifications Laws - Time for a Pimp Slap Presented by Steve Werb...
Data Breach Notifications Laws - Time for a Pimp Slap Presented by Steve Werb...Data Breach Notifications Laws - Time for a Pimp Slap Presented by Steve Werb...
Data Breach Notifications Laws - Time for a Pimp Slap Presented by Steve Werb...Steve Werby
 
Avoiding Senior Scams
Avoiding Senior ScamsAvoiding Senior Scams
Avoiding Senior ScamsBrightStar Care
 
Sylvia hipaa powerpoint presentation 2010(2)
Sylvia hipaa powerpoint presentation 2010(2)Sylvia hipaa powerpoint presentation 2010(2)
Sylvia hipaa powerpoint presentation 2010(2)bholmes
 
aidsandthedutytowarn-1-120817003514-phpapp01
aidsandthedutytowarn-1-120817003514-phpapp01aidsandthedutytowarn-1-120817003514-phpapp01
aidsandthedutytowarn-1-120817003514-phpapp01Shanae Berry-Weldon
 
Hipaa Is Heating Up!!
Hipaa Is Heating Up!!Hipaa Is Heating Up!!
Hipaa Is Heating Up!!Candy Matheny
 

Ă„hnlich wie Anonymizing Health Data (20)

O'Reilly Webcast: Anonymizing Health Data
O'Reilly Webcast: Anonymizing Health DataO'Reilly Webcast: Anonymizing Health Data
O'Reilly Webcast: Anonymizing Health Data
 
bwmedicalidt
bwmedicalidtbwmedicalidt
bwmedicalidt
 
DEF CON 23 - CHRIS ROCK - i will kill you how to get away with mu
DEF CON 23 - CHRIS ROCK - i will kill you how to get away with muDEF CON 23 - CHRIS ROCK - i will kill you how to get away with mu
DEF CON 23 - CHRIS ROCK - i will kill you how to get away with mu
 
dgcha07
dgcha07dgcha07
dgcha07
 
Can I share this? Curating sensitive data
Can I share this? Curating sensitive dataCan I share this? Curating sensitive data
Can I share this? Curating sensitive data
 
What To Do if You Were Scammed
What To Do if You Were ScammedWhat To Do if You Were Scammed
What To Do if You Were Scammed
 
125 nipsta
125 nipsta125 nipsta
125 nipsta
 
Whistle Blowing Essays
Whistle Blowing EssaysWhistle Blowing Essays
Whistle Blowing Essays
 
Wk1 dq2
Wk1 dq2Wk1 dq2
Wk1 dq2
 
Wk1 dq2
Wk1 dq2Wk1 dq2
Wk1 dq2
 
Prevent Elder Abuse
Prevent Elder AbusePrevent Elder Abuse
Prevent Elder Abuse
 
Adult protection and safeguarding presentation
Adult protection and safeguarding presentationAdult protection and safeguarding presentation
Adult protection and safeguarding presentation
 
Fifth Annual Study on Medical Identity Theft
Fifth Annual Study on Medical Identity TheftFifth Annual Study on Medical Identity Theft
Fifth Annual Study on Medical Identity Theft
 
Debix OnCall Healthcare
Debix OnCall HealthcareDebix OnCall Healthcare
Debix OnCall Healthcare
 
Sylvia hipaa powerpoint presentation 2010(1)
Sylvia hipaa powerpoint presentation 2010(1)Sylvia hipaa powerpoint presentation 2010(1)
Sylvia hipaa powerpoint presentation 2010(1)
 
Data Breach Notifications Laws - Time for a Pimp Slap Presented by Steve Werb...
Data Breach Notifications Laws - Time for a Pimp Slap Presented by Steve Werb...Data Breach Notifications Laws - Time for a Pimp Slap Presented by Steve Werb...
Data Breach Notifications Laws - Time for a Pimp Slap Presented by Steve Werb...
 
Avoiding Senior Scams
Avoiding Senior ScamsAvoiding Senior Scams
Avoiding Senior Scams
 
Sylvia hipaa powerpoint presentation 2010(2)
Sylvia hipaa powerpoint presentation 2010(2)Sylvia hipaa powerpoint presentation 2010(2)
Sylvia hipaa powerpoint presentation 2010(2)
 
aidsandthedutytowarn-1-120817003514-phpapp01
aidsandthedutytowarn-1-120817003514-phpapp01aidsandthedutytowarn-1-120817003514-phpapp01
aidsandthedutytowarn-1-120817003514-phpapp01
 
Hipaa Is Heating Up!!
Hipaa Is Heating Up!!Hipaa Is Heating Up!!
Hipaa Is Heating Up!!
 

Mehr von Khaled El Emam

Canadian AI 2014 Conference Keynote - Deploying SMC in Practice
Canadian AI 2014 Conference Keynote - Deploying SMC in PracticeCanadian AI 2014 Conference Keynote - Deploying SMC in Practice
Canadian AI 2014 Conference Keynote - Deploying SMC in PracticeKhaled El Emam
 
Take Two Curves and Call Me in the Morning: The Story of the NSAs Dual_EC_DRB...
Take Two Curves and Call Me in the Morning: The Story of the NSAs Dual_EC_DRB...Take Two Curves and Call Me in the Morning: The Story of the NSAs Dual_EC_DRB...
Take Two Curves and Call Me in the Morning: The Story of the NSAs Dual_EC_DRB...Khaled El Emam
 
Facilitating Analytics while Protecting Privacy
Facilitating Analytics while Protecting PrivacyFacilitating Analytics while Protecting Privacy
Facilitating Analytics while Protecting PrivacyKhaled El Emam
 
Big Data Meets Privacy:De-identification Maturity Model for Benchmarking and ...
Big Data Meets Privacy:De-identification Maturity Model for Benchmarking and ...Big Data Meets Privacy:De-identification Maturity Model for Benchmarking and ...
Big Data Meets Privacy:De-identification Maturity Model for Benchmarking and ...Khaled El Emam
 
Sharing Health Research Data
Sharing Health Research DataSharing Health Research Data
Sharing Health Research DataKhaled El Emam
 
Risk Based De-identification for Sharing Health Data
Risk Based De-identification for Sharing Health DataRisk Based De-identification for Sharing Health Data
Risk Based De-identification for Sharing Health DataKhaled El Emam
 
The De-identification of Clinical Data
The De-identification of Clinical DataThe De-identification of Clinical Data
The De-identification of Clinical DataKhaled El Emam
 
The Adoption of Personal Health Records by Consumers
The Adoption of Personal Health Records by ConsumersThe Adoption of Personal Health Records by Consumers
The Adoption of Personal Health Records by ConsumersKhaled El Emam
 
The Use of EDC in Canadian Clinical Trials
The Use of EDC in Canadian Clinical TrialsThe Use of EDC in Canadian Clinical Trials
The Use of EDC in Canadian Clinical TrialsKhaled El Emam
 

Mehr von Khaled El Emam (9)

Canadian AI 2014 Conference Keynote - Deploying SMC in Practice
Canadian AI 2014 Conference Keynote - Deploying SMC in PracticeCanadian AI 2014 Conference Keynote - Deploying SMC in Practice
Canadian AI 2014 Conference Keynote - Deploying SMC in Practice
 
Take Two Curves and Call Me in the Morning: The Story of the NSAs Dual_EC_DRB...
Take Two Curves and Call Me in the Morning: The Story of the NSAs Dual_EC_DRB...Take Two Curves and Call Me in the Morning: The Story of the NSAs Dual_EC_DRB...
Take Two Curves and Call Me in the Morning: The Story of the NSAs Dual_EC_DRB...
 
Facilitating Analytics while Protecting Privacy
Facilitating Analytics while Protecting PrivacyFacilitating Analytics while Protecting Privacy
Facilitating Analytics while Protecting Privacy
 
Big Data Meets Privacy:De-identification Maturity Model for Benchmarking and ...
Big Data Meets Privacy:De-identification Maturity Model for Benchmarking and ...Big Data Meets Privacy:De-identification Maturity Model for Benchmarking and ...
Big Data Meets Privacy:De-identification Maturity Model for Benchmarking and ...
 
Sharing Health Research Data
Sharing Health Research DataSharing Health Research Data
Sharing Health Research Data
 
Risk Based De-identification for Sharing Health Data
Risk Based De-identification for Sharing Health DataRisk Based De-identification for Sharing Health Data
Risk Based De-identification for Sharing Health Data
 
The De-identification of Clinical Data
The De-identification of Clinical DataThe De-identification of Clinical Data
The De-identification of Clinical Data
 
The Adoption of Personal Health Records by Consumers
The Adoption of Personal Health Records by ConsumersThe Adoption of Personal Health Records by Consumers
The Adoption of Personal Health Records by Consumers
 
The Use of EDC in Canadian Clinical Trials
The Use of EDC in Canadian Clinical TrialsThe Use of EDC in Canadian Clinical Trials
The Use of EDC in Canadian Clinical Trials
 

KĂĽrzlich hochgeladen

97111 47426 Call Girls In Delhi MUNIRKAA
97111 47426 Call Girls In Delhi MUNIRKAA97111 47426 Call Girls In Delhi MUNIRKAA
97111 47426 Call Girls In Delhi MUNIRKAAjennyeacort
 
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...narwatsonia7
 
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original PhotosBook Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photosnarwatsonia7
 
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call NowKolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call NowNehru place Escorts
 
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking Models
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking ModelsMumbai Call Girls Service 9910780858 Real Russian Girls Looking Models
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking Modelssonalikaur4
 
Russian Call Girls Gunjur Mugalur Road : 7001305949 High Profile Model Escort...
Russian Call Girls Gunjur Mugalur Road : 7001305949 High Profile Model Escort...Russian Call Girls Gunjur Mugalur Road : 7001305949 High Profile Model Escort...
Russian Call Girls Gunjur Mugalur Road : 7001305949 High Profile Model Escort...narwatsonia7
 
call girls in green park DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in green park  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in green park  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in green park DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️saminamagar
 
Housewife Call Girls Hsr Layout - Call 7001305949 Rs-3500 with A/C Room Cash ...
Housewife Call Girls Hsr Layout - Call 7001305949 Rs-3500 with A/C Room Cash ...Housewife Call Girls Hsr Layout - Call 7001305949 Rs-3500 with A/C Room Cash ...
Housewife Call Girls Hsr Layout - Call 7001305949 Rs-3500 with A/C Room Cash ...narwatsonia7
 
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original Photos
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original PhotosCall Girl Service Bidadi - For 7001305949 Cheap & Best with original Photos
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original Photosnarwatsonia7
 
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...rajnisinghkjn
 
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...narwatsonia7
 
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...Nehru place Escorts
 
See the 2,456 pharmacies on the National E-Pharmacy Platform
See the 2,456 pharmacies on the National E-Pharmacy PlatformSee the 2,456 pharmacies on the National E-Pharmacy Platform
See the 2,456 pharmacies on the National E-Pharmacy PlatformKweku Zurek
 
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbai
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service MumbaiVIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbai
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbaisonalikaur4
 
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Availablenarwatsonia7
 
Glomerular Filtration rate and its determinants.pptx
Glomerular Filtration rate and its determinants.pptxGlomerular Filtration rate and its determinants.pptx
Glomerular Filtration rate and its determinants.pptxDr.Nusrat Tariq
 
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...narwatsonia7
 
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...narwatsonia7
 
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbai
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service MumbaiLow Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbai
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbaisonalikaur4
 
Housewife Call Girls Bangalore - Call 7001305949 Rs-3500 with A/C Room Cash o...
Housewife Call Girls Bangalore - Call 7001305949 Rs-3500 with A/C Room Cash o...Housewife Call Girls Bangalore - Call 7001305949 Rs-3500 with A/C Room Cash o...
Housewife Call Girls Bangalore - Call 7001305949 Rs-3500 with A/C Room Cash o...narwatsonia7
 

KĂĽrzlich hochgeladen (20)

97111 47426 Call Girls In Delhi MUNIRKAA
97111 47426 Call Girls In Delhi MUNIRKAA97111 47426 Call Girls In Delhi MUNIRKAA
97111 47426 Call Girls In Delhi MUNIRKAA
 
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
 
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original PhotosBook Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
 
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call NowKolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
 
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking Models
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking ModelsMumbai Call Girls Service 9910780858 Real Russian Girls Looking Models
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking Models
 
Russian Call Girls Gunjur Mugalur Road : 7001305949 High Profile Model Escort...
Russian Call Girls Gunjur Mugalur Road : 7001305949 High Profile Model Escort...Russian Call Girls Gunjur Mugalur Road : 7001305949 High Profile Model Escort...
Russian Call Girls Gunjur Mugalur Road : 7001305949 High Profile Model Escort...
 
call girls in green park DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in green park  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in green park  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in green park DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
 
Housewife Call Girls Hsr Layout - Call 7001305949 Rs-3500 with A/C Room Cash ...
Housewife Call Girls Hsr Layout - Call 7001305949 Rs-3500 with A/C Room Cash ...Housewife Call Girls Hsr Layout - Call 7001305949 Rs-3500 with A/C Room Cash ...
Housewife Call Girls Hsr Layout - Call 7001305949 Rs-3500 with A/C Room Cash ...
 
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original Photos
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original PhotosCall Girl Service Bidadi - For 7001305949 Cheap & Best with original Photos
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original Photos
 
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
 
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...
 
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...
 
See the 2,456 pharmacies on the National E-Pharmacy Platform
See the 2,456 pharmacies on the National E-Pharmacy PlatformSee the 2,456 pharmacies on the National E-Pharmacy Platform
See the 2,456 pharmacies on the National E-Pharmacy Platform
 
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbai
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service MumbaiVIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbai
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbai
 
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
 
Glomerular Filtration rate and its determinants.pptx
Glomerular Filtration rate and its determinants.pptxGlomerular Filtration rate and its determinants.pptx
Glomerular Filtration rate and its determinants.pptx
 
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
 
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...
 
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbai
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service MumbaiLow Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbai
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbai
 
Housewife Call Girls Bangalore - Call 7001305949 Rs-3500 with A/C Room Cash o...
Housewife Call Girls Bangalore - Call 7001305949 Rs-3500 with A/C Room Cash o...Housewife Call Girls Bangalore - Call 7001305949 Rs-3500 with A/C Room Cash o...
Housewife Call Girls Bangalore - Call 7001305949 Rs-3500 with A/C Room Cash o...
 

Anonymizing Health Data

  • 1. Anonymizing Health Data Webcast Case Studies and Methods to Get You S Khaled El Emam & Luk
  • 2. Anonymizing Health Data Part 1 of Webcast: Intro and Methodology Part 2 of Webcast: A Look at Our Case Studies Part 3 of Webcast: Questions and Answers Khaled El Emam & Luk
  • 3. Anonymizing Health Data Part 1 of Webcast: Intro and Methodology Khaled El Emam & Luk
  • 4. Anonymizing Health Data To Anonymize or not to Anonymize Khaled El Emam & Luk
  • 5. Anonymizing Health Data Consent needs to be informed. To Anonymize or not to Anonymize Khaled El Emam & Luk
  • 6. Anonymizing Health Data Consent needs to be informed. Not all health care providers are willing to share their patient’s PHI. To Anonymize or not to Anonymize Khaled El Emam & Luk
  • 7. Anonymizing Health Data Consent needs to be informed. Not all health care providers are willing to share their patient’s PHI. Anonymization allows for the sharing of health information. To Anonymize or not to Anonymize Khaled El Emam & Luk
  • 8. Anonymizing Health Data Consent needs to be informed. Not all health care providers are willing to share their patient’s PHI. Anonymization allows for the sharing of health information. To Anonymize or not to Anonymize Compelling financial case. Breach cost ~$200 per patient. Khaled El Emam & Luk
  • 9. Anonymizing Health Data Consent needs to be informed. Not all health care providers are willing to share their patient’s PHI. Anonymization allows for the sharing of health information. To Anonymize or not to Anonymize Compelling financial case. Breach cost ~$200 per patient. Khaled El Emam & Luk
  • 10. Anonymizing Health Data Consent needs to be informed. Not all health care providers are willing to share their patient’s PHI. Anonymization allows for the sharing of health information. To Anonymize or not to Anonymize Privacy protective behaviors by patients. Compelling financial case. Breach cost ~$200 per patient. Khaled El Emam & Luk
  • 11. Anonymizing Health Data Masking Standards Khaled El Emam & Luk
  • 12. Anonymizing Health Data Masking Standards First name, last name, SSN. Khaled El Emam & Luk
  • 13. Anonymizing Health Data Masking Standards Distortion of data—no analytics. First name, last name, SSN. Khaled El Emam & Luk
  • 14. Anonymizing Health Data Masking Standards Creating pseudonyms. First name, last name, SSN. Distortion of data—no analytics. Khaled El Emam & Luk
  • 15. Anonymizing Health Data Masking Standards Removing a whole field. Creating pseudonyms. First name, last name, SSN. Distortion of data—no analytics. Khaled El Emam & Luk
  • 16. Anonymizing Health Data Masking Standards Removing a whole field. Creating pseudonyms. Replacing actual values with random ones. First name, last name, SSN. Distortion of data—no analytics. Khaled El Emam & Luk
  • 17. Anonymizing Health Data De-identification Standards Khaled El Emam & Luk
  • 18. Anonymizing Health Data De-identification Standards Age, sex, race, address, income. Khaled El Emam & Luk
  • 19. Anonymizing Health Data Minimal distortion of data—for analytics. Age, sex, race, address, income. De-identification Standards Khaled El Emam & Luk
  • 20. Anonymizing Health Data Minimal distortion of data—for analytics. Age, sex, race, address, income. De-identification Standards Safe Harbor in HIPAA Privacy Rule. Khaled El Emam & Luk
  • 21. Anonymizing Health Data What’s “Actual Knowledge”? Privacy Rule Safe Harbor Khaled El Emam & Luk
  • 22. Anonymizing Health Data What’s “Actual Knowledge”? Info, alone or in combo, that could identify an individual. Khaled El Emam & Luk
  • 23. Anonymizing Health Data What’s “Actual Knowledge”? Info, alone or in combo, that could identify an individual. Has to be specific to the data set—not theoretical. Khaled El Emam & Luk
  • 24. Anonymizing Health Data What’s “Actual Knowledge”? Info, alone or in combo, that could identify an individual. Has to be specific to the data set—not theoretical. Occupation Mayor of Gotham. Khaled El Emam & Luk
  • 25. Anonymizing Health Data Heuristics, or rules of thumb. Minimal distortion of data—for analytics. Age, sex, race, address, income. Safe Harbor in HIPAA Privacy Rule. De-identification Standards Khaled El Emam & Luk
  • 26. Anonymizing Health Data Heuristics, or rules of thumb. Statistical method in HIPAA Privacy Rule. Minimal distortion of data—for analytics. Age, sex, race, address, income. Safe Harbor in HIPAA Privacy Rule. De-identification Standards Khaled El Emam & Luk
  • 27. Anonymizing Health Data De-identification Myths Khaled El Emam & Luk
  • 28. Anonymizing Health Data De-identification Myths Myth: It’s possible to re-identify most, if not all, data. Khaled El Emam & Luk
  • 29. Anonymizing Health Data De-identification Myths Myth: It’s possible to re-identify most, if not all, data. Using robust methods, evidence suggests risk can be very small. Khaled El Emam & Luk
  • 30. Anonymizing Health Data De-identification Myths Myth: It’s possible to re-identify most, if not all, data. Myth: Genomic sequences are not identifiable, or are easy to re-identify. Using robust methods, evidence suggests risk can be very small. Khaled El Emam & Luk
  • 31. Anonymizing Health Data De-identification Myths Myth: It’s possible to re-identify most, if not all, data. Myth: Genomic sequences are not identifiable, or are easy to re-identify. In some cases can re-identify, difficult to de- identify using our methods. Using robust methods, evidence suggests risk can be very small. Khaled El Emam & Luk
  • 32. Anonymizing Health Data A Risk-based De-identification Methodology Khaled El Emam & Luk
  • 33. Anonymizing Health Data A Risk-based De-identification Methodology The risk of re-identification can be quantified. Khaled El Emam & Luk
  • 34. Anonymizing Health Data A Risk-based De-identification Methodology The risk of re-identification can be quantified. The Goldilocks principle: balancing privacy with data utility. Khaled El Emam & Luk
  • 36. Anonymizing Health Data A Risk-based De-identification Methodology The risk of re-identification can be quantified. The Goldilocks principle: balancing privacy with data utility. The re-identification risk needs to be very small. Khaled El Emam & Luk
  • 37. Anonymizing Health Data A Risk-based De-identification Methodology The risk of re-identification can be quantified. The Goldilocks principle: balancing privacy with data utility. De-identification involves a mix of technical, contractual, and other measures. The re-identification risk needs to be very small. Khaled El Emam & Luk
  • 38. Anonymizing Health Data Steps in the De-identification Methodology Step 1: Select Direct and Indirect Identifiers Step 2: Setting the Threshold Step 3: Examining Plausible Attacks Step 4: De-identifying the Data Step 5: Documenting the Process Khaled El Emam & Luk
  • 39. Anonymizing Health Data Step 1: Select Direct and Indirect Identifiers Khaled El Emam & Luk
  • 40. Anonymizing Health Data Direct identifiers: name, telephone number, health insurance card number, medical record number. Step 1: Select Direct and Indirect Identifiers Khaled El Emam & Luk
  • 41. Anonymizing Health Data Direct identifiers: name, telephone number, health insurance card number, medical record number. Indirect identifiers, or quasi-identifiers: sex, date of birth, ethnicity, locations, event dates, medical codes. Step 1: Select Direct and Indirect Identifiers Khaled El Emam & Luk
  • 42. Anonymizing Health Data Step 2: Setting the Threshold Khaled El Emam & Luk
  • 43. Anonymizing Health Data Maximum acceptable risk for sharing data. Step 2: Setting the Threshold Khaled El Emam & Luk
  • 44. Anonymizing Health Data Maximum acceptable risk for sharing data. Needs to be quantitative and defensible. Step 2: Setting the Threshold Khaled El Emam & Luk
  • 45. Anonymizing Health Data Maximum acceptable risk for sharing data. Needs to be quantitative and defensible. Is the data in going to be in the public domain? Step 2: Setting the Threshold Khaled El Emam & Luk
  • 46. Anonymizing Health Data Maximum acceptable risk for sharing data. Needs to be quantitative and defensible. Is the data in going to be in the public domain? Extent of invasion-of-privacy when data was shared? Step 2: Setting the Threshold Khaled El Emam & Luk
  • 47. Anonymizing Health Data Step 3: Examining Plausible Attacks Khaled El Emam & Luk
  • 48. Anonymizing Health Data Recipient deliberately attempts to re-identify the data. Step 3: Examining Plausible Attacks Khaled El Emam & Luk
  • 49. Anonymizing Health Data Recipient deliberately attempts to re-identify the data. Recipient inadvertently re-identifies the data. “Holly Smokes, I know her!” Step 3: Examining Plausible Attacks Khaled El Emam & Luk
  • 50. Anonymizing Health Data Recipient deliberately attempts to re-identify the data. Recipient inadvertently re-identifies the data. Data breach at recipient’s site, “data gone wild”. Step 3: Examining Plausible Attacks Khaled El Emam & Luk
  • 51. Anonymizing Health Data Recipient deliberately attempts to re-identify the data. Data breach at recipient’s site, “data gone wild”. Adversary launches a demonstration attack on the data. Step 3: Examining Plausible Attacks Khaled El Emam & Luk Recipient inadvertently re-identifies the data.
  • 52. Anonymizing Health Data Step 4: De-identifying the Data Khaled El Emam & Luk
  • 53. Anonymizing Health Data Step 4: De-identifying the Data Generalization: reducing the precision of a field. Dates converted to month/year, or year. Khaled El Emam & Luk
  • 54. Anonymizing Health Data Step 4: De-identifying the Data Generalization: reducing the precision of a field. Suppression: replacing a cell with NULL. Unique 55-year old female in birth registry. Khaled El Emam & Luk
  • 55. Anonymizing Health Data Step 4: De-identifying the Data Generalization: reducing the precision of a field. Suppression: replacing a cell with NULL. Sub-sampling: releasing a simple random sample. 50% of data set instead of all data. Khaled El Emam & Luk
  • 56. Anonymizing Health Data Step 5: Documenting the Process Khaled El Emam & Luk
  • 57. Anonymizing Health Data Step 5: Documenting the Process Process documentation—a methodology text. Khaled El Emam & Luk
  • 58. Anonymizing Health Data Step 5: Documenting the Process Results documentation—data set, risk thresholds, assumptions, evidence of low risk. Khaled El Emam & Luk Process documentation—a methodology text.
  • 59. Anonymizing Health Data Measuring Risk Under Plausible Attacks Khaled El Emam & Luk
  • 60. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Pr(re-id, attempt) = Pr(attempt) Pr(re-id | attempt) Khaled El Emam & Luk
  • 61. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk T2: Inadvertent Attempt (“Holly Smokes, I know her!”) Pr(re-id, acquaintance) = Pr(acquaintance) Pr(re-id | acquaintance)
  • 62. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk T2: Inadvertent Attempt (“Holly Smokes, I know her!”) T3: Data Breach (“data gone wild”) Pr(re-id, breach) = Pr(breach) Pr(re-id | breach)
  • 63. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk T2: Inadvertent Attempt (“Holly Smokes, I know her!”) T3: Data Breach (“data gone wild”) T4: Public Data (demonstration attack) Pr(re-id), based on data set only
  • 64. Anonymizing Health Data Choosing Thresholds Khaled El Emam & Luk
  • 65. Anonymizing Health Data Choosing Thresholds Khaled El Emam & Luk Many precedents going back multiple decades.
  • 66. Anonymizing Health Data Choosing Thresholds Khaled El Emam & Luk Many precedents going back multiple decades. Recommended by regulators.
  • 67. Anonymizing Health Data Choosing Thresholds Khaled El Emam & Luk Many precedents going back multiple decades. Recommended by regulators. All based on max risk though.
  • 68. Anonymizing Health Data Choosing Thresholds Khaled El Emam & Luk Many precedents going back multiple decades. Recommended by regulators. All based on max risk though.
  • 69. Anonymizing Health Data Part 2 of Webcast: A Look at Our Case Studies Khaled El Emam & Luk
  • 70. Anonymizing Health Data Cross Sectional Data: Research Registries Khaled El Emam & Luk
  • 71. Anonymizing Health Data Cross Sectional Data: Research Registries Khaled El Emam & Luk Better Outcomes Registry & Network (BORN) of Ontario
  • 72. Anonymizing Health Data Cross Sectional Data: Research Registries Khaled El Emam & Luk Better Outcomes Registry & Network (BORN) of Ontario 140,000 births per year.
  • 73. Anonymizing Health Data Cross Sectional Data: Research Registries Khaled El Emam & Luk Better Outcomes Registry & Network (BORN) of Ontario 140,000 births per year. Cross-sectional—mothers not traced over time.
  • 74. Anonymizing Health Data Cross Sectional Data: Research Registries Khaled El Emam & Luk Better Outcomes Registry & Network (BORN) of Ontario 140,000 births per year. Cross-sectional—mothers not traced over time. Process of getting de-identified data from a research registry.
  • 75. Anonymizing Health Data Cross Sectional Data: Research Registries Khaled El Emam & Luk Better Outcomes Registry & Network (BORN) of Ontario 140,000 births per year. Cross-sectional—mothers not traced over time. Process of getting de-identified data from a research registry.
  • 76. Anonymizing Health Data Researcher Ronnie wants data! Khaled El Emam & Luk
  • 77. Anonymizing Health Data Researcher Ronnie wants data! Khaled El Emam & Luk 919,710 records from 2005-2011
  • 78. Anonymizing Health Data Researcher Ronnie wants data! Khaled El Emam & Luk 919,710 records from 2005-2011
  • 79. Anonymizing Health Data Choosing Thresholds Khaled El Emam & Luk
  • 80. Anonymizing Health Data Choosing Thresholds Khaled El Emam & Luk Average risk of 0.1 for Researcher Ronnie (and the data he specifically requested).
  • 81. Anonymizing Health Data Choosing Thresholds Khaled El Emam & Luk 0.05 if there were highly sensitive variables (congenital anomalies, mental health problems). Average risk of 0.1 for Researcher Ronnie
  • 82. Anonymizing Health Data Measuring Risk Under Plausible Attacks Khaled El Emam & Luk
  • 83. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk Low motives and capacity
  • 84. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk Low motives and capacity; low mitigating controls.
  • 85. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk Pr(attempt) = 0.4
  • 86. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk T2: Inadvertent Attempt (“Holly Smokes, I know her!”) 119,785 births out of a 4,478,500 women ( = 0.027)
  • 87. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk T2: Inadvertent Attempt (“Holly Smokes, I know her!”) Pr(aquaintance) = 1- (1-0.027)150/2 = 0.87
  • 88. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk T2: Inadvertent Attempt (“Holly Smokes, I know her!”) T3: Data Breach (“data gone wild”) Based on historical data.
  • 89. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk T2: Inadvertent Attempt (“Holly Smokes, I know her!”) T3: Data Breach (“data gone wild”) Pr(breach)=0.27
  • 90. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk T2: Inadvertent Attempt (“Holly Smokes, I know her!”) T3: Data Breach (“data gone wild”) T4: Public Data (demonstration attack)
  • 91. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk T2: Inadvertent Attempt (“Holly Smokes, I know her!”) T3: Data Breach (“data gone wild”) Overall risk Pr(re-id, T) = Pr(T) x Pr(re-id | T) ≤ 0.1
  • 92. Anonymizing Health Data Measuring Risk Under Plausible Attacks Khaled El Emam & Luk T2: Inadvertent Attempt (“Holly Smokes, I know her!”) Pr(aquaintance) = 1- (1-0.027)150/2 = 0.87 Overall risk Pr(re-id, acquaintance) = 0.87 Pr(re-id | acquaintance) ≤ 0.1
  • 93. Anonymizing Health Data De-identifying the Data Set Khaled El Emam & Luk
  • 94. Anonymizing Health Data Meeting Thresholds: k-anonymity Khaled El Emam & Luk k
  • 95. Anonymizing Health Data Meeting Thresholds: k-anonymity Khaled El Emam & Luk
  • 96. Anonymizing Health Data De-identifying the Data Set Khaled El Emam & Luk MDOB in 1-yy; BDOB in wk/yy; MPC of 1 char.
  • 97. Anonymizing Health Data De-identifying the Data Set Khaled El Emam & Luk MDOB in 1-yy; BDOB in wk/yy; MPC of 1 char. MDOB in 10-yy; BDOB in qtr/yy; MPC of 3 chars.
  • 98. Anonymizing Health Data De-identifying the Data Set Khaled El Emam & Luk MDOB in 1-yy; BDOB in wk/yy; MPC of 1 char. MDOB in 10-yy; BDOB in qtr/yy; MPC of 3 chars. MDOB in 10-yy; BDOB in mm/yy; MPC of 3 chars.
  • 99. Anonymizing Health Data Year on Year: Re-using Risk Analyses Khaled El Emam & Luk
  • 100. Anonymizing Health Data Year on Year: Re-using Risk Analyses Khaled El Emam & Luk In 2006 Researcher Ronnie asks for 2005.
  • 101. Anonymizing Health Data Year on Year: Re-using Risk Analyses Khaled El Emam & Luk In 2006 Researcher Ronnie asks for 2005—deleted. In 2007 Researcher Ronnie asks for 2006.
  • 102. Anonymizing Health Data Year on Year: Re-using Risk Analyses Khaled El Emam & Luk In 2006 Researcher Ronnie asks for 2005. In 2007 Researcher Ronnie asks for 2006—deleted. In 2008 Researcher Ronnie asks for 2007.
  • 103. Anonymizing Health Data Year on Year: Re-using Risk Analyses Khaled El Emam & Luk In 2006 Researcher Ronnie asks for 2005. In 2007 Researcher Ronnie asks for 2006. In 2008 Researcher Ronnie asks for 2007—deleted. In 2009 Researcher Ronnie asks for 2008.
  • 104. Anonymizing Health Data Year on Year: Re-using Risk Analyses Khaled El Emam & Luk In 2006 Researcher Ronnie asks for 2005. In 2007 Researcher Ronnie asks for 2006. In 2008 Researcher Ronnie asks for 2007. In 2009 Researcher Ronnie asks for 2008—deleted. In 2010 Researcher Ronnie asks for 2009.
  • 105. Anonymizing Health Data Year on Year: Re-using Risk Analyses Khaled El Emam & Luk In 2006 Researcher Ronnie asks for 2005. In 2007 Researcher Ronnie asks for 2006. In 2008 Researcher Ronnie asks for 2007. In 2009 Researcher Ronnie asks for 2008—deleted. In 2010 Researcher Ronnie asks for 2009. Can we use the same de-identification scheme every year?
  • 108. Anonymizing Health Data Year on Year: Re-using Risk Analyses Khaled El Emam & Luk BORN data pertains to very stable populations.
  • 109. Anonymizing Health Data Year on Year: Re-using Risk Analyses Khaled El Emam & Luk BORN data pertains to very stable populations. No dramatic changes in the number or characteristics of births from 2005-2010.
  • 110. Anonymizing Health Data Year on Year: Re-using Risk Analyses Khaled El Emam & Luk BORN data pertains to very stable populations. No dramatic changes in the number or characteristics of births from 2005-2010. Revisit de-identification scheme every 18 to 24 months.
  • 111. Anonymizing Health Data Year on Year: Re-using Risk Analyses Khaled El Emam & Luk BORN data pertains to very stable populations. No dramatic changes in the number or characteristics of births from 2005-2010. Revisit de-identification scheme every 18 to 24 months. Revisit if any new quasi-identifiers are added or changed.
  • 112. Anonymizing Health Data Longitudinal Discharge Abstract Data: State Inpatient Databases Khaled El Emam & Luk
  • 113. Anonymizing Health Data Longitudinal Discharge Abstract Data: State Inpatient Databases Khaled El Emam & Luk Linking a patient’s records over time.
  • 114. Anonymizing Health Data Longitudinal Discharge Abstract Data: State Inpatient Databases Khaled El Emam & Luk Linking a patient’s records over time. Need to be de-identified differently.
  • 115. Anonymizing Health Data Meeting Thresholds: k-anonymity? Khaled El Emam & Luk k?
  • 116. Anonymizing Health Data Meeting Thresholds: k-anonymity? Khaled El Emam & Luk
  • 117. Anonymizing Health Data Meeting Thresholds: k-anonymity? Khaled El Emam & Luk
  • 118. Anonymizing Health Data De-identifying Under Complete Knowledge Khaled El Emam & Luk
  • 119. Anonymizing Health Data De-identifying Under Complete Knowledge Khaled El Emam & Luk
  • 120. Anonymizing Health Data De-identifying Under Complete Knowledge Khaled El Emam & Luk
  • 121. Anonymizing Health Data De-identifying Under Complete Knowledge Khaled El Emam & Luk
  • 122. Anonymizing Health Data State Inpatient Database (SID) of California Khaled El Emam & Luk
  • 123. Anonymizing Health Data State Inpatient Database (SID) of California Khaled El Emam & Luk Researcher Ronnie wants public data!
  • 124. Anonymizing Health Data State Inpatient Database (SID) of California Khaled El Emam & Luk Researcher Ronnie wants public data!
  • 125. Anonymizing Health Data State Inpatient Database (SID) of California Khaled El Emam & Luk
  • 126. Anonymizing Health Data Measuring Risk Under Plausible Attacks Khaled El Emam & Luk
  • 127. Anonymizing Health Data T1:Deliberate Attempt Measuring Risk Under Plausible Attacks Khaled El Emam & Luk T2: Inadvertent Attempt (“Holly Smokes, I know her!”) T3: Data Breach (“data gone wild”) T4: Public Data (demonstration attack) Pr(re-id) ≤ 0.09 (maximum risk)
  • 128. Anonymizing Health Data De-identifying the Data Set Khaled El Emam & Luk
  • 129. Anonymizing Health Data De-identifying the Data Set Khaled El Emam & Luk BirthYear in 5-yy (cut at 1910-); AdmissionYear unchanged; DaysSinceLastService in 28-dd (cut at 7-, 182+); LengthOfStay same as DaysSinceLastService.
  • 130. Anonymizing Health Data De-identifying the Data Set Khaled El Emam & Luk BirthYear in 5-yy (cut at 1910-); AdmissionYear unchanged; DaysSinceLastService in 28-dd (cut at 7-, 182+); LengthOfStay same as DaysSinceLastService.
  • 131. Anonymizing Health Data Connected Variables Khaled El Emam & Luk
  • 132. Anonymizing Health Data Connected Variables Khaled El Emam & Luk QI to QI
  • 133. Anonymizing Health Data Connected Variables Khaled El Emam & Luk QI to QI Similar QI? Same generalization and suppression.
  • 134. Anonymizing Health Data Connected Variables Khaled El Emam & Luk QI to QI Similar QI? Same generalization and suppression. QI to non-QI
  • 135. Anonymizing Health Data Connected Variables Khaled El Emam & Luk QI to QI Similar QI? Same generalization and suppression. QI to non-QI Non-QI is revealing? Same suppression so both are removed.
  • 136. Anonymizing Health Data Other Issues Regarding Longitudinal Data Khaled El Emam & Luk
  • 137. Anonymizing Health Data Other Issues Regarding Longitudinal Data Khaled El Emam & Luk Date shifting—maintaining order of records.
  • 138. Anonymizing Health Data Other Issues Regarding Longitudinal Data Khaled El Emam & Luk Date shifting—maintaining order of records. Long tails—truncation of records.
  • 139. Anonymizing Health Data Other Issues Regarding Longitudinal Data Khaled El Emam & Luk Date shifting—maintaining order of records. Long tails—truncation of records. Adversary power—assumption of knowledge.
  • 140. Anonymizing Health Data Other Concerns to Think About Khaled El Emam & Luk
  • 141. Anonymizing Health Data Other Concerns to Think About Khaled El Emam & Luk Free-form text—anonymization.
  • 142. Anonymizing Health Data Other Concerns to Think About Khaled El Emam & Luk Free-form text—anonymization. Geospatial information—aggregation and geoproxy risk.
  • 143. Anonymizing Health Data Other Concerns to Think About Khaled El Emam & Luk Free-form text—anonymization. Geospatial information—aggregation and geoproxy risk. Medical codes—generalization, suppression, shuffling (yes, as in cards).
  • 144. Anonymizing Health Data Other Concerns to Think About Khaled El Emam & Luk Free-form text—anonymization. Geospatial information—aggregation and geoproxy risk. Medical codes—generalization, suppression, shuffling (yes, as in cards). Secure linking—linking data through encryption before anonymization.
  • 145. Anonymizing Health Data Part 3 of Webcast: Questions and Answers Khaled El Emam & Luk
  • 146. Anonymizing Health Data Khaled El Emam & Luk More Comments or Questions: Contact us!
  • 147. Anonymizing Health Data Khaled El Emam & Luk Khaled El Emam: kelemam@privacyanalytics.ca Luk Arbuckle: larbuckle@privacyanalytics.ca More Comments or Questions: Contact us!

Hinweis der Redaktion

  1. A risk-based methodology is consistent with contemporary standards from regulators and governments, and is the approach we present in our book.
  2. This is where things get heavy. We’ll start with some basic principles.
  3. The Goldilocks Principle: the trade-off between perfect data and perfect privacy.
  4. We use masking for direct identifiers, and de-identification for indirect identifiers.
  5. Masking
  6. De-identification
  7. Yahoo!
  8. From a regulatory perspective, it’s important to document the process that was used to de-identify the data set, as well as the results of enacting that process.
  9. From a regulatory perspective, it’s important to document the process that was used to de-identify the data set, as well as the results of enacting that process.
  10. From a regulatory perspective, it’s important to document the process that was used to de-identify the data set, as well as the results of enacting that process.
  11. The probability of anattack will depend on the controls in place to manage the data (mitigating controls).
  12. On average people tend to have 150 friends. This is called the Dunbar number.
  13. Based on recent credible evidence, we know that approximately 27% of providers that are supposed to follow the HIPAA Security Rule have a reportable breach every year.
  14. We assume that there is an adversary who has background information that can be used to launch an attack.
  15. So we can measure risk under plausible attacks, but how to we set an overall risk threshold?
  16. Max risk is based on the record that has the highest probability of re-identification; average risk when the adversary is trying to re-identify someone they know or all everyone in data set.
  17. To set the threshold, we can look at the sensitivity of the data and the consent mechanism that was in place (invasion of privacy).
  18. The data he wants...
  19. The data he wants...
  20. Based on detailed risk assessment.
  21. Worse case is 2008, prevalence of 0.027.
  22. 150/2 friends because only women considered.
  23. K=11
  24. Approximate complete knowledge
  25. Approximate complete knowledge
  26. Approximate complete knowledge
  27. Approximate complete knowledge
  28. Approximate complete knowledge
  29. Approximate complete knowledge
  30. Approximate complete knowledge
  31. Approximate complete knowledge
  32. Approximate complete knowledge
  33. Approximate complete knowledge