SlideShare ist ein Scribd-Unternehmen logo
1 von 14
Editorial responsibilities arising
from personalisation algorithms
Ansgar Koene, Elvira Perez Vallejos, Helena Webb,
Menisha Patel, Sofia Ceppi, Marina Jirotka and Derek
McAuley
ETHICOMP
Torino, 8th June 2017
http://unbias.wp.horizon.ac.uk/
Personalisation
2
http://www.smartinsights.com/
Personalisation Algorithms (PAs)
• Personalisation Algorithms (PAs) ensure the content
presented to the user is relevant and engaging
• PAs are designed to prioritise and make some information
more visible than others
• However, there is no transparency in the criteria used for
ranking this information
• What are the consequences on users?
• Limiting exposure to attitude-challenging information
• Intellectual isolation
• Filter bubble/Echo Chambers effect
• Personal agency
3
Good information service = good filtering
4
Algorithms in the news
5
User understanding of social media algorithms:
Facebook News Feed
6
Of 40 interviewed participants more than 60% of
Facebook users are entirely unaware of any algorithmic
curation on Facebook at all: “They believed every single
story from their friends and followed pages appeared in
their news feed”.
Published at: CHI 2015
How do the algorithms work?
7
PAs algorithms usually identify
personalised interests patterns
based on assumptions about user
behaviour (time/topic)
Positioning effect in NewsFeed
E. Bakshy, S. Medding & L.A. Adamic, “Exposure to ideologically diverse news and opinion on Facebook” Science, 348, 1130-1132, 2015
8
Personalised recommendations
• Content based– similarity to past results the user liked
• Collaborative filtering – results that similar users liked (people
with statistically similar tastes/interests)
• Community based – results that people in the same social
network liked
(people who are linked on a social network e.g. ‘friends’)
9
Editorial responsibility… who? Me?
10
We do not
alter content We just
reshape
content
We are a
technological
company
We are NOT a media
company and therefore
we do not hold editorial
responsibility
What about Responsible Research and
Innovation (RRI)?
• Due to their global reach and potential to promote the exercise
and enjoyment of human rights and fundamental freedoms,
social media companies have to arbitrate on the balance
between:
• Public interest vs. Personal privacy (e.g., the right to be forgotten)
• Rights of freedom of expression vs. Protection of harm (e.g. hate
speech)
• Accordingly Social Media platforms should take editorial-like
responsibility towards the public and adopt a code of ethics to
promote corporate social responsibility and a healthy
democratic discourse
• Including concepts such as public interest in their
optimisation algorithms
• This would imply applying principles of RRI and the
development of mutual learning via multi-stakeholder
involvement 11
Responsible Editorial Approach
• Ethical obligation to serve the public interest is based
on trusteeship, where policy makers and media
organisations apply normative principles of social
responsibility
• By contrast, social media platforms exhibit a
marketplace approach
• The platform enables an environment in which users take
responsibility when signing T&C
• In 2012 the Reuters Institute for the Study of
Journalism found that digital intermediaries act as
gatekeepers who exert editorial-like judgements:
• Content ranking manipulates information accessibility
• Lack of transparency to define relevance of content
12
To conclude
• In keeping with:
• ACM Principles of Algorithmic Transparency and
Accountability
• IEEE Vision for Prioritising Human Wellbeing with AI and
Autonomous Systems
• 2012 recommendation of the Council of Europe on the
protection of human rights with regard to social
networking services
SOCIAL MEDIA PLATFORMS SHOULD BE ACCOUNTABLE
FOR THE EDITORIAL-LIKE CONTROL EXERTED BY THEIR PAs
ON THE CONTENT VISIBILITY EXPERIENCED BY USERS
13
EPSRC funded UnBias project
14
http://unbias.wp.horizon.ac.uk/

Weitere ähnliche Inhalte

Was ist angesagt?

Intelclinic - NeuroOn
Intelclinic - NeuroOnIntelclinic - NeuroOn
Intelclinic - NeuroOn
Intelclinic
 

Was ist angesagt? (20)

Algorithmically Mediated Online Inforamtion Access workshop at WebSci17
Algorithmically Mediated Online Inforamtion Access workshop at WebSci17Algorithmically Mediated Online Inforamtion Access workshop at WebSci17
Algorithmically Mediated Online Inforamtion Access workshop at WebSci17
 
TRILcon'17 confernece workshop presentation on UnBias stakeholder engagement
TRILcon'17 confernece workshop presentation on UnBias stakeholder engagementTRILcon'17 confernece workshop presentation on UnBias stakeholder engagement
TRILcon'17 confernece workshop presentation on UnBias stakeholder engagement
 
iConference 2018 BIAS workshop keynote
iConference 2018 BIAS workshop keynoteiConference 2018 BIAS workshop keynote
iConference 2018 BIAS workshop keynote
 
Bias in algorithmic decision-making: Standards, Algorithmic Literacy and Gove...
Bias in algorithmic decision-making: Standards, Algorithmic Literacy and Gove...Bias in algorithmic decision-making: Standards, Algorithmic Literacy and Gove...
Bias in algorithmic decision-making: Standards, Algorithmic Literacy and Gove...
 
Young people's policy recommendations on algorithm fairness web sci17
Young people's policy recommendations on algorithm fairness web sci17Young people's policy recommendations on algorithm fairness web sci17
Young people's policy recommendations on algorithm fairness web sci17
 
IEEE P7003 at ICSE Fairware 2018
IEEE P7003 at ICSE Fairware 2018IEEE P7003 at ICSE Fairware 2018
IEEE P7003 at ICSE Fairware 2018
 
The Age of Algorithms
The Age of AlgorithmsThe Age of Algorithms
The Age of Algorithms
 
Ansgar rcep algorithmic_bias_july2018
Ansgar rcep algorithmic_bias_july2018Ansgar rcep algorithmic_bias_july2018
Ansgar rcep algorithmic_bias_july2018
 
A koene humaint_march2018
A koene humaint_march2018A koene humaint_march2018
A koene humaint_march2018
 
What is AI?
What is AI?What is AI?
What is AI?
 
Taming AI Engineering Ethics and Policy
Taming AI Engineering Ethics and PolicyTaming AI Engineering Ethics and Policy
Taming AI Engineering Ethics and Policy
 
are algorithms really a black box
are algorithms really a black boxare algorithms really a black box
are algorithms really a black box
 
A koene intersectionality_algorithmic_discrimination_dec2017
A koene intersectionality_algorithmic_discrimination_dec2017A koene intersectionality_algorithmic_discrimination_dec2017
A koene intersectionality_algorithmic_discrimination_dec2017
 
Aspa ai webinar
Aspa   ai webinarAspa   ai webinar
Aspa ai webinar
 
20190423 PRiSE model to tackle data protection impact assessments and data pr...
20190423 PRiSE model to tackle data protection impact assessments and data pr...20190423 PRiSE model to tackle data protection impact assessments and data pr...
20190423 PRiSE model to tackle data protection impact assessments and data pr...
 
Model bias in AI
Model bias in AIModel bias in AI
Model bias in AI
 
Racial and gender bias in AI
Racial and gender bias in AI Racial and gender bias in AI
Racial and gender bias in AI
 
AAMAS-2017 8-12 May, 2017, Sao Paulo, Brazil
AAMAS-2017 8-12 May, 2017, Sao Paulo, BrazilAAMAS-2017 8-12 May, 2017, Sao Paulo, Brazil
AAMAS-2017 8-12 May, 2017, Sao Paulo, Brazil
 
Intelclinic - NeuroOn
Intelclinic - NeuroOnIntelclinic - NeuroOn
Intelclinic - NeuroOn
 
Auditing search engines for differential satisfaction across demographics
Auditing search engines for differential satisfaction across demographicsAuditing search engines for differential satisfaction across demographics
Auditing search engines for differential satisfaction across demographics
 

Ähnlich wie Editorial responsibilities arising from personalisation algorithms

Building a CHC Social Media Policy/Guide - London InterCommunity Health Centre
Building a CHC Social Media Policy/Guide - London InterCommunity Health CentreBuilding a CHC Social Media Policy/Guide - London InterCommunity Health Centre
Building a CHC Social Media Policy/Guide - London InterCommunity Health Centre
cachc
 
Ethics and social media
Ethics and social mediaEthics and social media
Ethics and social media
kmtj1979
 
The power of social media in marketing and public relations
The power of social media in marketing and public relationsThe power of social media in marketing and public relations
The power of social media in marketing and public relations
Curtis Rogers, MLIS, EdD
 
Open Cambodia 2014 Invite
Open Cambodia 2014 InviteOpen Cambodia 2014 Invite
Open Cambodia 2014 Invite
John Weeks
 
Social Networking, Online Communities and Clinical Research
Social Networking, Online Communities and Clinical ResearchSocial Networking, Online Communities and Clinical Research
Social Networking, Online Communities and Clinical Research
Colleen Young
 
Social Media Workshop, postgraduate
Social Media Workshop, postgraduateSocial Media Workshop, postgraduate
Social Media Workshop, postgraduate
Christie Barakat
 

Ähnlich wie Editorial responsibilities arising from personalisation algorithms (20)

Com class
Com classCom class
Com class
 
Neias june 16 2010
Neias june 16 2010Neias june 16 2010
Neias june 16 2010
 
Engaging Youth & Young Adults in Social Media
Engaging Youth & Young Adults in Social MediaEngaging Youth & Young Adults in Social Media
Engaging Youth & Young Adults in Social Media
 
Ethics and Social Media
Ethics and Social MediaEthics and Social Media
Ethics and Social Media
 
Building a CHC Social Media Policy/Guide - London InterCommunity Health Centre
Building a CHC Social Media Policy/Guide - London InterCommunity Health CentreBuilding a CHC Social Media Policy/Guide - London InterCommunity Health Centre
Building a CHC Social Media Policy/Guide - London InterCommunity Health Centre
 
How to engage in 140 character or less #suicideprevention
How to engage in 140 character or less #suicidepreventionHow to engage in 140 character or less #suicideprevention
How to engage in 140 character or less #suicideprevention
 
Ethics and social media
Ethics and social mediaEthics and social media
Ethics and social media
 
The power of social media in marketing and public relations
The power of social media in marketing and public relationsThe power of social media in marketing and public relations
The power of social media in marketing and public relations
 
Open Cambodia 2014 Invite
Open Cambodia 2014 InviteOpen Cambodia 2014 Invite
Open Cambodia 2014 Invite
 
Social media ethical issues jotham wasike
Social media ethical issues   jotham wasikeSocial media ethical issues   jotham wasike
Social media ethical issues jotham wasike
 
The Roles of Social Networks In Knowledge Management
The Roles of Social Networks In Knowledge ManagementThe Roles of Social Networks In Knowledge Management
The Roles of Social Networks In Knowledge Management
 
Analisis media sosial harisa mardiana
Analisis media sosial harisa mardianaAnalisis media sosial harisa mardiana
Analisis media sosial harisa mardiana
 
Analisis media sosial harisa mardiana
Analisis media sosial harisa mardianaAnalisis media sosial harisa mardiana
Analisis media sosial harisa mardiana
 
Social Networking, Online Communities and Clinical Research
Social Networking, Online Communities and Clinical ResearchSocial Networking, Online Communities and Clinical Research
Social Networking, Online Communities and Clinical Research
 
You Said What About Us on Facebook?
You Said What About Us on Facebook?You Said What About Us on Facebook?
You Said What About Us on Facebook?
 
Social Media and International Organizations
Social Media and International OrganizationsSocial Media and International Organizations
Social Media and International Organizations
 
Corporate Communication
Corporate CommunicationCorporate Communication
Corporate Communication
 
Social Networking, Online Communities & Research - WCHRI Rounds
Social Networking, Online Communities & Research - WCHRI RoundsSocial Networking, Online Communities & Research - WCHRI Rounds
Social Networking, Online Communities & Research - WCHRI Rounds
 
WAPWG 16_jan_ethicsoverview
WAPWG 16_jan_ethicsoverviewWAPWG 16_jan_ethicsoverview
WAPWG 16_jan_ethicsoverview
 
Social Media Workshop, postgraduate
Social Media Workshop, postgraduateSocial Media Workshop, postgraduate
Social Media Workshop, postgraduate
 

Mehr von Ansgar Koene

Mehr von Ansgar Koene (9)

AI Governance and Ethics - Industry Standards
AI Governance and Ethics - Industry StandardsAI Governance and Ethics - Industry Standards
AI Governance and Ethics - Industry Standards
 
Industry Standards as vehicle to address socio-technical AI challenges
Industry Standards as vehicle to address socio-technical AI challengesIndustry Standards as vehicle to address socio-technical AI challenges
Industry Standards as vehicle to address socio-technical AI challenges
 
A koene governance_framework_algorithmicaccountabilitytransparency_october2018
A koene governance_framework_algorithmicaccountabilitytransparency_october2018A koene governance_framework_algorithmicaccountabilitytransparency_october2018
A koene governance_framework_algorithmicaccountabilitytransparency_october2018
 
IEEE P7003 Algorithmic Bias Considerations
IEEE P7003 Algorithmic Bias ConsiderationsIEEE P7003 Algorithmic Bias Considerations
IEEE P7003 Algorithmic Bias Considerations
 
A koene ai_in_command_control
A koene ai_in_command_controlA koene ai_in_command_control
A koene ai_in_command_control
 
A koene Rebooting The Expert Petcha Kutcha 2017
A koene Rebooting The Expert Petcha Kutcha 2017A koene Rebooting The Expert Petcha Kutcha 2017
A koene Rebooting The Expert Petcha Kutcha 2017
 
Internet Society (ISOC Uk England) Webinar on User Trust
Internet Society (ISOC Uk England) Webinar on User TrustInternet Society (ISOC Uk England) Webinar on User Trust
Internet Society (ISOC Uk England) Webinar on User Trust
 
Gada CaSMa oxford connected life oxcl16
Gada CaSMa oxford connected life oxcl16Gada CaSMa oxford connected life oxcl16
Gada CaSMa oxford connected life oxcl16
 
Ass a koene_ca_sma
Ass a koene_ca_smaAss a koene_ca_sma
Ass a koene_ca_sma
 

Kürzlich hochgeladen

Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
PirithiRaju
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Digital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptxDigital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptx
MohamedFarag457087
 
The Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptxThe Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptx
seri bangash
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Sérgio Sacani
 

Kürzlich hochgeladen (20)

Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
 
Zoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfZoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdf
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
 
Introduction to Viruses
Introduction to VirusesIntroduction to Viruses
Introduction to Viruses
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Digital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptxDigital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptx
 
The Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptxThe Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptx
 
Molecular markers- RFLP, RAPD, AFLP, SNP etc.
Molecular markers- RFLP, RAPD, AFLP, SNP etc.Molecular markers- RFLP, RAPD, AFLP, SNP etc.
Molecular markers- RFLP, RAPD, AFLP, SNP etc.
 
Clean In Place(CIP).pptx .
Clean In Place(CIP).pptx                 .Clean In Place(CIP).pptx                 .
Clean In Place(CIP).pptx .
 
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort ServiceCall Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
 
Factory Acceptance Test( FAT).pptx .
Factory Acceptance Test( FAT).pptx       .Factory Acceptance Test( FAT).pptx       .
Factory Acceptance Test( FAT).pptx .
 
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
 
COST ESTIMATION FOR A RESEARCH PROJECT.pptx
COST ESTIMATION FOR A RESEARCH PROJECT.pptxCOST ESTIMATION FOR A RESEARCH PROJECT.pptx
COST ESTIMATION FOR A RESEARCH PROJECT.pptx
 
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 60009654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
 
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit flypumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
 
module for grade 9 for distance learning
module for grade 9 for distance learningmodule for grade 9 for distance learning
module for grade 9 for distance learning
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
 

Editorial responsibilities arising from personalisation algorithms

  • 1. Editorial responsibilities arising from personalisation algorithms Ansgar Koene, Elvira Perez Vallejos, Helena Webb, Menisha Patel, Sofia Ceppi, Marina Jirotka and Derek McAuley ETHICOMP Torino, 8th June 2017 http://unbias.wp.horizon.ac.uk/
  • 3. Personalisation Algorithms (PAs) • Personalisation Algorithms (PAs) ensure the content presented to the user is relevant and engaging • PAs are designed to prioritise and make some information more visible than others • However, there is no transparency in the criteria used for ranking this information • What are the consequences on users? • Limiting exposure to attitude-challenging information • Intellectual isolation • Filter bubble/Echo Chambers effect • Personal agency 3
  • 4. Good information service = good filtering 4
  • 6. User understanding of social media algorithms: Facebook News Feed 6 Of 40 interviewed participants more than 60% of Facebook users are entirely unaware of any algorithmic curation on Facebook at all: “They believed every single story from their friends and followed pages appeared in their news feed”. Published at: CHI 2015
  • 7. How do the algorithms work? 7 PAs algorithms usually identify personalised interests patterns based on assumptions about user behaviour (time/topic)
  • 8. Positioning effect in NewsFeed E. Bakshy, S. Medding & L.A. Adamic, “Exposure to ideologically diverse news and opinion on Facebook” Science, 348, 1130-1132, 2015 8
  • 9. Personalised recommendations • Content based– similarity to past results the user liked • Collaborative filtering – results that similar users liked (people with statistically similar tastes/interests) • Community based – results that people in the same social network liked (people who are linked on a social network e.g. ‘friends’) 9
  • 10. Editorial responsibility… who? Me? 10 We do not alter content We just reshape content We are a technological company We are NOT a media company and therefore we do not hold editorial responsibility
  • 11. What about Responsible Research and Innovation (RRI)? • Due to their global reach and potential to promote the exercise and enjoyment of human rights and fundamental freedoms, social media companies have to arbitrate on the balance between: • Public interest vs. Personal privacy (e.g., the right to be forgotten) • Rights of freedom of expression vs. Protection of harm (e.g. hate speech) • Accordingly Social Media platforms should take editorial-like responsibility towards the public and adopt a code of ethics to promote corporate social responsibility and a healthy democratic discourse • Including concepts such as public interest in their optimisation algorithms • This would imply applying principles of RRI and the development of mutual learning via multi-stakeholder involvement 11
  • 12. Responsible Editorial Approach • Ethical obligation to serve the public interest is based on trusteeship, where policy makers and media organisations apply normative principles of social responsibility • By contrast, social media platforms exhibit a marketplace approach • The platform enables an environment in which users take responsibility when signing T&C • In 2012 the Reuters Institute for the Study of Journalism found that digital intermediaries act as gatekeepers who exert editorial-like judgements: • Content ranking manipulates information accessibility • Lack of transparency to define relevance of content 12
  • 13. To conclude • In keeping with: • ACM Principles of Algorithmic Transparency and Accountability • IEEE Vision for Prioritising Human Wellbeing with AI and Autonomous Systems • 2012 recommendation of the Council of Europe on the protection of human rights with regard to social networking services SOCIAL MEDIA PLATFORMS SHOULD BE ACCOUNTABLE FOR THE EDITORIAL-LIKE CONTROL EXERTED BY THEIR PAs ON THE CONTENT VISIBILITY EXPERIENCED BY USERS 13
  • 14. EPSRC funded UnBias project 14 http://unbias.wp.horizon.ac.uk/