SlideShare ist ein Scribd-Unternehmen logo
1 von 19
Downloaden Sie, um offline zu lesen
Crowd Science:
Measurement, Models, and Methods
John Prpić & Prashant Shukla
HICSS 2016
 Overview of the Field
 Research Goals
 Theoretical Grounding
 Toward Crowd Science
 Discussion
The Grand aim of science is to cover the greatest number of experimental facts by
logical deduction from the smallest number of hypotheses or actions.
- Albert Einstein.
Agenda
2
 Crowdsourcing - Crowdflower, Wikipedia, TopCoder,
 Citizen Science - GalaxyZoo, Foldit, Zooniverse,
 Crowdfunding - Kickstarter, Indiegogo, Kiva,
 Open Innovation Platforms - Kaggle, Innocentive, Challenge.gov,
 Sharing Economy - AirBnB, Uber, Lyft,
 Public Sector - IPaidaBribe, FixMyStreet, Open Ministry,
IT-Mediated Crowds – Practice
3
 Human Computation - (Ipeirotis, Michelucci, von Ahn)
 Open Collaboration - (Benkler, Majchrzak, Mako-Hill)
 Ideas Competitions - (Afuah, Boudreau, Lakhani)
 Citizen Science - (Cooper, Crowston, Meier)
 Crowdfunding - (Agrawal, Burtch, Mollick)
 Public Sector - (Aitamurto, Brabham, Noveck)
IT-Mediated Crowds – Research
4
 We’re observing increased research and practice on
organizations using IT to connect with dispersed individuals for
explicit resource creation purposes.
 This state of affairs precipitates the need to precisely measure
the processes and benefits of these activities over myriad
different implementations.
Research Motivation
5
 We seek to address these salient and non-trivial considerations
by laying a foundation of:
 Theory,
 Measures,
 Research methods,
 That allow us to test Crowd-engagement efficacy across
organizations, industries, technologies, and geographies.
Research Goals
6
The Theory of Crowd Capital (Prpić & Shukla 2013; 2014)
Dispersed Knowledge (Hayek 1945)
Every individual has private knowledge that is useful, but cannot be accessed.
Crowd Capability
The IT structure, form of content, and internal processes through which an organization engages a Crowd.
Crowd Capital
A heterogeneous organizational resource generated from IT-mediated Crowds.
Theoretical Grounding
7
Dispersed
Knowledge
Crowd
Capability
Crowd Capital
IT Structure
Crowd-engaging IT is found in Episodic or Collaborative forms, distinguished by
whether the individuals in a Crowd interact with one another or not, through the IT
(Prpić & Shukla 2013; 2014).
Theoretical Grounding
8
Theoretical Grounding
9
Typology of Crowd-derived content & Organizational processing
methods (Prpić, Shukla, Kietzmann & McCarthy 2015)
Theoretical Grounding
10
Comparison of Common Characteristics of Crowdsourcing Techniques
(Prpić, Taeihagh & Melton 2015)
 An empirical apparatus that considers counterfactuals in ascertaining
the benefits of various implementations of IT-mediated Crowds.
 Currently, to test hypotheses about the benefits of using IT-mediated
Crowds, researchers use data from a single Crowdsourcing,
Crowdfunding, Open innovation platform.
 Need to consider counterfactuals.
 Can’t quantify the benefits of using Crowds otherwise.
 Can’t generalize, can’t predict.
 Can’t move toward a science of IT-mediated Crowds.
Toward Crowd Science
11
Counterfactuals
 If the use of IT-mediated Crowds is the treatment, we need to measure the
difference between the treatment and control group, before and after
implementing a Crowd.
Toward Crowd Science:
Counterfactuals
12
Operationalization
 Measures of processes and benefits across a variety of IT-mediated Crowds
implemented.
Toward Crowd Science:
Operationalizations
13
Experiments
 Randomly select organizations/units seeking specific and similar resources from
IT-mediated Crowds.
 Observe how they do with respect to Crowd Capital generation relative to the
control group over a period of time.
Toward Crowd Science: Methods
14
Meta-Analysis
 Focus on quantitative meta analysis that accumulates the evidence from the
extant hypothesis testing endeavors in the field.
 Revolves around collection of effect sizes/coefficients and applications of
procedures such as meta analytic regression analysis (MARA) and
homogeneity analysis (HOMA).
Toward Crowd Science: Methods
15
Natural Experiments
 Difference-in-differences techniques.
Toward Crowd Science: Methods
16
 Unprecedented shocks to knowledge production function
 Unprecedented on-demand scale of human participation.
 Unprecedented on-demand speed and aggregation of human effort.
 Unprecedented on-demand access to human knowledge.
 New outcomes & new configurations of socio-technical systems.
Why we need Crowd Science
17
The Grand aim of science is to cover the greatest number
of experimental facts by logical deduction from the
smallest number of hypotheses or actions.
- Albert Einstein.
 Are we moving toward more perfect information through Crowd
Science?
 Can Crowd Science optimize stewardship of common-pool resources?
 Crowd vs. Market vs. Firm?
 AI, IoT, Machine Learning, with Crowds?
Crowd Science: Open Questions
18
Twitter:
 @JPnuggets
 @Prashshukla
Blogs:
 phdinstrategicmanagement.wordpress.com
 creativecommodum.com
Thank You!
19

Weitere ähnliche Inhalte

Andere mochten auch

Blockchain: a Game-Changing Technology
Blockchain: a Game-Changing TechnologyBlockchain: a Game-Changing Technology
Blockchain: a Game-Changing TechnologyCrowdsourcing Week
 
One does not simply crowdsource the Semantic Web
One does not simply crowdsource the Semantic WebOne does not simply crowdsource the Semantic Web
One does not simply crowdsource the Semantic WebElena Simperl
 
Unpacking the Geography of Crowd Capital
Unpacking the Geography of Crowd CapitalUnpacking the Geography of Crowd Capital
Unpacking the Geography of Crowd CapitalYannig Roth
 
How to work a crowd: Developing crowd capital through crowdsourcing
How to work a crowd: Developing crowd capital through crowdsourcingHow to work a crowd: Developing crowd capital through crowdsourcing
How to work a crowd: Developing crowd capital through crowdsourcingIan McCarthy
 
The Role of Design in Crowdsourcing
The Role of Design in CrowdsourcingThe Role of Design in Crowdsourcing
The Role of Design in CrowdsourcingCrowdsourcing Week
 
Your Neighborhood is your University
Your Neighborhood is your UniversityYour Neighborhood is your University
Your Neighborhood is your UniversityCrowdsourcing Week
 
Future of Crowdsourcing: Creation to Curation, Search to Synthesis, Content t...
Future of Crowdsourcing: Creation to Curation, Search to Synthesis, Content t...Future of Crowdsourcing: Creation to Curation, Search to Synthesis, Content t...
Future of Crowdsourcing: Creation to Curation, Search to Synthesis, Content t...Gaurav Mishra
 
An evolutionary approach to understanding adaptive organizational resilience
An evolutionary approach to understanding adaptive organizational resilienceAn evolutionary approach to understanding adaptive organizational resilience
An evolutionary approach to understanding adaptive organizational resilienceIan McCarthy
 
Crowdsourcing challenges and opportunities 2012
Crowdsourcing challenges and opportunities 2012Crowdsourcing challenges and opportunities 2012
Crowdsourcing challenges and opportunities 2012xin wang
 

Andere mochten auch (11)

Blockchain: a Game-Changing Technology
Blockchain: a Game-Changing TechnologyBlockchain: a Game-Changing Technology
Blockchain: a Game-Changing Technology
 
One does not simply crowdsource the Semantic Web
One does not simply crowdsource the Semantic WebOne does not simply crowdsource the Semantic Web
One does not simply crowdsource the Semantic Web
 
Unpacking the Geography of Crowd Capital
Unpacking the Geography of Crowd CapitalUnpacking the Geography of Crowd Capital
Unpacking the Geography of Crowd Capital
 
Crowdsourcing Democracy
Crowdsourcing DemocracyCrowdsourcing Democracy
Crowdsourcing Democracy
 
How to work a crowd: Developing crowd capital through crowdsourcing
How to work a crowd: Developing crowd capital through crowdsourcingHow to work a crowd: Developing crowd capital through crowdsourcing
How to work a crowd: Developing crowd capital through crowdsourcing
 
The Role of Design in Crowdsourcing
The Role of Design in CrowdsourcingThe Role of Design in Crowdsourcing
The Role of Design in Crowdsourcing
 
Your Neighborhood is your University
Your Neighborhood is your UniversityYour Neighborhood is your University
Your Neighborhood is your University
 
Future of Crowdsourcing: Creation to Curation, Search to Synthesis, Content t...
Future of Crowdsourcing: Creation to Curation, Search to Synthesis, Content t...Future of Crowdsourcing: Creation to Curation, Search to Synthesis, Content t...
Future of Crowdsourcing: Creation to Curation, Search to Synthesis, Content t...
 
An evolutionary approach to understanding adaptive organizational resilience
An evolutionary approach to understanding adaptive organizational resilienceAn evolutionary approach to understanding adaptive organizational resilience
An evolutionary approach to understanding adaptive organizational resilience
 
Crowdsourcing challenges and opportunities 2012
Crowdsourcing challenges and opportunities 2012Crowdsourcing challenges and opportunities 2012
Crowdsourcing challenges and opportunities 2012
 
Crowdsourcing
CrowdsourcingCrowdsourcing
Crowdsourcing
 

Ähnlich wie Crowd Science: Measurements, Models, and Methods

Smart Data - How you and I will exploit Big Data for personalized digital hea...
Smart Data - How you and I will exploit Big Data for personalized digital hea...Smart Data - How you and I will exploit Big Data for personalized digital hea...
Smart Data - How you and I will exploit Big Data for personalized digital hea...Amit Sheth
 
WSI Stimulus Project: Centre for longitudinal studies of online citizen parti...
WSI Stimulus Project: Centre for longitudinal studies of online citizen parti...WSI Stimulus Project: Centre for longitudinal studies of online citizen parti...
WSI Stimulus Project: Centre for longitudinal studies of online citizen parti...Ramine Tinati
 
HUMAN RIGHTS IN THE AGE OF ARTIFICIAL INTELLIGENCE
HUMAN RIGHTS IN THE AGE OF ARTIFICIAL INTELLIGENCEHUMAN RIGHTS IN THE AGE OF ARTIFICIAL INTELLIGENCE
HUMAN RIGHTS IN THE AGE OF ARTIFICIAL INTELLIGENCEeraser Juan José Calderón
 
A Framework for Policy Crowdsourcing - Oxford IPP 2014
A Framework for Policy Crowdsourcing - Oxford IPP 2014A Framework for Policy Crowdsourcing - Oxford IPP 2014
A Framework for Policy Crowdsourcing - Oxford IPP 2014Araz Taeihagh
 
New and Emerging Forms of Data
New and Emerging Forms of DataNew and Emerging Forms of Data
New and Emerging Forms of DataDavid De Roure
 
Factors that influence an organization’s decision to adopt crowdsourcing: A r...
Factors that influence an organization’s decision to adopt crowdsourcing: A r...Factors that influence an organization’s decision to adopt crowdsourcing: A r...
Factors that influence an organization’s decision to adopt crowdsourcing: A r...donellemckinley
 
An initial exploration of Citizen Science
An initial exploration of Citizen ScienceAn initial exploration of Citizen Science
An initial exploration of Citizen ScienceNiamh O Riordan
 
Crowdsourcing Approaches for Smart City Open Data Management
Crowdsourcing Approaches for Smart City Open Data ManagementCrowdsourcing Approaches for Smart City Open Data Management
Crowdsourcing Approaches for Smart City Open Data ManagementEdward Curry
 
TRANSFORMING BIG DATA INTO SMART DATA: Deriving Value via Harnessing Volume, ...
TRANSFORMING BIG DATA INTO SMART DATA: Deriving Value via Harnessing Volume, ...TRANSFORMING BIG DATA INTO SMART DATA: Deriving Value via Harnessing Volume, ...
TRANSFORMING BIG DATA INTO SMART DATA: Deriving Value via Harnessing Volume, ...Amit Sheth
 
Crowdsourcing as a problem solving strategy
Crowdsourcing as a problem solving strategyCrowdsourcing as a problem solving strategy
Crowdsourcing as a problem solving strategyMiia Kosonen
 
Ii 05. wp8 dti lodz.poland june 2014
Ii 05. wp8 dti lodz.poland june 2014Ii 05. wp8 dti lodz.poland june 2014
Ii 05. wp8 dti lodz.poland june 2014Maciej Szczepańczyk
 
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...IOSR Journals
 
AI WORLD: I-World: EIS Global Innovation Platform: BIG Knowledge World vs. BI...
AI WORLD: I-World: EIS Global Innovation Platform: BIG Knowledge World vs. BI...AI WORLD: I-World: EIS Global Innovation Platform: BIG Knowledge World vs. BI...
AI WORLD: I-World: EIS Global Innovation Platform: BIG Knowledge World vs. BI...Azamat Abdoullaev
 
Rise of Crowd Computing (December 2012)
Rise of Crowd Computing (December 2012)Rise of Crowd Computing (December 2012)
Rise of Crowd Computing (December 2012)Matthew Lease
 
Data Science definition
Data Science definitionData Science definition
Data Science definitionCarloLauro1
 
Let's talk about Data Science
Let's talk about Data ScienceLet's talk about Data Science
Let's talk about Data ScienceCarlo Lauro
 
Analíticas del aprendizaje: una perspectiva crítica
Analíticas del aprendizaje: una perspectiva críticaAnalíticas del aprendizaje: una perspectiva crítica
Analíticas del aprendizaje: una perspectiva críticaCENT
 
PatternLanguageOfData
PatternLanguageOfDataPatternLanguageOfData
PatternLanguageOfDatakimErwin
 
Technology in the Wild: Dynamics and Uncertainty in Field Experiments, Vietnam
Technology in the Wild: Dynamics and Uncertainty in Field Experiments, VietnamTechnology in the Wild: Dynamics and Uncertainty in Field Experiments, Vietnam
Technology in the Wild: Dynamics and Uncertainty in Field Experiments, VietnamBenCorrigan
 

Ähnlich wie Crowd Science: Measurements, Models, and Methods (20)

Smart Data - How you and I will exploit Big Data for personalized digital hea...
Smart Data - How you and I will exploit Big Data for personalized digital hea...Smart Data - How you and I will exploit Big Data for personalized digital hea...
Smart Data - How you and I will exploit Big Data for personalized digital hea...
 
WSI Stimulus Project: Centre for longitudinal studies of online citizen parti...
WSI Stimulus Project: Centre for longitudinal studies of online citizen parti...WSI Stimulus Project: Centre for longitudinal studies of online citizen parti...
WSI Stimulus Project: Centre for longitudinal studies of online citizen parti...
 
HUMAN RIGHTS IN THE AGE OF ARTIFICIAL INTELLIGENCE
HUMAN RIGHTS IN THE AGE OF ARTIFICIAL INTELLIGENCEHUMAN RIGHTS IN THE AGE OF ARTIFICIAL INTELLIGENCE
HUMAN RIGHTS IN THE AGE OF ARTIFICIAL INTELLIGENCE
 
A Framework for Policy Crowdsourcing - Oxford IPP 2014
A Framework for Policy Crowdsourcing - Oxford IPP 2014A Framework for Policy Crowdsourcing - Oxford IPP 2014
A Framework for Policy Crowdsourcing - Oxford IPP 2014
 
New and Emerging Forms of Data
New and Emerging Forms of DataNew and Emerging Forms of Data
New and Emerging Forms of Data
 
Factors that influence an organization’s decision to adopt crowdsourcing: A r...
Factors that influence an organization’s decision to adopt crowdsourcing: A r...Factors that influence an organization’s decision to adopt crowdsourcing: A r...
Factors that influence an organization’s decision to adopt crowdsourcing: A r...
 
An initial exploration of Citizen Science
An initial exploration of Citizen ScienceAn initial exploration of Citizen Science
An initial exploration of Citizen Science
 
Crowdsourcing Approaches for Smart City Open Data Management
Crowdsourcing Approaches for Smart City Open Data ManagementCrowdsourcing Approaches for Smart City Open Data Management
Crowdsourcing Approaches for Smart City Open Data Management
 
TRANSFORMING BIG DATA INTO SMART DATA: Deriving Value via Harnessing Volume, ...
TRANSFORMING BIG DATA INTO SMART DATA: Deriving Value via Harnessing Volume, ...TRANSFORMING BIG DATA INTO SMART DATA: Deriving Value via Harnessing Volume, ...
TRANSFORMING BIG DATA INTO SMART DATA: Deriving Value via Harnessing Volume, ...
 
Crowdsourcing as a problem solving strategy
Crowdsourcing as a problem solving strategyCrowdsourcing as a problem solving strategy
Crowdsourcing as a problem solving strategy
 
Ii 05. wp8 dti lodz.poland june 2014
Ii 05. wp8 dti lodz.poland june 2014Ii 05. wp8 dti lodz.poland june 2014
Ii 05. wp8 dti lodz.poland june 2014
 
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...
 
AI WORLD: I-World: EIS Global Innovation Platform: BIG Knowledge World vs. BI...
AI WORLD: I-World: EIS Global Innovation Platform: BIG Knowledge World vs. BI...AI WORLD: I-World: EIS Global Innovation Platform: BIG Knowledge World vs. BI...
AI WORLD: I-World: EIS Global Innovation Platform: BIG Knowledge World vs. BI...
 
Tecnologías emergentes: priorizando al ciudadano
Tecnologías emergentes: priorizando al ciudadanoTecnologías emergentes: priorizando al ciudadano
Tecnologías emergentes: priorizando al ciudadano
 
Rise of Crowd Computing (December 2012)
Rise of Crowd Computing (December 2012)Rise of Crowd Computing (December 2012)
Rise of Crowd Computing (December 2012)
 
Data Science definition
Data Science definitionData Science definition
Data Science definition
 
Let's talk about Data Science
Let's talk about Data ScienceLet's talk about Data Science
Let's talk about Data Science
 
Analíticas del aprendizaje: una perspectiva crítica
Analíticas del aprendizaje: una perspectiva críticaAnalíticas del aprendizaje: una perspectiva crítica
Analíticas del aprendizaje: una perspectiva crítica
 
PatternLanguageOfData
PatternLanguageOfDataPatternLanguageOfData
PatternLanguageOfData
 
Technology in the Wild: Dynamics and Uncertainty in Field Experiments, Vietnam
Technology in the Wild: Dynamics and Uncertainty in Field Experiments, VietnamTechnology in the Wild: Dynamics and Uncertainty in Field Experiments, Vietnam
Technology in the Wild: Dynamics and Uncertainty in Field Experiments, Vietnam
 

Kürzlich hochgeladen

Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...PrithaVashisht1
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Guido X Jansen
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?sonikadigital1
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityAggregage
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxDwiAyuSitiHartinah
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best PracticesDataArchiva
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)Data & Analytics Magazin
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptaigil2
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introductionsanjaymuralee1
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructuresonikadigital1
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Vladislav Solodkiy
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024Becky Burwell
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.JasonViviers2
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerPavel Šabatka
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionajayrajaganeshkayala
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxVenkatasubramani13
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationGiorgio Carbone
 

Kürzlich hochgeladen (17)

Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .ppt
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introduction
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructure
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayer
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual intervention
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptx
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - Presentation
 

Crowd Science: Measurements, Models, and Methods

  • 1. Crowd Science: Measurement, Models, and Methods John Prpić & Prashant Shukla HICSS 2016
  • 2.  Overview of the Field  Research Goals  Theoretical Grounding  Toward Crowd Science  Discussion The Grand aim of science is to cover the greatest number of experimental facts by logical deduction from the smallest number of hypotheses or actions. - Albert Einstein. Agenda 2
  • 3.  Crowdsourcing - Crowdflower, Wikipedia, TopCoder,  Citizen Science - GalaxyZoo, Foldit, Zooniverse,  Crowdfunding - Kickstarter, Indiegogo, Kiva,  Open Innovation Platforms - Kaggle, Innocentive, Challenge.gov,  Sharing Economy - AirBnB, Uber, Lyft,  Public Sector - IPaidaBribe, FixMyStreet, Open Ministry, IT-Mediated Crowds – Practice 3
  • 4.  Human Computation - (Ipeirotis, Michelucci, von Ahn)  Open Collaboration - (Benkler, Majchrzak, Mako-Hill)  Ideas Competitions - (Afuah, Boudreau, Lakhani)  Citizen Science - (Cooper, Crowston, Meier)  Crowdfunding - (Agrawal, Burtch, Mollick)  Public Sector - (Aitamurto, Brabham, Noveck) IT-Mediated Crowds – Research 4
  • 5.  We’re observing increased research and practice on organizations using IT to connect with dispersed individuals for explicit resource creation purposes.  This state of affairs precipitates the need to precisely measure the processes and benefits of these activities over myriad different implementations. Research Motivation 5
  • 6.  We seek to address these salient and non-trivial considerations by laying a foundation of:  Theory,  Measures,  Research methods,  That allow us to test Crowd-engagement efficacy across organizations, industries, technologies, and geographies. Research Goals 6
  • 7. The Theory of Crowd Capital (Prpić & Shukla 2013; 2014) Dispersed Knowledge (Hayek 1945) Every individual has private knowledge that is useful, but cannot be accessed. Crowd Capability The IT structure, form of content, and internal processes through which an organization engages a Crowd. Crowd Capital A heterogeneous organizational resource generated from IT-mediated Crowds. Theoretical Grounding 7 Dispersed Knowledge Crowd Capability Crowd Capital
  • 8. IT Structure Crowd-engaging IT is found in Episodic or Collaborative forms, distinguished by whether the individuals in a Crowd interact with one another or not, through the IT (Prpić & Shukla 2013; 2014). Theoretical Grounding 8
  • 9. Theoretical Grounding 9 Typology of Crowd-derived content & Organizational processing methods (Prpić, Shukla, Kietzmann & McCarthy 2015)
  • 10. Theoretical Grounding 10 Comparison of Common Characteristics of Crowdsourcing Techniques (Prpić, Taeihagh & Melton 2015)
  • 11.  An empirical apparatus that considers counterfactuals in ascertaining the benefits of various implementations of IT-mediated Crowds.  Currently, to test hypotheses about the benefits of using IT-mediated Crowds, researchers use data from a single Crowdsourcing, Crowdfunding, Open innovation platform.  Need to consider counterfactuals.  Can’t quantify the benefits of using Crowds otherwise.  Can’t generalize, can’t predict.  Can’t move toward a science of IT-mediated Crowds. Toward Crowd Science 11
  • 12. Counterfactuals  If the use of IT-mediated Crowds is the treatment, we need to measure the difference between the treatment and control group, before and after implementing a Crowd. Toward Crowd Science: Counterfactuals 12
  • 13. Operationalization  Measures of processes and benefits across a variety of IT-mediated Crowds implemented. Toward Crowd Science: Operationalizations 13
  • 14. Experiments  Randomly select organizations/units seeking specific and similar resources from IT-mediated Crowds.  Observe how they do with respect to Crowd Capital generation relative to the control group over a period of time. Toward Crowd Science: Methods 14
  • 15. Meta-Analysis  Focus on quantitative meta analysis that accumulates the evidence from the extant hypothesis testing endeavors in the field.  Revolves around collection of effect sizes/coefficients and applications of procedures such as meta analytic regression analysis (MARA) and homogeneity analysis (HOMA). Toward Crowd Science: Methods 15
  • 16. Natural Experiments  Difference-in-differences techniques. Toward Crowd Science: Methods 16
  • 17.  Unprecedented shocks to knowledge production function  Unprecedented on-demand scale of human participation.  Unprecedented on-demand speed and aggregation of human effort.  Unprecedented on-demand access to human knowledge.  New outcomes & new configurations of socio-technical systems. Why we need Crowd Science 17 The Grand aim of science is to cover the greatest number of experimental facts by logical deduction from the smallest number of hypotheses or actions. - Albert Einstein.
  • 18.  Are we moving toward more perfect information through Crowd Science?  Can Crowd Science optimize stewardship of common-pool resources?  Crowd vs. Market vs. Firm?  AI, IoT, Machine Learning, with Crowds? Crowd Science: Open Questions 18
  • 19. Twitter:  @JPnuggets  @Prashshukla Blogs:  phdinstrategicmanagement.wordpress.com  creativecommodum.com Thank You! 19

Hinweis der Redaktion

  1. http://stats.stackexchange.com/questions/564/what-is-difference-in-differences http://www.summitllc.us/difference-differences