SlideShare ist ein Scribd-Unternehmen logo
1 von 25
@seangorman
Is big data the new reductionism?
People from different places and different
backgrounds tend to produce different sorts of
information. And so we risk ignoring a lot of
important nuance if relying on big data as a
social/economic/political mirror.
                              Mark Graham, “Big data and the end
                              of theory” The Guardian. March 2012
Alternatives to reductionism?
The NYC Marathon’s Human Sensor Network
32,000+ unique devices
3.5 million events fired
Streaming Analysis Architecture
Just in Time Analytics - Where Conference

Weitere ähnliche Inhalte

Was ist angesagt?

BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...
BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...
BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...Big Data Week
 
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18Angelo Gino Varrati
 
Small Business Solutions
Small Business SolutionsSmall Business Solutions
Small Business SolutionsTrevarthen
 
Policy paper - Bigdata skill building
Policy paper - Bigdata skill buildingPolicy paper - Bigdata skill building
Policy paper - Bigdata skill buildingRitesh Shrivastava
 
Novedades de Utility Network
Novedades de Utility NetworkNovedades de Utility Network
Novedades de Utility NetworkEsri España
 
Open Data 101 (from GO Open Data 2015, Toronto Canada)
Open Data 101 (from GO Open Data 2015, Toronto Canada)Open Data 101 (from GO Open Data 2015, Toronto Canada)
Open Data 101 (from GO Open Data 2015, Toronto Canada)Christian Villum
 
Wall Street Network case study
Wall Street Network case studyWall Street Network case study
Wall Street Network case studyEsri
 
Crowdsourcing and storytelling by gamification
Crowdsourcing and storytelling by gamificationCrowdsourcing and storytelling by gamification
Crowdsourcing and storytelling by gamificationDany Laksono
 
Scalout @ Data Innovation Summit 2019
Scalout @ Data Innovation Summit 2019Scalout @ Data Innovation Summit 2019
Scalout @ Data Innovation Summit 2019Jens Frid
 
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunenMeetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunenDigipolis Antwerpen
 
We are just playing GO......
We are just playing GO......We are just playing GO......
We are just playing GO......JamesAKirkcaldy
 
The beauty of data visualization
The beauty of data visualizationThe beauty of data visualization
The beauty of data visualizationDebashish Jana
 
AWE Tel Aviv Startup Pitch: Omri Stein with ReSight
AWE Tel Aviv Startup Pitch: Omri Stein with ReSightAWE Tel Aviv Startup Pitch: Omri Stein with ReSight
AWE Tel Aviv Startup Pitch: Omri Stein with ReSightAugmentedWorldExpo
 
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈NAVER D2
 

Was ist angesagt? (15)

BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...
BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...
BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...
 
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18
 
Small Business Solutions
Small Business SolutionsSmall Business Solutions
Small Business Solutions
 
Policy paper - Bigdata skill building
Policy paper - Bigdata skill buildingPolicy paper - Bigdata skill building
Policy paper - Bigdata skill building
 
Novedades de Utility Network
Novedades de Utility NetworkNovedades de Utility Network
Novedades de Utility Network
 
Open Data 101 (from GO Open Data 2015, Toronto Canada)
Open Data 101 (from GO Open Data 2015, Toronto Canada)Open Data 101 (from GO Open Data 2015, Toronto Canada)
Open Data 101 (from GO Open Data 2015, Toronto Canada)
 
Wall Street Network case study
Wall Street Network case studyWall Street Network case study
Wall Street Network case study
 
Crowdsourcing and storytelling by gamification
Crowdsourcing and storytelling by gamificationCrowdsourcing and storytelling by gamification
Crowdsourcing and storytelling by gamification
 
Scalout @ Data Innovation Summit 2019
Scalout @ Data Innovation Summit 2019Scalout @ Data Innovation Summit 2019
Scalout @ Data Innovation Summit 2019
 
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunenMeetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
 
We are just playing GO......
We are just playing GO......We are just playing GO......
We are just playing GO......
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
 
The beauty of data visualization
The beauty of data visualizationThe beauty of data visualization
The beauty of data visualization
 
AWE Tel Aviv Startup Pitch: Omri Stein with ReSight
AWE Tel Aviv Startup Pitch: Omri Stein with ReSightAWE Tel Aviv Startup Pitch: Omri Stein with ReSight
AWE Tel Aviv Startup Pitch: Omri Stein with ReSight
 
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈
 

Andere mochten auch

Wherecamp Lightningtalk - GeoMining Social Media
Wherecamp Lightningtalk - GeoMining Social MediaWherecamp Lightningtalk - GeoMining Social Media
Wherecamp Lightningtalk - GeoMining Social Mediaseagor
 
The State of Big Data for Geo - ESRI Big Data Meetup
The State of Big Data for Geo - ESRI Big Data MeetupThe State of Big Data for Geo - ESRI Big Data Meetup
The State of Big Data for Geo - ESRI Big Data Meetupseagor
 
Oscar twitter geo_sentiment
Oscar twitter geo_sentimentOscar twitter geo_sentiment
Oscar twitter geo_sentimentseagor
 
Gsapp xcities gorman_upload
Gsapp xcities gorman_uploadGsapp xcities gorman_upload
Gsapp xcities gorman_uploadseagor
 
Geo Web F1 Enterprise
Geo Web F1 EnterpriseGeo Web F1 Enterprise
Geo Web F1 Enterpriseseagor
 
Where 2.0 NoSQL Presentation 2008 - GeoIQ
Where 2.0 NoSQL Presentation 2008 - GeoIQWhere 2.0 NoSQL Presentation 2008 - GeoIQ
Where 2.0 NoSQL Presentation 2008 - GeoIQseagor
 
ONR Social Media Conference - GeoIQ
ONR Social Media Conference - GeoIQONR Social Media Conference - GeoIQ
ONR Social Media Conference - GeoIQseagor
 
Black Friday Twitter Brand Analysis
Black Friday Twitter Brand AnalysisBlack Friday Twitter Brand Analysis
Black Friday Twitter Brand Analysisseagor
 
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...Amazon Web Services
 

Andere mochten auch (9)

Wherecamp Lightningtalk - GeoMining Social Media
Wherecamp Lightningtalk - GeoMining Social MediaWherecamp Lightningtalk - GeoMining Social Media
Wherecamp Lightningtalk - GeoMining Social Media
 
The State of Big Data for Geo - ESRI Big Data Meetup
The State of Big Data for Geo - ESRI Big Data MeetupThe State of Big Data for Geo - ESRI Big Data Meetup
The State of Big Data for Geo - ESRI Big Data Meetup
 
Oscar twitter geo_sentiment
Oscar twitter geo_sentimentOscar twitter geo_sentiment
Oscar twitter geo_sentiment
 
Gsapp xcities gorman_upload
Gsapp xcities gorman_uploadGsapp xcities gorman_upload
Gsapp xcities gorman_upload
 
Geo Web F1 Enterprise
Geo Web F1 EnterpriseGeo Web F1 Enterprise
Geo Web F1 Enterprise
 
Where 2.0 NoSQL Presentation 2008 - GeoIQ
Where 2.0 NoSQL Presentation 2008 - GeoIQWhere 2.0 NoSQL Presentation 2008 - GeoIQ
Where 2.0 NoSQL Presentation 2008 - GeoIQ
 
ONR Social Media Conference - GeoIQ
ONR Social Media Conference - GeoIQONR Social Media Conference - GeoIQ
ONR Social Media Conference - GeoIQ
 
Black Friday Twitter Brand Analysis
Black Friday Twitter Brand AnalysisBlack Friday Twitter Brand Analysis
Black Friday Twitter Brand Analysis
 
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...
 

Kürzlich hochgeladen

Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DaySri Ambati
 

Kürzlich hochgeladen (20)

Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
 

Just in Time Analytics - Where Conference

Hinweis der Redaktion

  1. Just in time manufacturing – kanban. 1950’s Toyota looked at how supermarkets handle inventory delivering produce just at the time customers in the store needed. In manufacturing large inventories were kept in storage and analysis was done on what volumes levels should be held based on historical data.  In contexts where supply time is lengthy and demand is difficult to forecast, the best case can be to respond quickly to observed demand.Kanban changed this with dynamic job queues and just in time delivery. Can the information economy get the same gains the manufacturing economy got with just in time methods.
  2. The heijunka box is generally a wall schedule which is divided into a grid of boxes or a set of 'pigeon-holes'/rectangular receptacles. Each column of boxes representing a specific period of time, lines are drawn down the schedule/grid to visually break the schedule into columns of individual shifts or days or weeks. Coloured cards representing individual jobs (referred to as kanban cards) are placed on the heijunka box to provide a visual representation of the upcoming production runs.The heijunka box makes it easy to see what type of jobs are queued for production and for when they are scheduled. Workers on the process remove the kanban cards for the current period from the box in order to know what to do. These cards will be passed to another section when they process the related job.
  3. Today’s data warehouses
  4. Big data originated with batch operations with massive amount of data. In effect performing valuable post mortems on our digital exhaust
  5. Increasing the data we create is coming in real time
  6. It is not just social media but sensors, mobile, all globally instrumented
  7. Real time analytic tools are quickly emerging but are out old analytical methods appropriate
  8. In 1749 the German scholar Gottfried Achenwall suggested that since this ‘science’ [the study of society by counting] dealt with the natural ‘states” of society, it should be called Statistik.
  9. Two trends using big data as a reflection of society and data is a living organism and a post mortem is for things that are dead.
  10. The downside to reductionist approaches. Is the end of theory premature?
  11. Any event with a very low probabilitythat occurs gives us a great deal of information, whereas when an event with a highprobability occurs, this is less of a surprise and gives us correspondingly less information but greater certainty. Information thus varies inversely with probability.You should call it entropy, for two reasons. In the first place your uncertainty function has been used in statistical mechanics under that name, so it already has a name. In the second place, and more important, no one really knows what entropy really is, so in a debate you will always have the advantage!
  12. Entropy measures of Vogue covers based on the complexity of the pixel variations in the graphic layout
  13. This function has many attractive properties for describing spatial distributions.Here, we initially assume that the probability piis proportional to some count ordensity of spatial activity, such as population in a zone i that might be a censustract. If all the population were located in a ‘‘mile-high building’’ such as the oneproposed for a town of 100,000 people in 1956 by Frank Lloyd Wright (Rybczynski2010), then pi 5 1 and pk ¼ 0; 8k ¼6 i, and the entropy would be at a minimum,with Hmin 5 0. If the population were evenly spread throughout the tracts as pi ¼ 1=n; 8i, then the entropy would be at a maximum, with Hmax ¼ log n. (Batty 2011)
  14. Max entropy over space and time
  15. Traditional statistical approaches to dynamic data. Categorical splits.
  16. Kernel density functions
  17. Delaunay triangulation