SlideShare ist ein Scribd-Unternehmen logo
1 von 28
Downloaden Sie, um offline zu lesen
Data Decay and the Illusion of the Present
Dan Lynn
@danklynn
Keeps all your contacts in one place and keeps them
automatically up to date.
Based in Denver, Colorado

CTO & Co-Founder
dan@fullcontact.com
@danklynn
Let’s talk about time.
The Past
http://wearcam.org/dundas-square/2004sep23/cement.jpg
The Present
The Past

The Future
Unless you’re a yogi,
you probably can’t
even perceive the
present.
http://applemagazine.com/wp-content/uploads/2012/12/
exc.jpeg
“Traders may have gotten last week’s Fed
news 7 milliseconds early“
- Washington Post (September 24, 2013)
Data is always old
It’s just a question of how old.
How do APIs keep
data fresh?
Polling
GET /notifications?since=1382630675166

• Simple
• But can lead to complex scheduling
• Trades efficient use of resources for
fresh data.
“98.5% of polls are wasted”
- Zapier
Ping/Pull
• XML-RPC
• Facebook Realtime updates
• Avoids scheduled polling
• Consumer must host an endpoint
• Moderate latency (3 hops)
• Complex
Push
• Github service hooks
• Content of change is pushed
• Payload can be diff or full resource
• Consumer must host an endpoint
• Lowest latency (1 hop)
We are moving
towards a push-based
API ecosystem
Flight Delays

“Security is abnormally slow.”
Contact Information
“Dan Lynn changed his phone number”
Dynamic Subscriptions
POST /contacts/123/subscriptions
{
"url" : "https://.../updates?contactId=123"
}

201 Created
{ "url" : "/contacts/123/subscriptions/a3b"}
Dynamic Subscriptions
DELETE /contacts/123/subscriptions/a3b
200 OK
So which model is right
for your API?
What’s the cost of
acting on wrong
data?
$100 per contact
If left untreated

Source: SiriusDecisions
Low time sensitivity?
Polling is fine.
High time sensitivity?
Go with push.
APIs are combating
information asymmetry.
Thanks!
@danklynn
See Also:
http://xmpp.org/extensions/xep-0060.html
https://code.google.com/p/pubsubhubbub/
http://www.resthooks.org/

Weitere ähnliche Inhalte

Andere mochten auch

Individuals with disabilities in higher education
Individuals with disabilities in higher educationIndividuals with disabilities in higher education
Individuals with disabilities in higher education
Susan Moore
 
Utah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
Utah’s Watershed Restoration Initiative — Dec. 2010 Board MeetingUtah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
Utah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
Utah Division of Wildlife Resources
 
Using smtp over_bgan_en
Using smtp over_bgan_enUsing smtp over_bgan_en
Using smtp over_bgan_en
madhu4a
 
Chelsea Property Group (Reit)
Chelsea Property Group (Reit)Chelsea Property Group (Reit)
Chelsea Property Group (Reit)
russellernst
 
【STR2 CyberX プレゼンテーション】
【STR2 CyberX プレゼンテーション】【STR2 CyberX プレゼンテーション】
【STR2 CyberX プレゼンテーション】
Up Hatch
 

Andere mochten auch (20)

Epidermis
EpidermisEpidermis
Epidermis
 
SMS For Email Service Providers Webinar
SMS For Email Service Providers WebinarSMS For Email Service Providers Webinar
SMS For Email Service Providers Webinar
 
Jasmine soap
Jasmine soapJasmine soap
Jasmine soap
 
SqaВфны8
SqaВфны8SqaВфны8
SqaВфны8
 
Individuals with disabilities in higher education
Individuals with disabilities in higher educationIndividuals with disabilities in higher education
Individuals with disabilities in higher education
 
Jasmine soap
Jasmine soapJasmine soap
Jasmine soap
 
Presentacio1
Presentacio1Presentacio1
Presentacio1
 
אז איך מתמודדים עם לחץ בחינות
אז איך מתמודדים עם לחץ בחינותאז איך מתמודדים עם לחץ בחינות
אז איך מתמודדים עם לחץ בחינות
 
Utah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
Utah’s Watershed Restoration Initiative — Dec. 2010 Board MeetingUtah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
Utah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
 
Extending your CRM to Mobile_april 2011
Extending your CRM to Mobile_april 2011Extending your CRM to Mobile_april 2011
Extending your CRM to Mobile_april 2011
 
Canoe Trip 2011 - February Meeting
Canoe Trip 2011 - February MeetingCanoe Trip 2011 - February Meeting
Canoe Trip 2011 - February Meeting
 
Batik aceh dan penjelasannya
Batik aceh dan penjelasannyaBatik aceh dan penjelasannya
Batik aceh dan penjelasannya
 
ניהול זמנים פסיכומטרי בפרק הכמותי
ניהול זמנים פסיכומטרי בפרק הכמותיניהול זמנים פסיכומטרי בפרק הכמותי
ניהול זמנים פסיכומטרי בפרק הכמותי
 
2011 Antlerless Recommendations, May 4, 2011
2011 Antlerless Recommendations, May 4, 20112011 Antlerless Recommendations, May 4, 2011
2011 Antlerless Recommendations, May 4, 2011
 
Commsday presentation
Commsday presentationCommsday presentation
Commsday presentation
 
Hypotheekvormen
HypotheekvormenHypotheekvormen
Hypotheekvormen
 
Using smtp over_bgan_en
Using smtp over_bgan_enUsing smtp over_bgan_en
Using smtp over_bgan_en
 
Chelsea Property Group (Reit)
Chelsea Property Group (Reit)Chelsea Property Group (Reit)
Chelsea Property Group (Reit)
 
Sampling Data in T-SQL
Sampling Data in T-SQLSampling Data in T-SQL
Sampling Data in T-SQL
 
【STR2 CyberX プレゼンテーション】
【STR2 CyberX プレゼンテーション】【STR2 CyberX プレゼンテーション】
【STR2 CyberX プレゼンテーション】
 

Ähnlich wie Data decay and the illusion of the present

Big data and the data quality imperative
Big data and the data quality imperativeBig data and the data quality imperative
Big data and the data quality imperative
Trillium Software
 

Ähnlich wie Data decay and the illusion of the present (20)

Crossing the bridge - how do we link end-user-computing and formal tech for d...
Crossing the bridge - how do we link end-user-computing and formal tech for d...Crossing the bridge - how do we link end-user-computing and formal tech for d...
Crossing the bridge - how do we link end-user-computing and formal tech for d...
 
Data science presentation 2nd CI day
Data science presentation 2nd CI dayData science presentation 2nd CI day
Data science presentation 2nd CI day
 
Less is More: Behind the Data at Risk I/O
Less is More: Behind the Data at Risk I/OLess is More: Behind the Data at Risk I/O
Less is More: Behind the Data at Risk I/O
 
Fast Data Mining: Real Time Knowledge Discovery for Predictive Decision Making
Fast Data Mining: Real Time Knowledge Discovery for Predictive Decision MakingFast Data Mining: Real Time Knowledge Discovery for Predictive Decision Making
Fast Data Mining: Real Time Knowledge Discovery for Predictive Decision Making
 
Future of data science as a profession
Future of data science as a professionFuture of data science as a profession
Future of data science as a profession
 
Big data and the data quality imperative
Big data and the data quality imperativeBig data and the data quality imperative
Big data and the data quality imperative
 
DataOps @ Scale: A Modern Framework for Data Management in the Public Sector
DataOps @ Scale: A Modern Framework for Data Management in the Public SectorDataOps @ Scale: A Modern Framework for Data Management in the Public Sector
DataOps @ Scale: A Modern Framework for Data Management in the Public Sector
 
10 Decisions You Will Face With Any Donor Data Migration Project
10 Decisions You Will Face With Any Donor Data Migration Project10 Decisions You Will Face With Any Donor Data Migration Project
10 Decisions You Will Face With Any Donor Data Migration Project
 
Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science
 
Close Encounters with the Third Kind of Database
Close Encounters with the Third Kind of DatabaseClose Encounters with the Third Kind of Database
Close Encounters with the Third Kind of Database
 
FutureSkills: Refreshing IT Skills in State and Local Government
FutureSkills: Refreshing IT Skills in State and Local GovernmentFutureSkills: Refreshing IT Skills in State and Local Government
FutureSkills: Refreshing IT Skills in State and Local Government
 
Human-centered data: using data science and human-centered design to grow you...
Human-centered data: using data science and human-centered design to grow you...Human-centered data: using data science and human-centered design to grow you...
Human-centered data: using data science and human-centered design to grow you...
 
Internet of Things - Lecture 1 - Introduction
Internet of Things - Lecture 1 - IntroductionInternet of Things - Lecture 1 - Introduction
Internet of Things - Lecture 1 - Introduction
 
Recent developments in data analytics and big data
Recent developments in data analytics and big dataRecent developments in data analytics and big data
Recent developments in data analytics and big data
 
Big Data: The Magic to Attain New Heights
Big Data:  The Magic to Attain New HeightsBig Data:  The Magic to Attain New Heights
Big Data: The Magic to Attain New Heights
 
MySQL Backed - Fraud Prevention
MySQL Backed - Fraud PreventionMySQL Backed - Fraud Prevention
MySQL Backed - Fraud Prevention
 
Data in the Wild: Survival Guide
Data in the Wild: Survival GuideData in the Wild: Survival Guide
Data in the Wild: Survival Guide
 
Data Mesh @ Yelp - 2019
Data Mesh @ Yelp - 2019Data Mesh @ Yelp - 2019
Data Mesh @ Yelp - 2019
 
Tableau - Make your SEO data work for you!
Tableau - Make your SEO data work for you!Tableau - Make your SEO data work for you!
Tableau - Make your SEO data work for you!
 
Explaining the importance of a database lock in clinical research
Explaining the importance of a database lock in clinical researchExplaining the importance of a database lock in clinical research
Explaining the importance of a database lock in clinical research
 

Mehr von Dan Lynn (6)

Dirty data? Clean it up! - Datapalooza Denver 2016
Dirty data? Clean it up! - Datapalooza Denver 2016Dirty data? Clean it up! - Datapalooza Denver 2016
Dirty data? Clean it up! - Datapalooza Denver 2016
 
Data Streaming Technology Overview
Data Streaming Technology OverviewData Streaming Technology Overview
Data Streaming Technology Overview
 
Storm - As deep into real-time data processing as you can get in 30 minutes.
Storm - As deep into real-time data processing as you can get in 30 minutes.Storm - As deep into real-time data processing as you can get in 30 minutes.
Storm - As deep into real-time data processing as you can get in 30 minutes.
 
Storing and manipulating graphs in HBase
Storing and manipulating graphs in HBaseStoring and manipulating graphs in HBase
Storing and manipulating graphs in HBase
 
Storm: The Real-Time Layer - GlueCon 2012
Storm: The Real-Time Layer  - GlueCon 2012Storm: The Real-Time Layer  - GlueCon 2012
Storm: The Real-Time Layer - GlueCon 2012
 
When it rains: Prepare for scale with Amazon EC2
When it rains: Prepare for scale with Amazon EC2When it rains: Prepare for scale with Amazon EC2
When it rains: Prepare for scale with Amazon EC2
 

Kürzlich hochgeladen

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Kürzlich hochgeladen (20)

08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 

Data decay and the illusion of the present