SlideShare ist ein Scribd-Unternehmen logo
1 von 19
Downloaden Sie, um offline zu lesen
unba.se
Distributed Database for Human Interaction
Daniel Norman
CTO and cofounder, güdTECH
unba.se founder
Twitter: @DreamingInCode
HPTSHigh Performance Transaction Systems 2017
unba.se
crates.io/crates/unbase
gitter.im/unbase
CAFFEINATEDEDITION
● Open source
● Peer-to-peer “database”
● Strong causal consistency model
● Distributed immutable Merkle DAG
● Data locality or GTFO
● Rust!
YES!
● No “Clients” or “Servers” – Just Nodes
● Not quite blockchain
● No DHT
● No a priori resource planning
● No stored state, just events (ish)
● No wallclock
● Not remotely done – pre pre pre alpha
NO!
Travel Sucks
Distance between you and
the stuff you probably care
about:
Much much less
Distance between you and the
arbiter of linearization:
Usually thousands of Km
(Stuff you care about)
Collaborating with Bob &
Alice down the hall
You
Messages/docs you authored
Messages/docs you read
Your wristwatch
Your IOT devices
Next door neighbors
The linearization you must visit
Backhoes
Congestion
Light travel time
Alligators
Net non-neutrality
BGP Screwups
Power outages
State Hacking
Spanning tree errors
Tripped-over cables
Cat on server
Submarine cable break
Settlement-free
peering disputes
State Surveillance
Packet corruption
Lie-FiUnder Provisioned hardware
Cheap electrolytic capacitors
Thousands of Km of:
DNS errors
Saturated cell-tower backhaul
RF reflections
Interference from microwave oven
Cosmic Rays
Disgruntled employees
DDOS Attacks
Rat-chewed cables
Corrosion Late internet payments
Gravitational time-dilation
Doppler effect
F*#KING BOINGO
Failed B-side Power
Core router problem
F*#KING TMOBILE
F*#KING NETGEAR
Cabinet switch failure
Misconfigured health check
NAT Misconfiguration
Load balancer failure
NTP failures
WHY!?
Consistency models in your application
WHY!?
● The Network is reliable
● A single arbiter of state makes a consistency-model “strong”
● Objective state is a thing
● Objective simultaneity is a thing
BUSTED!
“Observe locally, act globally”
Fig III. State machine for plugging leaky abstractions
FLAWLESS LOGIC!
● Merkle DAG
● Query Context = Root Reference + Decorations
● Sparse vector clocks
● Selective-hearing gossip
● Commutative index merging
● Storage locality based on “Gravity” and “pressure”, not planning
HOW?
Thank You!
Daniel Norman
CTO and Co-founder, güdTECH
unba.se founder
Twitter: @DreamingInCode
HPTSHigh Performance Transaction Systems 2017
unba.se
crates.io/crates/unbase
gitter.im/unbase
#unbase at irc.mozilla.orgunba.se/design/bibliography.html
CAFFEINATEDEDITION

Weitere ähnliche Inhalte

Ähnlich wie Unbase - HPTS gong show

Big Data Visualisation with Hadoop and PowerPivot
Big Data Visualisation with Hadoop and PowerPivotBig Data Visualisation with Hadoop and PowerPivot
Big Data Visualisation with Hadoop and PowerPivotJen Stirrup
 
ASA Trial Workshop Slides for Archives NZ [2016-09-28]
ASA Trial Workshop Slides for Archives NZ [2016-09-28]ASA Trial Workshop Slides for Archives NZ [2016-09-28]
ASA Trial Workshop Slides for Archives NZ [2016-09-28]Ross Spencer
 
MongoDB IoT City Tour LONDON: Why your Dad's database won't work for IoT. Joe...
MongoDB IoT City Tour LONDON: Why your Dad's database won't work for IoT. Joe...MongoDB IoT City Tour LONDON: Why your Dad's database won't work for IoT. Joe...
MongoDB IoT City Tour LONDON: Why your Dad's database won't work for IoT. Joe...MongoDB
 
Big data for the rest of us with hadoop
Big data for the rest of us with hadoopBig data for the rest of us with hadoop
Big data for the rest of us with hadoopDhaval Anjaria
 
CLOUD_Presentation PB BNI
CLOUD_Presentation PB BNI CLOUD_Presentation PB BNI
CLOUD_Presentation PB BNI Philip Base
 
Inside Out and Upside Down - FOO Camp 2016 - Peter Coffee
Inside Out and Upside Down - FOO Camp 2016 - Peter CoffeeInside Out and Upside Down - FOO Camp 2016 - Peter Coffee
Inside Out and Upside Down - FOO Camp 2016 - Peter CoffeePeter Coffee
 
IOT Paris Seminar 2015 - Storage Challenges in IOT
IOT Paris Seminar 2015 - Storage Challenges in IOTIOT Paris Seminar 2015 - Storage Challenges in IOT
IOT Paris Seminar 2015 - Storage Challenges in IOTMongoDB
 
Anything Data: Big, Streaming, NoSQL, Cloud, Science ... A Sloppy Travel Guide
Anything Data: Big, Streaming, NoSQL, Cloud, Science ... A Sloppy Travel GuideAnything Data: Big, Streaming, NoSQL, Cloud, Science ... A Sloppy Travel Guide
Anything Data: Big, Streaming, NoSQL, Cloud, Science ... A Sloppy Travel GuideAhmet Akyol
 
2021 Trends from the Trenches
2021 Trends from the Trenches2021 Trends from the Trenches
2021 Trends from the TrenchesChris Dagdigian
 
20181122 opengovtcon (1)lindavandenbrink
20181122 opengovtcon (1)lindavandenbrink20181122 opengovtcon (1)lindavandenbrink
20181122 opengovtcon (1)lindavandenbrinkOpenGovIntelligence
 
Remote Research at IxD10
Remote Research at IxD10Remote Research at IxD10
Remote Research at IxD10bolt peters
 
Staying Broad and Shallow: Learning on the Fly (Eric Monson)
Staying Broad and Shallow: Learning on the Fly (Eric Monson)Staying Broad and Shallow: Learning on the Fly (Eric Monson)
Staying Broad and Shallow: Learning on the Fly (Eric Monson)DukeDigitalScholarship
 
culture victoria lodlam lightningtalk
culture victoria lodlam lightningtalkculture victoria lodlam lightningtalk
culture victoria lodlam lightningtalkDavid F. Flanders
 
A Lightning Introduction To Clouds & HLT - Human Language Technology Conference
A Lightning Introduction To Clouds & HLT - Human Language Technology ConferenceA Lightning Introduction To Clouds & HLT - Human Language Technology Conference
A Lightning Introduction To Clouds & HLT - Human Language Technology ConferenceBasis Technology
 
Big Data made easy in the era of the Cloud - Demi Ben-Ari
Big Data made easy in the era of the Cloud - Demi Ben-AriBig Data made easy in the era of the Cloud - Demi Ben-Ari
Big Data made easy in the era of the Cloud - Demi Ben-AriDemi Ben-Ari
 
Intro to Web3 and Polygon.pdf
Intro to Web3 and Polygon.pdfIntro to Web3 and Polygon.pdf
Intro to Web3 and Polygon.pdfTinaBregovi
 

Ähnlich wie Unbase - HPTS gong show (20)

marc portier_westtoer
marc portier_westtoermarc portier_westtoer
marc portier_westtoer
 
Big Data Visualisation with Hadoop and PowerPivot
Big Data Visualisation with Hadoop and PowerPivotBig Data Visualisation with Hadoop and PowerPivot
Big Data Visualisation with Hadoop and PowerPivot
 
ASA Trial Workshop Slides for Archives NZ [2016-09-28]
ASA Trial Workshop Slides for Archives NZ [2016-09-28]ASA Trial Workshop Slides for Archives NZ [2016-09-28]
ASA Trial Workshop Slides for Archives NZ [2016-09-28]
 
MongoDB IoT City Tour LONDON: Why your Dad's database won't work for IoT. Joe...
MongoDB IoT City Tour LONDON: Why your Dad's database won't work for IoT. Joe...MongoDB IoT City Tour LONDON: Why your Dad's database won't work for IoT. Joe...
MongoDB IoT City Tour LONDON: Why your Dad's database won't work for IoT. Joe...
 
Big data for the rest of us with hadoop
Big data for the rest of us with hadoopBig data for the rest of us with hadoop
Big data for the rest of us with hadoop
 
When?
When?When?
When?
 
CLOUD_Presentation PB BNI
CLOUD_Presentation PB BNI CLOUD_Presentation PB BNI
CLOUD_Presentation PB BNI
 
Nosql public
Nosql publicNosql public
Nosql public
 
Inside Out and Upside Down - FOO Camp 2016 - Peter Coffee
Inside Out and Upside Down - FOO Camp 2016 - Peter CoffeeInside Out and Upside Down - FOO Camp 2016 - Peter Coffee
Inside Out and Upside Down - FOO Camp 2016 - Peter Coffee
 
IOT Paris Seminar 2015 - Storage Challenges in IOT
IOT Paris Seminar 2015 - Storage Challenges in IOTIOT Paris Seminar 2015 - Storage Challenges in IOT
IOT Paris Seminar 2015 - Storage Challenges in IOT
 
Anything Data: Big, Streaming, NoSQL, Cloud, Science ... A Sloppy Travel Guide
Anything Data: Big, Streaming, NoSQL, Cloud, Science ... A Sloppy Travel GuideAnything Data: Big, Streaming, NoSQL, Cloud, Science ... A Sloppy Travel Guide
Anything Data: Big, Streaming, NoSQL, Cloud, Science ... A Sloppy Travel Guide
 
2021 Trends from the Trenches
2021 Trends from the Trenches2021 Trends from the Trenches
2021 Trends from the Trenches
 
Messaging
MessagingMessaging
Messaging
 
20181122 opengovtcon (1)lindavandenbrink
20181122 opengovtcon (1)lindavandenbrink20181122 opengovtcon (1)lindavandenbrink
20181122 opengovtcon (1)lindavandenbrink
 
Remote Research at IxD10
Remote Research at IxD10Remote Research at IxD10
Remote Research at IxD10
 
Staying Broad and Shallow: Learning on the Fly (Eric Monson)
Staying Broad and Shallow: Learning on the Fly (Eric Monson)Staying Broad and Shallow: Learning on the Fly (Eric Monson)
Staying Broad and Shallow: Learning on the Fly (Eric Monson)
 
culture victoria lodlam lightningtalk
culture victoria lodlam lightningtalkculture victoria lodlam lightningtalk
culture victoria lodlam lightningtalk
 
A Lightning Introduction To Clouds & HLT - Human Language Technology Conference
A Lightning Introduction To Clouds & HLT - Human Language Technology ConferenceA Lightning Introduction To Clouds & HLT - Human Language Technology Conference
A Lightning Introduction To Clouds & HLT - Human Language Technology Conference
 
Big Data made easy in the era of the Cloud - Demi Ben-Ari
Big Data made easy in the era of the Cloud - Demi Ben-AriBig Data made easy in the era of the Cloud - Demi Ben-Ari
Big Data made easy in the era of the Cloud - Demi Ben-Ari
 
Intro to Web3 and Polygon.pdf
Intro to Web3 and Polygon.pdfIntro to Web3 and Polygon.pdf
Intro to Web3 and Polygon.pdf
 

Kürzlich hochgeladen

Artificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdfArtificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdfscitechtalktv
 
Exploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptxExploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptxDilipVasan
 
how can i exchange pi coins for others currency like Bitcoin
how can i exchange pi coins for others currency like Bitcoinhow can i exchange pi coins for others currency like Bitcoin
how can i exchange pi coins for others currency like BitcoinDOT TECH
 
Easy and simple project file on mp online
Easy and simple project file on mp onlineEasy and simple project file on mp online
Easy and simple project file on mp onlinebalibahu1313
 
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理pyhepag
 
2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group MeetingAlison Pitt
 
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理pyhepag
 
一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理pyhepag
 
Fuzzy Sets decision making under information of uncertainty
Fuzzy Sets decision making under information of uncertaintyFuzzy Sets decision making under information of uncertainty
Fuzzy Sets decision making under information of uncertaintyRafigAliyev2
 
一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理cyebo
 
MALL CUSTOMER SEGMENTATION USING K-MEANS CLUSTERING.pptx
MALL CUSTOMER SEGMENTATION USING K-MEANS CLUSTERING.pptxMALL CUSTOMER SEGMENTATION USING K-MEANS CLUSTERING.pptx
MALL CUSTOMER SEGMENTATION USING K-MEANS CLUSTERING.pptxNidaFaviankaNawawi
 
Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)Jon Hansen
 
AI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdfAI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdfMichaelSenkow
 
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflictSupply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflictJack Cole
 
一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理pyhepag
 
How I opened a fake bank account and didn't go to prison
How I opened a fake bank account and didn't go to prisonHow I opened a fake bank account and didn't go to prison
How I opened a fake bank account and didn't go to prisonPayment Village
 
一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理cyebo
 

Kürzlich hochgeladen (20)

Artificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdfArtificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdf
 
Exploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptxExploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptx
 
how can i exchange pi coins for others currency like Bitcoin
how can i exchange pi coins for others currency like Bitcoinhow can i exchange pi coins for others currency like Bitcoin
how can i exchange pi coins for others currency like Bitcoin
 
Easy and simple project file on mp online
Easy and simple project file on mp onlineEasy and simple project file on mp online
Easy and simple project file on mp online
 
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
 
2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting
 
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
 
Slip-and-fall Injuries: Top Workers' Comp Claims
Slip-and-fall Injuries: Top Workers' Comp ClaimsSlip-and-fall Injuries: Top Workers' Comp Claims
Slip-and-fall Injuries: Top Workers' Comp Claims
 
一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理
 
Fuzzy Sets decision making under information of uncertainty
Fuzzy Sets decision making under information of uncertaintyFuzzy Sets decision making under information of uncertainty
Fuzzy Sets decision making under information of uncertainty
 
一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理
 
Machine Learning for Accident Severity Prediction
Machine Learning for Accident Severity PredictionMachine Learning for Accident Severity Prediction
Machine Learning for Accident Severity Prediction
 
MALL CUSTOMER SEGMENTATION USING K-MEANS CLUSTERING.pptx
MALL CUSTOMER SEGMENTATION USING K-MEANS CLUSTERING.pptxMALL CUSTOMER SEGMENTATION USING K-MEANS CLUSTERING.pptx
MALL CUSTOMER SEGMENTATION USING K-MEANS CLUSTERING.pptx
 
Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)
 
AI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdfAI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdf
 
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflictSupply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
 
Abortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotec
Abortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotecAbortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotec
Abortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotec
 
一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理
 
How I opened a fake bank account and didn't go to prison
How I opened a fake bank account and didn't go to prisonHow I opened a fake bank account and didn't go to prison
How I opened a fake bank account and didn't go to prison
 
一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理
 

Unbase - HPTS gong show

  • 1. unba.se Distributed Database for Human Interaction Daniel Norman CTO and cofounder, güdTECH unba.se founder Twitter: @DreamingInCode HPTSHigh Performance Transaction Systems 2017 unba.se crates.io/crates/unbase gitter.im/unbase CAFFEINATEDEDITION
  • 2. ● Open source ● Peer-to-peer “database” ● Strong causal consistency model ● Distributed immutable Merkle DAG ● Data locality or GTFO ● Rust! YES!
  • 3. ● No “Clients” or “Servers” – Just Nodes ● Not quite blockchain ● No DHT ● No a priori resource planning ● No stored state, just events (ish) ● No wallclock ● Not remotely done – pre pre pre alpha NO!
  • 4. Travel Sucks Distance between you and the stuff you probably care about: Much much less Distance between you and the arbiter of linearization: Usually thousands of Km (Stuff you care about) Collaborating with Bob & Alice down the hall You Messages/docs you authored Messages/docs you read Your wristwatch Your IOT devices Next door neighbors The linearization you must visit Backhoes Congestion Light travel time Alligators Net non-neutrality BGP Screwups Power outages State Hacking Spanning tree errors Tripped-over cables Cat on server Submarine cable break Settlement-free peering disputes State Surveillance Packet corruption Lie-FiUnder Provisioned hardware Cheap electrolytic capacitors Thousands of Km of: DNS errors Saturated cell-tower backhaul RF reflections Interference from microwave oven Cosmic Rays Disgruntled employees DDOS Attacks Rat-chewed cables Corrosion Late internet payments Gravitational time-dilation Doppler effect F*#KING BOINGO Failed B-side Power Core router problem F*#KING TMOBILE F*#KING NETGEAR Cabinet switch failure Misconfigured health check NAT Misconfiguration Load balancer failure NTP failures WHY!?
  • 5. Consistency models in your application WHY!?
  • 6. ● The Network is reliable ● A single arbiter of state makes a consistency-model “strong” ● Objective state is a thing ● Objective simultaneity is a thing BUSTED!
  • 7. “Observe locally, act globally” Fig III. State machine for plugging leaky abstractions FLAWLESS LOGIC!
  • 8. ● Merkle DAG ● Query Context = Root Reference + Decorations ● Sparse vector clocks ● Selective-hearing gossip ● Commutative index merging ● Storage locality based on “Gravity” and “pressure”, not planning HOW?
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19. Thank You! Daniel Norman CTO and Co-founder, güdTECH unba.se founder Twitter: @DreamingInCode HPTSHigh Performance Transaction Systems 2017 unba.se crates.io/crates/unbase gitter.im/unbase #unbase at irc.mozilla.orgunba.se/design/bibliography.html CAFFEINATEDEDITION