Suche senden
Hochladen
Lambda architecture
•
0 gefällt mir
•
204 views
I
Ivan Kosianenko
Folgen
Lambda Architecture: Hot & Cold
Weniger lesen
Mehr lesen
Ingenieurwesen
Melden
Teilen
Melden
Teilen
1 von 17
Jetzt herunterladen
Downloaden Sie, um offline zu lesen
Empfohlen
Productionize spark structured streaming
Productionize spark structured streaming
Ivan Kosianenko
Rootconf
Rootconf
akbarabi
Flink Forward Berlin 2018: Ravi Suhag & Sumanth Nakshatrithaya - "Managing Fl...
Flink Forward Berlin 2018: Ravi Suhag & Sumanth Nakshatrithaya - "Managing Fl...
Flink Forward
Unreal Engine 4 Blueprints: Odio e amore Roberto De Ioris - Codemotion Rome 2017
Unreal Engine 4 Blueprints: Odio e amore Roberto De Ioris - Codemotion Rome 2017
Codemotion
Building GraphQL Servers with Node.JS & Prisma
Building GraphQL Servers with Node.JS & Prisma
Nikolas Burk
GraphQL in Kiwi.com
GraphQL in Kiwi.com
Michal Sänger
Logging in The World of DevOps
Logging in The World of DevOps
DevOps Indonesia
GraphQL API on a Serverless Environment
GraphQL API on a Serverless Environment
Itai Yaffe
Empfohlen
Productionize spark structured streaming
Productionize spark structured streaming
Ivan Kosianenko
Rootconf
Rootconf
akbarabi
Flink Forward Berlin 2018: Ravi Suhag & Sumanth Nakshatrithaya - "Managing Fl...
Flink Forward Berlin 2018: Ravi Suhag & Sumanth Nakshatrithaya - "Managing Fl...
Flink Forward
Unreal Engine 4 Blueprints: Odio e amore Roberto De Ioris - Codemotion Rome 2017
Unreal Engine 4 Blueprints: Odio e amore Roberto De Ioris - Codemotion Rome 2017
Codemotion
Building GraphQL Servers with Node.JS & Prisma
Building GraphQL Servers with Node.JS & Prisma
Nikolas Burk
GraphQL in Kiwi.com
GraphQL in Kiwi.com
Michal Sänger
Logging in The World of DevOps
Logging in The World of DevOps
DevOps Indonesia
GraphQL API on a Serverless Environment
GraphQL API on a Serverless Environment
Itai Yaffe
From logging to monitoring to reactive insights - C Schneider
From logging to monitoring to reactive insights - C Schneider
mfrancis
Flink Forward Berlin 2018: Aljoscha Krettek & Till Rohrmann - Keynote: "A Yea...
Flink Forward Berlin 2018: Aljoscha Krettek & Till Rohrmann - Keynote: "A Yea...
Flink Forward
Apache Airflow overview
Apache Airflow overview
NikolayGrishchenkov
From business requirements to working pipelines with apache airflow
From business requirements to working pipelines with apache airflow
Derrick Qin
Selenium camp 2017. Alexander Chumakin
Selenium camp 2017. Alexander Chumakin
Alex Chumakin
Flink Forward Berlin 2018: Brian Wolfe - "Upshot: distributed tracing using F...
Flink Forward Berlin 2018: Brian Wolfe - "Upshot: distributed tracing using F...
Flink Forward
Data Provision API with BigQuery - Google Cloud Summit Jakarta 18
Data Provision API with BigQuery - Google Cloud Summit Jakarta 18
Imre Nagi
Flink Forward Berlin 2018: Oleksandr Nitavskyi - "Data lossless event time st...
Flink Forward Berlin 2018: Oleksandr Nitavskyi - "Data lossless event time st...
Flink Forward
Implementing GraphQL - Without a Backend
Implementing GraphQL - Without a Backend
Showmax Engineering
OpenStack MagnetoDB. Atlanta Summit 2014
OpenStack MagnetoDB. Atlanta Summit 2014
Ilya Sviridov
MongoDB and the Future of Workspaces
MongoDB and the Future of Workspaces
MongoDB
Fall in Love with Graphs and Metrics using Grafana
Fall in Love with Graphs and Metrics using Grafana
torkelo
Pracital application logging and monitoring
Pracital application logging and monitoring
Laurynas Tretjakovas
"Smooth Operator" [Bay Area NewSQL meetup]
"Smooth Operator" [Bay Area NewSQL meetup]
Kevin Xu
Modern Monitoring and processing logs
Modern Monitoring and processing logs
Dmitry Lavrinenko
Athena 0.2.0 - Nimble
Athena 0.2.0 - Nimble
Nimble
GraphConnect 2014 SF: How eBay and Shutl Deliver Even Faster Using Neo4j
GraphConnect 2014 SF: How eBay and Shutl Deliver Even Faster Using Neo4j
Neo4j
Flink Forward Berlin 2018: Viktor Klang - Keynote "The convergence of stream ...
Flink Forward Berlin 2018: Viktor Klang - Keynote "The convergence of stream ...
Flink Forward
Flink Forward Berlin 2018: Stephan Ewen - Keynote: "Unlocking the next wave o...
Flink Forward Berlin 2018: Stephan Ewen - Keynote: "Unlocking the next wave o...
Flink Forward
Quick prototyping with VulcanJS
Quick prototyping with VulcanJS
Melek Hakim
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdf
JiananWang21
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Kandungan 087776558899
Weitere ähnliche Inhalte
Was ist angesagt?
From logging to monitoring to reactive insights - C Schneider
From logging to monitoring to reactive insights - C Schneider
mfrancis
Flink Forward Berlin 2018: Aljoscha Krettek & Till Rohrmann - Keynote: "A Yea...
Flink Forward Berlin 2018: Aljoscha Krettek & Till Rohrmann - Keynote: "A Yea...
Flink Forward
Apache Airflow overview
Apache Airflow overview
NikolayGrishchenkov
From business requirements to working pipelines with apache airflow
From business requirements to working pipelines with apache airflow
Derrick Qin
Selenium camp 2017. Alexander Chumakin
Selenium camp 2017. Alexander Chumakin
Alex Chumakin
Flink Forward Berlin 2018: Brian Wolfe - "Upshot: distributed tracing using F...
Flink Forward Berlin 2018: Brian Wolfe - "Upshot: distributed tracing using F...
Flink Forward
Data Provision API with BigQuery - Google Cloud Summit Jakarta 18
Data Provision API with BigQuery - Google Cloud Summit Jakarta 18
Imre Nagi
Flink Forward Berlin 2018: Oleksandr Nitavskyi - "Data lossless event time st...
Flink Forward Berlin 2018: Oleksandr Nitavskyi - "Data lossless event time st...
Flink Forward
Implementing GraphQL - Without a Backend
Implementing GraphQL - Without a Backend
Showmax Engineering
OpenStack MagnetoDB. Atlanta Summit 2014
OpenStack MagnetoDB. Atlanta Summit 2014
Ilya Sviridov
MongoDB and the Future of Workspaces
MongoDB and the Future of Workspaces
MongoDB
Fall in Love with Graphs and Metrics using Grafana
Fall in Love with Graphs and Metrics using Grafana
torkelo
Pracital application logging and monitoring
Pracital application logging and monitoring
Laurynas Tretjakovas
"Smooth Operator" [Bay Area NewSQL meetup]
"Smooth Operator" [Bay Area NewSQL meetup]
Kevin Xu
Modern Monitoring and processing logs
Modern Monitoring and processing logs
Dmitry Lavrinenko
Athena 0.2.0 - Nimble
Athena 0.2.0 - Nimble
Nimble
GraphConnect 2014 SF: How eBay and Shutl Deliver Even Faster Using Neo4j
GraphConnect 2014 SF: How eBay and Shutl Deliver Even Faster Using Neo4j
Neo4j
Flink Forward Berlin 2018: Viktor Klang - Keynote "The convergence of stream ...
Flink Forward Berlin 2018: Viktor Klang - Keynote "The convergence of stream ...
Flink Forward
Flink Forward Berlin 2018: Stephan Ewen - Keynote: "Unlocking the next wave o...
Flink Forward Berlin 2018: Stephan Ewen - Keynote: "Unlocking the next wave o...
Flink Forward
Quick prototyping with VulcanJS
Quick prototyping with VulcanJS
Melek Hakim
Was ist angesagt?
(20)
From logging to monitoring to reactive insights - C Schneider
From logging to monitoring to reactive insights - C Schneider
Flink Forward Berlin 2018: Aljoscha Krettek & Till Rohrmann - Keynote: "A Yea...
Flink Forward Berlin 2018: Aljoscha Krettek & Till Rohrmann - Keynote: "A Yea...
Apache Airflow overview
Apache Airflow overview
From business requirements to working pipelines with apache airflow
From business requirements to working pipelines with apache airflow
Selenium camp 2017. Alexander Chumakin
Selenium camp 2017. Alexander Chumakin
Flink Forward Berlin 2018: Brian Wolfe - "Upshot: distributed tracing using F...
Flink Forward Berlin 2018: Brian Wolfe - "Upshot: distributed tracing using F...
Data Provision API with BigQuery - Google Cloud Summit Jakarta 18
Data Provision API with BigQuery - Google Cloud Summit Jakarta 18
Flink Forward Berlin 2018: Oleksandr Nitavskyi - "Data lossless event time st...
Flink Forward Berlin 2018: Oleksandr Nitavskyi - "Data lossless event time st...
Implementing GraphQL - Without a Backend
Implementing GraphQL - Without a Backend
OpenStack MagnetoDB. Atlanta Summit 2014
OpenStack MagnetoDB. Atlanta Summit 2014
MongoDB and the Future of Workspaces
MongoDB and the Future of Workspaces
Fall in Love with Graphs and Metrics using Grafana
Fall in Love with Graphs and Metrics using Grafana
Pracital application logging and monitoring
Pracital application logging and monitoring
"Smooth Operator" [Bay Area NewSQL meetup]
"Smooth Operator" [Bay Area NewSQL meetup]
Modern Monitoring and processing logs
Modern Monitoring and processing logs
Athena 0.2.0 - Nimble
Athena 0.2.0 - Nimble
GraphConnect 2014 SF: How eBay and Shutl Deliver Even Faster Using Neo4j
GraphConnect 2014 SF: How eBay and Shutl Deliver Even Faster Using Neo4j
Flink Forward Berlin 2018: Viktor Klang - Keynote "The convergence of stream ...
Flink Forward Berlin 2018: Viktor Klang - Keynote "The convergence of stream ...
Flink Forward Berlin 2018: Stephan Ewen - Keynote: "Unlocking the next wave o...
Flink Forward Berlin 2018: Stephan Ewen - Keynote: "Unlocking the next wave o...
Quick prototyping with VulcanJS
Quick prototyping with VulcanJS
Kürzlich hochgeladen
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdf
JiananWang21
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Kandungan 087776558899
Hospital management system project report.pdf
Hospital management system project report.pdf
Kamal Acharya
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
SCMS School of Architecture
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
drmkjayanthikannan
Computer Networks Basics of Network Devices
Computer Networks Basics of Network Devices
ChandrakantDivate1
DeepFakes presentation : brief idea of DeepFakes
DeepFakes presentation : brief idea of DeepFakes
MayuraD1
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
BhangaleSonal
School management system project Report.pdf
School management system project Report.pdf
Kamal Acharya
Integrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - Neometrix
Neometrix_Engineering_Pvt_Ltd
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
jaanualu31
Moment Distribution Method For Btech Civil
Moment Distribution Method For Btech Civil
VinayVitekari
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
maisarahman1
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
selvakumar948
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
Amil baba
Unleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leap
RishantSharmaFr
Thermal Engineering Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
DineshKumar4165
Work-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptx
JuliansyahHarahap1
kiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal load
hamedmustafa094
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
KOUSTAV SARKAR
Kürzlich hochgeladen
(20)
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdf
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Hospital management system project report.pdf
Hospital management system project report.pdf
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Computer Networks Basics of Network Devices
Computer Networks Basics of Network Devices
DeepFakes presentation : brief idea of DeepFakes
DeepFakes presentation : brief idea of DeepFakes
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
School management system project Report.pdf
School management system project Report.pdf
Integrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - Neometrix
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
Moment Distribution Method For Btech Civil
Moment Distribution Method For Btech Civil
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
Unleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leap
Thermal Engineering Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
Work-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptx
kiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal load
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
Lambda architecture
1.
Lambda architecture: Hot &
Cold ivan.kosianenko@appsflyer.com
2.
● Life time
value ● Reports: cohorts, retention, daily activity ● Export raw data: instant and scheduled Real Time Dashboard
3.
Data is mutable
4.
Lambda Architecture
5.
6.
7.
Kafka: raw data ●
Lags ● 24h retention ● 15TB daily ● Clicks ● Impressions ● Installs ● In-app events ● and more ...
8.
Pinterest Secor ● Reads
data from kafka (raw jsons) ● Writes to S3 (sequence file) ● Commits offsets
9.
Apache Spark: Sulak
10.
Mojito
11.
Apache Zeppelin
12.
Reports ● LTV ● Retention ●
Cohorts
13.
Memsql Rebuild ● Discrepancies ●
Out of memory
14.
Monitoring ● Grafana ● Kibana ●
End-2-end tests
15.
16.
appsflyer.com/jobs
17.
ivan.kosianenko@appsflyer.com
Jetzt herunterladen