Scaling Uber's Real-time Market Platform

•

4 gefällt mir•1,844 views

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1Lq2ql7. Matt Ranney explains the Uber architecture overall, with a focus on the dispatch systems, the geospatial index, handling failure, and dealing with the distributed traveling salesman problem. Filmed at qconlondon.com. Matt Ranney is the Chief Systems Architect at Uber, where he's helping build and scale everything he can. Previously, Matt was a founder and CTO of Voxer, probably the largest and busiest deployment of Node.js.

Technologie

SCALINGUBER’S
REALTIMEMARKET
PLATFORM
QCON LONDON 2015

InfoQ.com: News & Community Site
• 750,000 unique visitors/month
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• News 15-20 / week
• Articles 3-4 / week
• Presentations (videos) 12-15 / week
• Interviews 2-3 / week
• Books 1 / month
Watch the video with slide
synchronization on InfoQ.com!
http://www.infoq.com/presentations
/uber-market-platform

Presented at QCon London
www.qconlondon.com
Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide

partners riders
dispatch
post trip
processing
money
maps / ETA services
databases

dispatch
post trip
processing
money
maps / ETA services
databases

•1 rider, 1 vehicle
•Moving people
•Sharding by city
•MPOF
PROBLEMS

supply
humans
demand
humans
demandsupply
Dispatch

supply
humans
demand
humans
demandsupply
Dispatch
DISCO

supply
humans
demand
humans
demandsupply
Dispatch
DISCO
geo by supply geo by demandrouting / ETA

demandsupply
Dispatch
DISCO
geo by supply geo by demandrouting / ETA

Source: Geometry on the Sphere: Google's S2 Library

•reduce waiting
•reduce extra driving
•lowest overall ETAs
GOALS

D1 Pickup request
S1 best ETA +8 mins
time
S1 pickup after 8 mins

time
S2 drop off +2 mins
S2 ETA from drop off +1 min
D1 Pickup request
S1 best ETA +8 mins
S1 pickup after 8 mins

time
D1 Pickup request
S2 best ETA +3 mins
S2 pickup after 3 mins

time
S2 pickup D2
D1 Pickup request
S2 best ETA +3 mins
D2 Pickup request
S2 best ETA +1 mins
S2 pickup D1
S2 drop off D1
S2 drop off D2

•performance
•forwarding
•language support
•proper pipelining
•checksums / tracing
•encapsulation
GOALS

AVAILABILITY
•everything retryable
•everything killable
•crash only
•small pieces

CULTURAL CHANGES
•no pairs
•kill everything
•even databases

•overall latency ≥ latency of slowest component
•1ms avg, 1000ms p99
•use 1: 1% at least 1000ms
•use 100: 63% at least 1000ms
•1.0 - 0.99^100 = 0.634 = 63.4%
LATENCY

service A service B (1)
service B (2)
req 1, also B (2)
+5ms req 1, also B (1)
cancel req 1

partner app dispatch DC1
Location Updates
State Digest
dispatch DC2
Location Updates
State Request

Watch the video with slide synchronization on
InfoQ.com!
http://www.infoq.com/presentations/uber-
market-platform

Weitere ähnliche Inhalte

Was ist angesagt?

Python

Tiago

Airbnb has a wide variety of ML problems ranging from models on traditional structured data to models built on unstructured data such as user reviews, messages and listing images. The ability to build, iterate on, and maintain healthy machine learning models is critical to Airbnb’s success. Many ML Platforms cover data collection, feature engineering, training, deploying, productionalization, and monitoring but few, if any, do all of the above seamlessly. Bighead aims to tie together various open source and in-house projects to remove incidental complexity from ML workflows. Bighead is built on Python and Spark and can be used in modular pieces as each ML problem presents unique challenges. Through standardization of the path to production, training environments and the methods for collecting and transforming data on Spark, each model is reproducible and iterable. This talk covers the architecture, the problems that each individual component and the overall system aims to solve, and a vision for the future of machine learning infrastructure. It’s widely adapted in Airbnb and we have variety of models running in production. We have seen the overall model development time go down from many months to days on Bighead. We plan to open source Bighead to allow the wider community to benefit from our work.

Bighead: Airbnb’s End-to-End Machine Learning Platform with Krishna Puttaswa...

Databricks

Chaos Engineering 101: A Field Guide

matthewbrahms

Mongo DB

Edureka!

Natural Language Processing with Graph Databases and Neo4j

William Lyon

Rapporto ONT sul turismo

FormazioneTurismo

Search engineers have many tools to address relevance. Older tools are typically unsupervised (statistical, rule based) and require large investments in manual tuning effort. Newer ones involve training or fine-tuning machine learning models and vector search, which require large investments in labeling documents with their relevance to queries. Learning to Rank (LTR) models are in the latter category. However, their popularity has traditionally been limited to domains where user data can be harnessed to generate labels that are cheap and plentiful, such as e-commerce sites. In domains where this is not true, labeling often involves human experts, and results in labels that are neither cheap nor plentiful. This effectively becomes a roadblock to adoption of LTR models in these domains, in spite of their effectiveness in general. Generative Large Language Models (LLMs) with parameters in the 70B+ range have been found to perform well at tasks that require mimicking human preferences. Labeling query-document pairs with relevance judgements for training LTR models is one such task. Using LLMs for this task opens up the possibility of obtaining a potentially unlimited number of query judgment labels, and makes LTR models a viable approach to improving the site’s search relevancy. In this presentation, we describe work that was done to train and evaluate four LTR based re-rankers against lexical, vector, and heuristic search baselines. The models were a mix of pointwise, pairwise and listwise, and required different strategies to generate labels for them. All four models outperformed the lexical baseline, and one of the four models outperformed the vector search baseline as well. None of the models beat the heuristics baseline, although two came close – however, it is important to note that the heuristics were built up over months of trial and error and required familiarity of the search domain, whereas the LTR models were built in days and required much less familiarity.

Building Learning to Rank (LTR) search reranking models using Large Language ...

Sujit Pal

Why and how to develop OpenERP test scenarios (in python and using OERPScenar...

Odoo

Big Query Basics

Ido Green

Windows IOCP vs Linux EPOLL Performance Comparison

Seungmo Koo

This webinar is designed to offer a comprehensive understanding of the evaluation processes for LLMs, particularly in the context of preparing these models for deployment in production environments. Key Highlights of the Seminar: In-Depth Analysis of LLM Evaluation Methods: Gain insights into a variety of methods to evaluate LLM models, understanding their strengths and weaknesses. End-to-End Evaluation Techniques: Explore how LLM augmented systems are assessed from a holistic perspective. Pragmatic Approach to System Deployment: Learn practical strategies for applying these evaluation techniques to systems intended for real-world application. Focused Overview on Critical LLM Aspects: Receive an overview of various evaluation techniques that are essential for assessing the most crucial elements of modern LLM systems. Simplifying the Evaluation Process: Understand how to streamline the evaluation process, making the work of LLM scientists more efficient and productive. Dr. Andrei Lopatenko is a seasoned expert and executive leader with over 15 years of experience in the tech industry, focusing on search engines, recommendation systems, and large-scale AI, ML, and NLP applications. He has contributed significantly to major companies like Google, Apple, Walmart, eBay, and Zillow, benefiting billions of customers. Dr. Lopatenko earned his PhD in Computer Science from the University of Manchester. He played a key role in developing Google's search engine, initiating Apple Maps, co-founding a Conversational AI startup acquired by Facebook/Meta, and leading Search, LLM, and Generative AI at Zillow.

Evaluating LLM Models for Production Systems Methods and Practices -

alopatenko

김민욱, (달빛조각사) 엘릭서를 이용한 mmorpg 서버 개발, NDC2019

min woog kim

Tdc2013 선배들에게 배우는 server scalability

흥배 최

gRPC is best suited for microservice communication. gRPC is fast, clear and powerful. It is an excellent alternative to address the verbose client problem when architecting a microservice infrastructure. But the legacy environment is always a big hurdle for changes. You must support existing clients that only understand RESTful HTTP API. In other cases, you need to provide RESTful APIs to the outside world. This session suggests solutions to resolve these problems. The session covers: - Why the team chose gRPC as the inter-service communication protocol while moving from a monolith to microservices and the challenges they faced. - How they leveraged Istio to support RESTful APIs using gRPC servers without additional development. - How they set up CI/CD to deliver API changes (including legacy API) using Helm and Spinnaker. - What they have learned through it and future improvements. gRPC는 마이크로서비스 커뮤니케이션에 가장 적합합니다. gRPC는 빠르고 명확하고 강력합니다. 이는 마이크로서비스 인프라를 설계할 때 복잡한 클라이언트의 문제를 해결하는데 있어 훌륭한 대안입니다. 하지만 기존 레거시 환경은 항상 변화의 큰 장애물입니다. RESTful HTTP API만을 이해하는 기존 클라이언트를 지원해야 합니다. 다른 경우, RESTful API를 외부에 제공해야 합니다. 본 세션에서는 이러한 문제를 해결할 솔루션을 제안합니다. 이 세션에서 다루는 내용: - 팀이 모놀리스에서 마이크로서비스로 전환하면서 서비스 간 커뮤니케이션 프로토콜로 gPRC를 선택한 이유 및 직면했던 난관들 - 추가 개발 없이 gRPC 서버를 이용해 RESTful API를 지원하기 위해 이스티오를 활용한 방법 - 헬름 및 스피네이커를 사용해 API 변경 사항 (레거시 API 포함)을 전달하기 위해 CI/CD를 설정하는 방법 - 이를 통해 배운 것과 앞으로 개선할 점

Running gRPC Services for Serving Legacy API on Kubernetes

Sungwon Lee

Behaviour-driven development (BDD) started as an improved variation on test-driven development, but has evolved to become a formidable tool that helps teams communicate more effectively about requirements, using conversation and concrete examples to discover what features really matter to the business. BDD helps teams focus not only on building features that work, but on ensuring that the features they deliver are the ones that the client actually needs. In this talk, we will discuss what BDD is about, its benefits, and how it affects teams and processes. We will discuss two case studies where BDD practices have been successfully introduced, including the benefits gained and challenges met. We will see how much benefit was gained when BDD was integrated into the broader development infrastructure, including issue tracking systems, requirements management, and project reporting. We will also see how BDD can be applied to all levels of the development process, from requirements down to low-level coding. We will also look at the principle BDD tools available that can help teams implement executable specifications, BDD-style test automation, and living documentation effectively. Some of the tools discussed will include JBehave, Cucumber, Specflow, Jasmine and Spock. We will also look at two case studies where BDD practices have been successfully integrated into several projects in large government and financial organizations. Teams that adopted BDD effectively benefited from significantly lower defect rates, much earlier discovery of errors and inconsistencies in the requirements, and better overall communication and collaboration within the team. However, practicing BDD does involve a significant change in mind-set compared to more traditional approaches, a different collaboration model between team members, and a high degree of stakeholder by-in and engagement, all of which should not be underestimated. We will discuss how the teams managed these various challenges during their BDD adoption story.

BDD in Action – principles, practices and real-world application

John Ferguson Smart Limited

Software and product quality for videogames

Antonio García-Domínguez

Git training

eric7master

Nessa apresentação falaremos sobre nossa stack, como construímos sistemas de recomendação usando várias técnicas, como aprendemos sobre o comportamento dos usuário usando Reinforcement Learning e como fazemos predições/análises, mantendo mais de 50 modificações de algoritmos em produção para recomendação gerando impacto em mais de 70 milhões de usuários únicos por mês. Falaremos sobre o nosso ambiente altamente focado em sistemas open-source e como estamos estamos com isso tornando a empresa cada dia mais Data Driven.

Machine Learning na globo-com

Renan Moreira de Oliveira

Modern Machine Learning (ML) represents everything as vectors, from documents, to videos, to user behavior. This representation makes it possible to accurately search, retrieve, rank, and classify different items by similarity and relevance. Running real-time applications that rely on large numbers of such high dimensional vectors requires a new kind of data infrastructure. In this talk we will discuss the need for such infrastructure, the algorithmic and engineering challenges in working with vector data at scale, and open problems we still have no adequate solutions for. Time permitting, I will introduce Pinecone as a solution to some of these challenges.

The Rise of Vector Data

Databricks

This report presents the findings from a study which looked at the educational impact of esports on students and schools. Schools taking part in the Digital Schoolhouse esports tournament 2018 were the primary focus of this study. The tournament aims to use esports to deliver an immersive careers education experience in order to help close the digital skills gap. Students took part in the tournament as either competing players or as part of the events management team with whole school responsibility for the tournament delivery. Industry engaged with schools and students throughout.

Esports: Engaging Education

Digital Schoolhouse

Was ist angesagt? (20)

Python

Bighead: Airbnb’s End-to-End Machine Learning Platform with Krishna Puttaswa...

Chaos Engineering 101: A Field Guide

Mongo DB

Natural Language Processing with Graph Databases and Neo4j

Rapporto ONT sul turismo

Building Learning to Rank (LTR) search reranking models using Large Language ...

Why and how to develop OpenERP test scenarios (in python and using OERPScenar...

Big Query Basics

Windows IOCP vs Linux EPOLL Performance Comparison

Evaluating LLM Models for Production Systems Methods and Practices -

김민욱, (달빛조각사) 엘릭서를 이용한 mmorpg 서버 개발, NDC2019

Tdc2013 선배들에게 배우는 server scalability

Running gRPC Services for Serving Legacy API on Kubernetes

BDD in Action – principles, practices and real-world application

Software and product quality for videogames

Git training

Machine Learning na globo-com

The Rise of Vector Data

Esports: Engaging Education

Andere mochten auch

Scaling Uber's Real-time Market Platform

Trieu Nguyen

Airbnb Growth Tech Talk 4/5/2016

jwegan

ABSTRACT: The ongoing big data revolution has revolutionized the way in which technology is used to empower new business segments like social networking and transform old business segments like traditional retail. However, the DNA that is used to build data processing platform is evolving quite rapidly. There is a plethora of competing tools, technologies, and “religion” for how to build state-of-the-art data analysis frameworks. In this talk, I will go over five ways to build scalable high-performance long-lasting data analysis frameworks in the wrong way. Surprisingly, the industry is full of examples of organization building frameworks in this “wrong” way. Since the “right” way to build a technology framework is dependent on the key business drivers, it is my hope that this talk will spur a discussion on what is the “right” way for Pinterest. The talk will focus on technologies including “data plumbing” (e.g. tools in the Hadoop ecosystem), and statistical modeling methods (e.g. R and Python). In this talk, I’ll try to connect to platform builders, data scientists, and business decision makers. BIO: Jignesh Patel is a Professor in Computer Sciences at the University of Wisconsin-Madison, where he also earned his Ph.D. He has worked in the area of databases (now fashionably called “big data”) for over two decades. He has won several best paper awards, and industry research awards. He is the recipient of the Wisconsin COW teaching award, and the U. Michigan College of Engineering Education Excellence Award. He has a strong interest in seeing research ideas transition to actual products. His Ph.D. thesis work was acquired by NCR/Teradata in 1997, and he also co-founded Locomatix -- a startup that built a platform to power real-time data-driven mobile services. Locomatix became part of Twitter in 2013. He is an ACM Distinguished Scientist and an IEEE Senior Member. He also serves on the board of Lands’ End, and advises a number of startups.

Five Ways To Do Data Analytics "The Wrong Way"

Discover Pinterest

Data Driven Growth

Discover Pinterest

Jay Kreps is a Principal Staff Engineer at LinkedIn where he is the lead architect for online data infrastructure. He is among the original authors of several open source projects including a distributed key-value store called Project Voldemort, a messaging system called Kafka, and a stream processing system called Samza. This talk gives an introduction to Apache Kafka, a distributed messaging system. It will cover both how Kafka works, as well as how it is used at LinkedIn for log aggregation, messaging, ETL, and real-time stream processing.

Apache Kafka at LinkedIn

Discover Pinterest

Slides of QCon London 2016 talk. How stream processing is used within the Uber's Marketplace system to solve a wide range problems, including but not limited to realtime indexing and querying of geospatial time series, aggregation and computing of streaming data, and extracting patterns from data streams. In addition, it will touch upon various TimeSeries analysis and predictions. The underlying systems utilize many open source technologies such as Apache Kafka, Samza and Spark streaming.

Stream Computing & Analytics at Uber

Sudhir Tonse

Andere mochten auch (6)

Scaling Uber's Real-time Market Platform

Airbnb Growth Tech Talk 4/5/2016

Five Ways To Do Data Analytics "The Wrong Way"

Data Driven Growth

Apache Kafka at LinkedIn

Stream Computing & Analytics at Uber

Ähnlich wie Scaling Uber's Real-time Market Platform

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1Rzjtjm. Josh Evans talks about the Netflix journey of failure, innovation, and ubiquity. He reviews the many facets of globalization then delves deep into the architectural patterns that enable seamless, multi-region traffic management, reliable, fast data propagation, and efficient service infrastructure. The patterns presented are broadly applicable to Internet services with global aspirations. Filmed at qconlondon.com. Josh Evans is Director of Operations Engineering at Netflix, with experience in e-commerce, playback control services, infrastructure, tools, testing, and operations.

#NetflixEverywhere Global Architecture

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2mcpD5B. Oliver Gould talks about the Linkerd project, a service mesh hosted by the Cloud Native Computing Foundation, to give operators control over the traffic between their microservices. He shares the lessons they've learned helping dozens of organizations get to production with Linkerd and how they've applied these lessons to tackle complexity with Linkerd. Filmed at qconnewyork.com. Oliver Gould is co-founder and CTO at Buoyant, Inc.

The Service Mesh: It's about Traffic

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1IPjAIS. Rick Hudson discusses the motivation, performance, and technical challenges of Go's low latency concurrent GC and why the approach fits Go well. Filmed at qconsf.com. Rick Hudson is a member of Google’s Go team. Rick has published papers on language runtimes, memory management, concurrency, synchronization, memory models, and transactional memory.

Go GC: Prioritizing Low Latency and Simplicity

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/25GPsXo. Charles Lamanna talks about the scale and architecture of Microsoft’s Azure Management Gateway. Lamanna presents how Azure API’s are built for high availability and for data sovereignty from a key Microsoft Azure Architectural resource. Filmed at qconlondon.com. Charles Lamanna is a Principal Group Development Manager in the Microsoft Azure team. Lamanna joined Microsoft in 2013 when Microsoft acquired MetricsHub, a company he cofounded. His team works on the Azure API front door, monitoring and auto-scaling capabilities, template deployments, resource groups and other management capabilities.

Microsoft Cloud's Front Door: Building a Global API

C4Media

Not Sold Yet, GraphQL: A Humble Tale from Skeptic to Enthusiast

C4Media

Video and slides synchronized, mp3 and slide download available at http://bit.ly/10Oirpo. Paul Downey explains what they did to redirect all traffic from DirectGov and Business Link to gov.uk, along with the tools, techniques and testing involved for the operation to succeed. Filmed at qconlondon.com. Paul is a Technical Architect at Her Majesty's Government Digital Service, where he is helping build GOV.UK. Formerly he acted as BT's Chief Web Services Architect, served as an W3C Advisory Committee representative, and was a founding member of Osmosoft.com. He built SolerPad, and co-founded OSHUG, the Open Source Hardware monthly meetup.

No Link Left Behind

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1hHLHxk. Phil Calcado shares the toolkit and strategy SoundCloud uses to keep its microservices explosion manageable. He presents what they do about the operations overhead, how they spread DevOps skills across teams to support the “you build it, you run it” vision, how they deal with breaking changes and asynchronous behaviors, and how they deal with chatty interactions. Filmed at qconlondon.com. Phil Calcado is the Director of Core Engineering at SoundCloud, and his team is responsible for “keeping the trains running” in our microservices architecture. Before that he was the Director of Product Engineering at SoundCloud, and before joining SoundCloud he was a Lead Consultant for ThoughtWorks in Australia and the UK.

No Free Lunch, Indeed: Three Years of Microservices at SoundCloud

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1LarzvW. Paul Dix discusses experiences building InfluxDB, an open source distributed time series database, in Go. He talks about what drove the decision to use Go, what's been really great about developing in the language, and a few of the pains that they’ve had along the way. He also digs into what performance characteristics they’ve seen in Go 1.4 vs. Go 1.5, which has a new garbage collector. Filmed at qconsf.com. Paul Dix is the CEO of InfluxDB. He is the editor for Addison Wesley's "Data and Analytics", the author of "Service Oriented Design with Ruby and Rails" and the founder of the NYC Machine Learning Meetup.

Experiences Building InfluxDB in Go

C4Media

Docker mentor week intro - cluj-napoca

Alex Vranceanu

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/19U4Q9T. Scott Vokes presents some lesser-known data structures and shows how probability distributions and content-addressable storage can become tools to shape global system behavior. Filmed at qconnewyork.com. Scott Vokes is a developer at Atomic Object, where he primarily works on embedded systems and the tools surrounding them. Previous work has included compilers/static analysis, search, and architectural/electrical planning systems. His main research interests include distributed systems, information retrieval, real-time systems, vector languages, and constraint/logic programming.

The Code that Isn't There

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1Z2JXhs. Manuel Fahndrich describes how they tackled one particular resource allocation aspect of Google Cloud Dataflow pipelines, namely, horizontal scaling of worker pools as a function of pipeline input rate. Managing the redistribution of key ranges across new pool sizes and the associated persistent data storage was particularly challenging. Filmed at qconlondon.com. Manuel Fahndrich earned his Ph.D. in C.S. from UC Berkeley in 1999. He spent the next 15 years as a Research Scientist at Microsoft, working on static and dynamic verification tools for object-oriented programs and system software. After joining Google in 2014 he has been working on data-parallel infrastructure, in particular auto-scaling for batch and streaming pipelines.

Streaming Auto-scaling in Google Cloud Dataflow

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2a6wCn2. Emily Reinhold shares stories of how a rapid growth company broke up a monolith into a series of microservices, with practices and lessons that can save time and money. Filmed at qconnewyork.com. Emily Reinhold is a software engineer on Uber's Money team. Since joining Uber in early 2015, Emily has been involved in many aspects of money, including charging riders and paying driver partners. She has recently contributed to the effort to dismantle Uber's monolith while building its microservice architecture.

Lessons Learned on Uber's Journey into Microservices

C4Media

Learn more about how we are evolving our open source. In our evolution we’ll discuss how we are approaching project lifecycles, metrics we are tracking that give us insight into the health of our key projects, and how we are working to make this clear to the communities involved with our projects. Also, we will discuss one of most recent key open source releases – Spinnaker (http://spinnaker.io/). Spinnaker is an open source, multi-cloud continuous delivery platform for releasing software changes with high velocity and confidence. Spinnaker powers thousands of deployments per day across the Netflix service.

Netflix Open Source Meetup Season 4 Episode 1

aspyker

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2wLVvC0. Jason Yip explores the way of thinking about "high velocity" and gives specific examples of concepts and practices to try from his experiences at ThoughtWorks and Spotify. He intends to change both how attendees think about how they work and specific practices at both the detailed day-to-day and broader coordination level. Filmed at qconnewyork.com. Jason Yip works as an Agile Coach at Spotify. Before joining Spotify NYC in February 2015, he worked at ThoughtWorks as a Principal Consultant.

What Does Speed Mean in Software Product Delivery?

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/15ACXCw. Tyler Akidau from Google demonstrates Google's Millwheel, a streaming system that promises low latency, strong consistency, and flexibility without relying on Lambda Architecture. Filmed at qconsf.com. Tyler Akidau is a Senior Software Engineer at Google. The current Tech Lead for the MillWheel team, he’s spent five years working on massive-scale streaming data processing systems.

Have Your Cake and Eat It Too -- Further Dispelling the Myths of the Lambda A...

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1lmM0bJ. Sponsored by Twilio. Matt Makai explores why deployments are difficult and shows solutions with case studies on how other organizations cut their production deployment times down from months to hours. Filmed at qconnewyork.com. Matt Makai (@mattmakai) is Twilio's Washington, D.C. based Developer Evangelist experienced in the Python and Java web stacks. Matt earned his B.S. in Computer Science from James Madison University, M.S. in Computer Science at Virginia Tech, and M.S. in Management of Information Technology at the University of Virginia.

Deployed in 60 Minutes: Increasing Production Deployments from Six Months to ...

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1C7k9pt. The authors discuss property based testing from the basics to advanced techniques (custom data generators, performance tests, basing data generation on samples from production data,...). Filmed at qconsf.com. Kelsey Gilmore-Innis is a back-end engineer at PagerDuty, where she uses Scala & functional programming to build powerful, scalable software systems. Stew O'Connor is a Senior Software Engineer at Verizon by day, and a scalaz committer by night.

I Dream of Gen'ning: Protecting Your Codebase with Scalacheck's Magic

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2xt4ZmE. Alex Kesling explores Google Expeditions as a case study in building meaningful Virtual Reality applications. Specifically, he discusses how the algorithms of Google's JUMP technologically hallucinate three dimensional photographs of the world around us. Filmed at qconnewyork.com. Alex Kesling is a Virtual Reality Engineer at Google focused on improving the lives of students everywhere through next-generation technologies. From working on designing Knowledge Graph infrastructure, to Android VR development, he has done a little bit of everything in his tenure at Google. He is currently exploring the next generation of VR tools to support educators.

Real-world Virtual Reality

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2c25d5K. Stefanie Schirmer talks about the case study of building an API-first architecture at Etsy. She talks about what problems prompted this drastic change, the new tools they had to build to be able to work with the new system and what mistakes they made along the way. Filmed at qconnewyork.com. Stefanie Schirmer is a Software Engineer at Etsy. In Etsy's core platform team she is working on the API that connects the community of buyers and sellers across different devices.

API-first Architecture Transformation at Etsy

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1vn9Zf0. Andy Vaughn gives attendees a case study of how changing the development model and release cycle of a 5 year old software product to continuous delivery greatly improved the product. Filmed at qconsf.com. Andy Vaughn is the lead engineer for executing software designs that concern the entire MindTouch technology stack and cross functional teams.

Continuous Delivery Without Breaking Everything

C4Media

Ähnlich wie Scaling Uber's Real-time Market Platform (20)

#NetflixEverywhere Global Architecture

The Service Mesh: It's about Traffic

Go GC: Prioritizing Low Latency and Simplicity

Microsoft Cloud's Front Door: Building a Global API

Not Sold Yet, GraphQL: A Humble Tale from Skeptic to Enthusiast

No Link Left Behind

No Free Lunch, Indeed: Three Years of Microservices at SoundCloud

Experiences Building InfluxDB in Go

Docker mentor week intro - cluj-napoca

The Code that Isn't There

Streaming Auto-scaling in Google Cloud Dataflow

Lessons Learned on Uber's Journey into Microservices

Netflix Open Source Meetup Season 4 Episode 1

What Does Speed Mean in Software Product Delivery?

Have Your Cake and Eat It Too -- Further Dispelling the Myths of the Lambda A...

Deployed in 60 Minutes: Increasing Production Deployments from Six Months to ...

I Dream of Gen'ning: Protecting Your Codebase with Scalacheck's Magic

Real-world Virtual Reality

API-first Architecture Transformation at Etsy

Continuous Delivery Without Breaking Everything

Mehr von C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/39NIjLV. Akhilesh Gupta does a technical deep-dive into how Linkedin uses the Play/Akka Framework and a scalable distributed system to enable live interactions like likes/comments at massive scale at extremely low costs across multiple data centers. Filmed at qconlondon.com. Akhilesh Gupta is the technical lead for LinkedIn's Real-time delivery infrastructure and LinkedIn Messaging. He has been working on the revamp of LinkedIn’s offerings to instant, real-time experiences. Before this, he was the head of engineering for the Ride Experience program at Uber Technologies in San Francisco.

Streaming a Million Likes/Second: Real-Time Interactions on Live Video

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2x0Fav8. Jose Nino guides the audience through the journey of Mobile APIs at Lyft. He focuses on how the team has reaped the benefits of API generation to experiment with the network transport layer. He also discusses recent developments the team has made with Envoy Mobile and the roadmap ahead. Filmed at qconlondon.com. Jose Nino works as a Software Engineer at Lyft.

Next Generation Client APIs in Envoy Mobile

C4Media

How do we cope with an environment that has been radically disrupted, where people are suddenly thrust into remote work in a chaotic state? What are the emerging good practices and new ideas that are shaping the way in which software development teams work? What can we do to make the workplace a more secure and diverse one while increasing the productivity of our teams? This report aims to assist technical leaders in making mid- to long-term decisions that will have a positive impact on their organisations and teams and help individual contributors find the practices, approaches, tools, techniques, and frameworks that can help them get a better experience at work - irrespective of where they are working from.

Software Teams and Teamwork Trends Report Q1 2020

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2QCmmJ0. Mark Stoodley examines some of the strengths and weaknesses of the different Java compilation technologies, if one was to apply them in isolation. Stoodley discusses how production JVMs are assembling a combination of these tools that work together to provide excellent performance across the large spectrum of applications written in Java and JVM based languages. Filmed at qconsf.com. Mark Stoodley joined IBM Canada to build Java JIT compilers for production use and led the team that delivered AOT compilation in the IBM SDK for Java 6. He spent the last five years leading the effort to open source nearly 4.3 million lines of source code from the IBM J9 Java Virtual Machine to create the two open source projects Eclipse OMR and Eclipse OpenJ9, and now co-leads both projects.

Understand the Trade-offs Using Compilers for Java Applications

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2y2yPiS. Colin McCabe talks about the ongoing effort to replace the use of Zookeeper in Kafka: why they want to do it and how it will work. He discusses the limitations they have found and how Kafka benefits both in terms of stability and scalability by bringing consensus in house. He talks about their progress, what work is remaining, and how contributors can help. Filmed at qconsf.com. Colin McCabe is a Kafka committer at Confluent, working on the scalability and extensibility of Kafka. Previously, he worked on the Hadoop Distributed Filesystem and the Ceph Filesystem.

Kafka Needs No Keeper

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2SXXXiD. Katharina Probst talks about what it means to act like an owner and why teams need ownership to be high-performing. When team members, regardless of whether they have a formal leadership role or not, act like owners, magical things can happen. She shares ideas that we can apply to our own work, and talks about how to recognize when we don’t live up to our own expectations of acting like an owner. Filmed at qconsf.com. Katharina Probst is a Senior Engineering Leader, Kubernetes & SaaS at Google. Before this, she was leading engineering teams at Netflix, being responsible for the Netflix API, which helps bring Netflix streaming to millions of people around the world. Prior to joining Netflix, she was in the cloud computing team at Google, where she saw cloud computing from the provider side.

High Performing Teams Act Like Owners

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2T04Lw4. Sergey Kuksenko talks about the performance benefits inline types bring to Java and how to exploit them. Inline/value types are the key part of experimental project Valhalla, which should bring new abilities to the Java language. Filmed at qconsf.com. Sergey Kuksenko is a Java Performance Engineer at Oracle working on a variety of Java and JVM performance enhancements. He started working as Java Engineer in 1996 and as Java Performance Engineer in 2005. He has had a passion for exploring how Java works on modern hardware.

Does Java Need Inline Types? What Project Valhalla Can Bring to Java

C4Media

Do you need service meshes in your tech stack? This on-line guide aims to answer pertinent questions for software architects and technical leaders, such as: what is a service mesh?, do I need a service mesh?, how do I evaluate the different service mesh offerings? In software architecture, a service mesh is a dedicated infrastructure layer for facilitating service-to-service communications between microservices, often using a sidecar proxy.

Service Meshes- The Ultimate Guide

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2UgQ3BU. Christie Wilson describes what to expect from CI/CD in 2019, and how Tekton is helping bring that to as many tools as possible, such as Jenkins X and Prow. Wilson talks about Tekton itself and performs a live demo that shows how cloud native CI/CD can help debug, surface and fix mistakes faster. Filmed at qconsf.com. Christie Wilson is a software engineer at Google, currently leading the Tekton project. Over the past decade, she has worked in the mobile, financial and video game industries. Prior to working at Google she led a team of software developers to build load testing tools for AAA video game titles, and founded the Vancouver chapter of PyLadies.

Shifting Left with Cloud Native CI/CD

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2S7lDiS. Sasha Rosenbaum shows how a CI/CD pipeline for Machine Learning can greatly improve both productivity and reliability. Filmed at qconsf.com. Sasha Rosenbaum is a Program Manager on the Azure DevOps engineering team, focused on improving the alignment of the product with open source software. She is a co-organizer of the DevOps Days Chicago and the DeliveryConf conferences, and recently published a book on Serverless computing in Azure with .NET.

CI/CD for Machine Learning

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/36epVKg. Todd Montgomery discusses the techniques and lessons learned from implementing Aeron Cluster. His focus is on how Raft can be implemented on Aeron, minimizing the network round trip overhead, and comparing single process to a fully distributed cluster. Filmed at qconsf.com. Todd Montgomery is a networking hacker who has researched, designed, and built numerous protocols, messaging-oriented middleware systems, and real-time data systems, done research for NASA, contributed to the IETF and IEEE, and co-founded two startups. He currently works as an independent consultant and is active in several open source projects.

Fault Tolerance at Speed

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2FWc5Sk. Ben Sigelman talks about "Deep Systems", their common properties and re-introduces the fundamentals of control theory from the 1960s, including the original conceptualizations of Observability & Controllability. He uses examples from Google & other companies to illustrate how deep systems have damaged people's ability to observe software, and what needs to be done in order to regain control. Filmed at qconsf.com. Ben Sigelman is a co-founder and the CEO at LightStep, a co-creator of Dapper (Google’s distributed tracing system), and co-creator of the OpenTracing and OpenTelemetry projects (both part of the CNCF). His work and interests gravitate towards observability, especially where microservices, high transaction volumes, and large engineering organizations are involved.

Architectures That Scale Deep - Regaining Control in Deep Systems

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/39SddUL. Victor Dibia provides a friendly introduction to machine learning, covers concrete steps on how front-end developers can create their own ML models and deploy them as part of web applications. He discusses his experience building Handtrack.js - a library for prototyping real time hand tracking interactions in the browser. Filmed at qconsf.com. Victor Dibia is a Research Engineer with Cloudera’s Fast Forward Labs. Prior to this, he was a Research Staff Member at the IBM TJ Watson Research Center, New York. His research interests are at the intersection of human computer interaction, computational social science, and applied AI.

ML in the Browser: Interactive Experiences with Tensorflow.js

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2s9T3Vl. Colin Eberhardt looks at some of the internals of WebAssembly, explores how it works “under the hood”, and looks at how to create a (simple) compiler that targets this runtime. Filmed at qconsf.com. Colin Eberhardt is the Technology Director at Scott Logic, a UK-based software consultancy where they create complex application for their financial services clients. He is an avid technology enthusiast, spending his evenings contributing to open source projects, writing blog posts and learning as much as he can.

Build Your Own WebAssembly Compiler

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2S9tOgy. Satyajit Thadeshwar provides useful insights on how Netflix implemented a secure, token-agnostic, identity solution that works with services operating at a massive scale. He shares some of the lessons learned from this process, both from architectural diagrams and code. Filmed at qconsf.com. Satyajit Thadeshwar is an engineer on the Product Edge Access Services team at Netflix, where he works on some of the most critical services focusing on user and device authentication. He has more than a decade of experience building fault-tolerant and highly scalable, distributed systems.

User & Device Identity for Microservices @ Netflix Scale

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2Ezs08q. Justin Ryan talks about Netflix’ scalability issues and some of the ways they addressed it. He shares successes they’ve had from unintuitively partitioning computation into multiple services to get better runtime characteristics. He introduces us to useful probabilistic data structures, innovative bi-directional data passing, open-source projects available from Netflix that make this all possible. Filmed at qconsf.com. Justin Ryan is Playback Edge Engineering at Netflix. He works on some of the most critical services at Netflix, specifically focusing on user and device authentication. Years of building developer tools has also given him a healthy set of opinions on developer productivity.

Scaling Patterns for Netflix's Edge

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2Z4ZJjn. Kilian Valkhof discusses the process of making an Electron app feel at home on all three platforms: Windows, MacOS and Linux, making devs aware of the pitfalls and how to avoid them. Filmed at qconsf.com. Kilian Valkhof is a Front-end Developer & User-experience Designer at Firstversionist. He writes about various topics, from design to machine learning, on his personal website, kilianvalkhof.com and is a frequent contributer to open source software. He is part of the Electron governance team that oversees the development of the Electron framework.

Make Your Electron App Feel at Home Everywhere

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/344PnB1. Steve Klabnik goes over the deep details of how async/await works in Rust, covering concepts like coroutines, generators, stack-less vs stack-ful, "pinning", and more. Filmed at qconsf.com. Steve Klabnik is on the core team of Rust, leads the documentation team, and is an author of "The Rust Programming Language." He is a frequent speaker at conferences and is a prolific open source contributor, previously working on projects such as Ruby and Ruby on Rails.

The Talk You've Been Await-ing For

C4Media

Future of Data Engineering

C4Media

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2rm4hFD. Yevgeniy Brikman talks about how to write automated tests for infrastructure code, including the code written for use with tools such as Terraform, Docker, Packer, and Kubernetes. Topics covered include: unit tests, integration tests, end-to-end tests, dependency injection, test parallelism, retries and error handling, static analysis, property testing and CI / CD for infrastructure code. Filmed at qconsf.com. Yevgeniy Brikman is the co-founder of Gruntwork, a company that provides DevOps as a Service. He is the author of two books published by O'Reilly Media: Hello, Startup and Terraform: Up & Running. Previously, he worked as a software engineer at LinkedIn, TripAdvisor, Cisco Systems, and Thomson Financial.

Automated Testing for Terraform, Docker, Packer, Kubernetes, and More

C4Media

Mehr von C4Media (20)

Streaming a Million Likes/Second: Real-Time Interactions on Live Video

Next Generation Client APIs in Envoy Mobile

Software Teams and Teamwork Trends Report Q1 2020

Understand the Trade-offs Using Compilers for Java Applications

Kafka Needs No Keeper

High Performing Teams Act Like Owners

Does Java Need Inline Types? What Project Valhalla Can Bring to Java

Service Meshes- The Ultimate Guide

Shifting Left with Cloud Native CI/CD

CI/CD for Machine Learning

Fault Tolerance at Speed

Architectures That Scale Deep - Regaining Control in Deep Systems

ML in the Browser: Interactive Experiences with Tensorflow.js

Build Your Own WebAssembly Compiler

User & Device Identity for Microservices @ Netflix Scale

Scaling Patterns for Netflix's Edge

Make Your Electron App Feel at Home Everywhere

The Talk You've Been Await-ing For

Future of Data Engineering

Automated Testing for Terraform, Docker, Packer, Kubernetes, and More

Kürzlich hochgeladen

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Neo4j

The presentation explores the development and application of artificial intelligence (AI) from its inception to its current status in the modern world. The term "artificial intelligence" was first coined by John McCarthy in 1956 to describe efforts to develop computer programs capable of performing tasks that typically require human intelligence. This concept was first introduced at a conference held at Dartmouth College, where programs demonstrated capabilities such as playing chess, proving theorems, and interpreting texts. In the early stages, Alan Turing contributed to the field by defining intelligence as the ability of a being to respond to certain questions intelligently, proposing what is now known as the Turing Test to evaluate the presence of intelligent behavior in machines. As the decades progressed, AI evolved significantly. The 1980s focused on machine learning, teaching computers to learn from data, leading to the development of models that could improve their performance based on their experiences. The 1990s and 2000s saw further advances in algorithms and computational power, which allowed for more sophisticated data analysis techniques, including data mining. By the 2010s, the proliferation of big data and the refinement of deep learning techniques enabled AI to become mainstream. Notable milestones included the success of Google's AlphaGo and advancements in autonomous vehicles by companies like Tesla and Waymo. A major theme of the presentation is the application of generative AI, which has been used for tasks such as natural language text generation, translation, and question answering. Generative AI uses large datasets to train models that can then produce new, coherent pieces of text or other media. The presentation also discusses the ethical implications and the need for regulation in AI, highlighting issues such as privacy, bias, and the potential for misuse. These concerns have prompted calls for comprehensive regulations to ensure the safe and equitable use of AI technologies. Artificial intelligence has also played a significant role in healthcare, particularly highlighted during the COVID-19 pandemic, where it was used in drug discovery, vaccine development, and analyzing the spread of the virus. The capabilities of AI in healthcare are vast, ranging from medical diagnostics to personalized medicine, demonstrating the technology's potential to revolutionize fields beyond just technical or consumer applications. In conclusion, AI continues to be a rapidly evolving field with significant implications for various aspects of society. The development from theoretical concepts to real-world applications illustrates both the potential benefits and the challenges that come with integrating advanced technologies into everyday life. The ongoing discussion about AI ethics and regulation underscores the importance of managing these technologies responsibly to maximize their their benefits while minimizing potential harms.

Artificial Intelligence: Facts and Myths

Joaquim Jorge

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

GenAI Risks & Security Meetup 01052024.pdf

lior mazor

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

Heather Hedden, Senior Consultant at Enterprise Knowledge, presented “The Role of Taxonomy and Ontology in Semantic Layers” at a webinar hosted by Progress Semaphore on April 16, 2024. Taxonomies at their core enable effective tagging and retrieval of content, and combined with ontologies they extend to the management and understanding of related data. There are even greater benefits of taxonomies and ontologies to enhance your enterprise information architecture when applying them to a semantic layer. A survey by DBP-Institute found that enterprises using a semantic layer see their business outcomes improve by four times, while reducing their data and analytics costs. Extending taxonomies to a semantic layer can be a game-changing solution, allowing you to connect information silos, alleviate knowledge gaps, and derive new insights. Hedden, who specializes in taxonomy design and implementation, presented how the value of taxonomies shouldn’t reside in silos but be integrated with ontologies into a semantic layer. Learn about: - The essence and purpose of taxonomies and ontologies in information and knowledge management; - Advantages of semantic layers leveraging organizational taxonomies; and - Components and approaches to creating a semantic layer, including the integration of taxonomies and ontologies

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Enterprise Knowledge

Presentation on how to chat with PDF using ChatGPT code interpreter

naman860154

What is a good lead in your organisation? Which leads are priority? What happens to leads? When sales and marketing give different answers to these questions, or perhaps aren't sure of the answers at all, frustrations build and opportunities are left on the table. Join us for an illuminating session with Cian McLoughlin, HubSpot Principal Customer Success Manager, as we look at that crucial piece of the customer journey in which leads are transferred from marketing to sales.

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

HampshireHUG

[2024]Digital Global Overview Report 2024 Meltwater.pdf

hans926745

Handwritten Text Recognition for manuscripts and early printed texts

Maria Levchenko

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Histor y of HAM Radio presentation slide

vu2urc

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

What are drone anti-jamming systems? The drone anti-jamming systems and anti-spoof technology protect against interference, jamming, and spoofing of the UAVs. To protect their security, countries are beginning to research drone anti-jamming systems, also known as drone strike weapons. The anti-jam and anti-spoof technology protects against interference, jamming and spoofing. A drone strike weapon is a drone attack weapon that can attack and destroy enemy drones. So what is so unique about this amazing system?

What Are The Drone Anti-jamming Systems Technology?

Antenna Manufacturer Coco

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Safe Software

CNv6 Instructor Chapter 6 Quality of Service

giselly40

BooK Now Call us at +918448380779 to hire a gorgeous and seductive call girl for sex. Take a Delhi Escort Service. The help of our escort agency is mostly meant for men who want sexual Indian Escorts In Delhi NCR. It should be noted that any impersonator will get 100 attention from our Young Girls Escorts in Delhi. They will assume the position of reliable allies. VIP Call Girl With Original Photos Book Tonight +918448380779 Our Cheap Price 1 Hour not available 2 Hours 5000 Full Night 8000 TAG: Call Girls in Delhi, Noida, Gurgaon, Ghaziabad, Connaught Place, Greater Kailash Delhi, Lajpat Nagar Delhi, Mayur Vihar Delhi, Chanakyapuri Delhi, New Friends Colony Delhi, Majnu Ka Tilla, Karol Bagh, Malviya Nagar, Saket, Khan Market, Noida Sector 18, Noida Sector 76, Noida Sector 51, Gurgaon Mg Road, Iffco Chowk Gurgaon, Rajiv Chowk Gurgaon All Delhi Ncr Free Home Deliver

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men

Delhi Call girls

Scaling API-first – The story of a global engineering organization

Radu Cotescu

Kürzlich hochgeladen (20)

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Artificial Intelligence: Facts and Myths

Strategies for Landing an Oracle DBA Job as a Fresher

GenAI Risks & Security Meetup 01052024.pdf

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Presentation on how to chat with PDF using ChatGPT code interpreter

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

[2024]Digital Global Overview Report 2024 Meltwater.pdf

Handwritten Text Recognition for manuscripts and early printed texts

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Histor y of HAM Radio presentation slide

Boost Fertility New Invention Ups Success Rates.pdf

What Are The Drone Anti-jamming Systems Technology?

Powerful Google developer tools for immediate impact! (2023-24 C)

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

CNv6 Instructor Chapter 6 Quality of Service

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men

Scaling API-first – The story of a global engineering organization

Scaling Uber's Real-time Market Platform

1. SCALINGUBER’S REALTIMEMARKET PLATFORM QCON LONDON 2015

2. InfoQ.com: News & Community Site • 750,000 unique visitors/month • Published in 4 languages (English, Chinese, Japanese and Brazilian Portuguese) • Post content from our QCon conferences • News 15-20 / week • Articles 3-4 / week • Presentations (videos) 12-15 / week • Interviews 2-3 / week • Books 1 / month Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations /uber-market-platform

3. Presented at QCon London www.qconlondon.com Purpose of QCon - to empower software development by facilitating the spread of knowledge and innovation Strategy - practitioner-driven conference designed for YOU: influencers of change and innovation in your teams - speakers and topics driving the evolution and innovation - connecting and catalyzing the influencers and innovators Highlights - attended by more than 12,000 delegates since 2007 - held in 9 cities worldwide

10.

11.

12.

13.

14.

15.

16.

17. partners riders dispatch post trip processing money maps / ETA services databases

18. partners riders dispatch post trip processing money maps / ETA services databases

19. partners riders dispatch post trip processing money maps / ETA services databases

20. partners riders dispatch post trip processing money maps / ETA services databases

21. partners riders dispatch post trip processing money maps / ETA services databases

22. MICROSERVICES

23. partners riders dispatch post trip processing money maps / ETA services databases

24. partners riders dispatch post trip processing money maps / ETA services databases

25. partners riders dispatch post trip processing money maps / ETA services databases

26. partners riders dispatch post trip processing money maps / ETA services databases

27. dispatch post trip processing money maps / ETA services databases

28.

29. •1 rider, 1 vehicle •Moving people •Sharding by city •MPOF PROBLEMS

30. dispatch post trip processing money maps / ETA services databases

31. supply humans demand humans demandsupply Dispatch

32. supply humans demand humans demandsupply Dispatch

33. supply humans demand humans demandsupply Dispatch

34. supply humans demand humans demandsupply Dispatch DISCO

35. supply humans demand humans demandsupply Dispatch DISCO geo by supply geo by demandrouting / ETA

36. supply humans demand humans demandsupply Dispatch DISCO geo by supply geo by demandrouting / ETA

37. demandsupply Dispatch DISCO geo by supply geo by demandrouting / ETA

38. Source: Geometry on the Sphere: Google's S2 Library

39. Source: Geometry on the Sphere: Google's S2 Library

40.

41.

42.

43.

44. •reduce waiting •reduce extra driving •lowest overall ETAs GOALS

45. D1 Pickup request S1 best ETA +8 mins time S1 pickup after 8 mins

46. time S2 drop off +2 mins S2 ETA from drop off +1 min D1 Pickup request S1 best ETA +8 mins S1 pickup after 8 mins

47. time D1 Pickup request S2 best ETA +3 mins S2 pickup after 3 mins

48. time S2 pickup D2 D1 Pickup request S2 best ETA +3 mins D2 Pickup request S2 best ETA +1 mins S2 pickup D1 S2 drop off D1 S2 drop off D2

49. demandsupply Dispatch DISCO geo by supply geo by demandrouting / ETA

50.

51.

52.

53.

54. •performance •forwarding •language support •proper pipelining •checksums / tracing •encapsulation GOALS

55.

56. AVAILABILITY •everything retryable •everything killable •crash only •small pieces

57. CULTURAL CHANGES •no pairs •kill everything •even databases

58. load balancerservice A service B

59. load balancer service A service B

60.

61.

62. •overall latency ≥ latency of slowest component •1ms avg, 1000ms p99 •use 1: 1% at least 1000ms •use 100: 63% at least 1000ms •1.0 - 0.99^100 = 0.634 = 63.4% LATENCY

63. service A service B (1) service B (2) req 1, also B (2) +5ms req 1, also B (1) cancel req 1

64. DATACENTER FAILURE

65. partner app dispatch DC1 Location Updates State Digest dispatch DC2 Location Updates State Request

66. THANKS

67. Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations/uber- market-platform

Scaling Uber's Real-time Market Platform

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (6)

Ähnlich wie Scaling Uber's Real-time Market Platform

Ähnlich wie Scaling Uber's Real-time Market Platform (20)

Mehr von C4Media

Mehr von C4Media (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Scaling Uber's Real-time Market Platform