MySQL And Search At Craigslist

•Als ODP, PDF herunterladen•

28 gefällt mir•14,763 views

Jeremy Zawodny

My talk as given at the 2009 MySQL Conference and Expo in Santa Clara, CA

Technologie

MySQL and Search at Craigslist ,[object Object],[object Object],[object Object],[object Object],[object Object]

Who Am I? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What is Craigslist? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What is Craigslist? ,[object Object],[object Object],[object Object]

Technical and other Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Goals ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Craigslist Internals Overview Perl + memcached Apache 1.3 + mod_perl Perl + memcached MySQL 5.0.xx Sphinx ... Load Balancer Read Proxy Array Write Proxy Array Web Read Array Object Cache Read DB Cluster Not Included : - user db, image db - async tasks, email - accounting, internal tools - and more! Search Cluster

Vertical Partitioning: Roles Users Classifieds Users Classifieds Forums Stats Archive Write Read Long Trash

Vertical Partitioning ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Horizontal Partitioning: Hydra cluster_01 cluster_02 cluster_03 cluster_N ... client

Horizontal Partitioning: Hydra ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Search Evolution ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

MySQL Full-Text Problems ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx: My First CL Project ,[object Object],[object Object],[object Object],[object Object],[object Object]

Search Implementation Details ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx Incremental Indexing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx Issues ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Search Project Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx Wishlist ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data Archiving, Replication, Indexes ,[object Object],[object Object],[object Object],[object Object]

Data Archiving: OOB Replication ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Long Term Data Archiving ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Drizzle, XtraDB, Future Stuff ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

We're Hiring! ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Empfohlen

Living with SQL and NoSQL at craigslist, a Pragmatic ApproachJeremy Zawodny

Real time analytics at uber @ strata data 2019Zhenxiao Luo

Percona XtraDB Cluster ( Ensure high Availability )Mydbops

Facebook Messages & HBase强王

Kea DHCP – the new open source DHCP server from ISCMen and Mice

LMAX Disruptor as real-life exampleGuy Nir

Google jeff dean lessons learned while building infrastructure software at go...xu liwei

Troubleshooting Kerberos in Hadoop: Taming the BeastDataWorks Summit

Empfohlen

Living with SQL and NoSQL at craigslist, a Pragmatic ApproachJeremy Zawodny

Real time analytics at uber @ strata data 2019Zhenxiao Luo

Percona XtraDB Cluster ( Ensure high Availability )Mydbops

Facebook Messages & HBase强王

Kea DHCP – the new open source DHCP server from ISCMen and Mice

LMAX Disruptor as real-life exampleGuy Nir

Google jeff dean lessons learned while building infrastructure software at go...xu liwei

Troubleshooting Kerberos in Hadoop: Taming the BeastDataWorks Summit

[若渴計畫] Challenges and Solutions of Window Remote ShellcodeAj MaChInE

Thousands of Threads and Blocking I/OGeorge Cao

PostgreSQL Replication High Availability MethodsMydbops

PostgreSQL HAharoonm

Auditing and Monitoring PostgreSQL/EPASEDB

Showdown: IBM DB2 versus Oracle Database for OLTPcomahony

Neo4j - 5 cool graph examplesPeter Neubauer

Postgresql 12 streaming replication holVijay Kumar N

MySQL Scalability and Reliability for Replicated EnvironmentJean-François Gagné

Performance Tuning RocksDB for Kafka Streams' State Stores (Dhruba Borthakur,...confluent

Vitess: Scalable Database Architecture - Kubernetes Community Days Africa Ap...Alkin Tezuysal

The Missing Manual for Leveled Compaction Strategy (Wei Deng & Ryan Svihla, D...DataStax

Persistência Poliglota, Big Data e NoSQL FISL 15Christiano Anderson

Using all of the high availability options in MariaDBMariaDB plc

Building ClickHouse and Making Your First Contribution: A Tutorial_06.10.2021Altinity Ltd

MySQL InnoDB Cluster 소개rockplace

patroni-based citrus high availability environment deploymenthyeongchae lee

Percona XtraDB ClusterKenny Gryp

Beginner's Guide to High Availability for PostgresEDB

In-memory OLTP storage with persistence and transaction supportAlexander Korotkov

Lessons Learned Migrating 2+ Billion Documents at CraigslistJeremy Zawodny

Realtime Search Infrastructure at Craigslist (OpenWest 2014)Jeremy Zawodny

Weitere ähnliche Inhalte

Was ist angesagt?

[若渴計畫] Challenges and Solutions of Window Remote ShellcodeAj MaChInE

Thousands of Threads and Blocking I/OGeorge Cao

PostgreSQL Replication High Availability MethodsMydbops

PostgreSQL HAharoonm

Auditing and Monitoring PostgreSQL/EPASEDB

Showdown: IBM DB2 versus Oracle Database for OLTPcomahony

Neo4j - 5 cool graph examplesPeter Neubauer

Postgresql 12 streaming replication holVijay Kumar N

MySQL Scalability and Reliability for Replicated EnvironmentJean-François Gagné

Performance Tuning RocksDB for Kafka Streams' State Stores (Dhruba Borthakur,...confluent

Vitess: Scalable Database Architecture - Kubernetes Community Days Africa Ap...Alkin Tezuysal

The Missing Manual for Leveled Compaction Strategy (Wei Deng & Ryan Svihla, D...DataStax

Persistência Poliglota, Big Data e NoSQL FISL 15Christiano Anderson

Using all of the high availability options in MariaDBMariaDB plc

Building ClickHouse and Making Your First Contribution: A Tutorial_06.10.2021Altinity Ltd

MySQL InnoDB Cluster 소개rockplace

patroni-based citrus high availability environment deploymenthyeongchae lee

Percona XtraDB ClusterKenny Gryp

Beginner's Guide to High Availability for PostgresEDB

In-memory OLTP storage with persistence and transaction supportAlexander Korotkov

Was ist angesagt? (20)

[若渴計畫] Challenges and Solutions of Window Remote Shellcode

Thousands of Threads and Blocking I/O

PostgreSQL Replication High Availability Methods

PostgreSQL HA

Auditing and Monitoring PostgreSQL/EPAS

Showdown: IBM DB2 versus Oracle Database for OLTP

Neo4j - 5 cool graph examples

Postgresql 12 streaming replication hol

MySQL Scalability and Reliability for Replicated Environment

Performance Tuning RocksDB for Kafka Streams' State Stores (Dhruba Borthakur,...

Vitess: Scalable Database Architecture - Kubernetes Community Days Africa Ap...

The Missing Manual for Leveled Compaction Strategy (Wei Deng & Ryan Svihla, D...

Persistência Poliglota, Big Data e NoSQL FISL 15

Using all of the high availability options in MariaDB

Building ClickHouse and Making Your First Contribution: A Tutorial_06.10.2021

MySQL InnoDB Cluster 소개

patroni-based citrus high availability environment deployment

Percona XtraDB Cluster

Beginner's Guide to High Availability for Postgres

In-memory OLTP storage with persistence and transaction support

Andere mochten auch

Lessons Learned Migrating 2+ Billion Documents at CraigslistJeremy Zawodny

Realtime Search Infrastructure at Craigslist (OpenWest 2014)Jeremy Zawodny

Fusion-io and MySQL at CraigslistJeremy Zawodny

Social Media Trends - Content CurationChris Mikulin

SphinxSearchPrzemyslaw Wroblewski

Managing Big Data with MySQLmwasaha mwagambo

Sphinx at Craigslist in 2012Jeremy Zawodny

Chipotle Buyer PersonaCrismerly Santibañez

Chipotle Buyer Persona Esther Khoudari

Ahlstrom Financial Statements 2016 & Interim Report Q4/2016Ahlstrom-Munksjö

Top 5 Trends in Local Advertising David Shaner

Sphinx - High performance full-text search for MySQLNguyen Van Vuong

Chipolte buyer personaCaroline Redmond

Craigee Pitch Presentationcraigee

Four Tech Trends for 2017Peter Pajor

Localyser - An Introductionsps:affinity

Nancy Kruse - Spotting Millennial Food TrendsJohn Blue

Why Your MongoDB Needs RedisItamar Haber

Mobile UX-COESatyajit Roy

Youth Trends & InsightsJason Newport

Andere mochten auch (20)

Lessons Learned Migrating 2+ Billion Documents at Craigslist

Realtime Search Infrastructure at Craigslist (OpenWest 2014)

Fusion-io and MySQL at Craigslist

Social Media Trends - Content Curation

SphinxSearch

Managing Big Data with MySQL

Sphinx at Craigslist in 2012

Chipotle Buyer Persona

Ahlstrom Financial Statements 2016 & Interim Report Q4/2016

Top 5 Trends in Local Advertising

Sphinx - High performance full-text search for MySQL

Chipolte buyer persona

Craigee Pitch Presentation

Four Tech Trends for 2017

Localyser - An Introduction

Nancy Kruse - Spotting Millennial Food Trends

Why Your MongoDB Needs Redis

Mobile UX-COE

Youth Trends & Insights

Ähnlich wie MySQL And Search At Craigslist

My Sql And Search At CraigslistMySQLConference

UnConference for Georgia Southern Computer Science March 31, 2015Christopher Curtin

Open source TechnologyAmardeep Vishwakarma

Object- Relational Persistence in SmalltalkESUG

Introduction to MongoDBJustin Smestad

Scaling your websiteAlejandro Marcu

Getting Started with Amazon RedshiftAmazon Web Services

Spark Summit EU talk by Shay Nativ and Dvir VolkSpark Summit

AWS Webcast - Build high-scale applications with Amazon DynamoDBAmazon Web Services

MinneBar 2013 - Scaling with CassandraJeff Smoley

Why databases cry at nightMichael Yarichuk

Deep Dive in Big DataAmazon Web Services

Agility and Scalability with MongoDBMongoDB

From a student to an apache committer practice of apache io tdbjixuan1989

Case Study: Elasticsearch Ingest Using StreamSets at Cisco IntercloudRick Bilodeau

Case Study: Elasticsearch Ingest Using StreamSets @ Cisco IntercloudStreamsets Inc.

Introduction to Azure DocumentDBDenny Lee

Java EE 7 with Apache Spark for the World’s Largest Credit Card Core Systems ...Hirofumi Iwasaki

Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010Bhupesh Bansal

Hadoop and Voldemort @ LinkedInHadoop User Group

Ähnlich wie MySQL And Search At Craigslist (20)

My Sql And Search At Craigslist

UnConference for Georgia Southern Computer Science March 31, 2015

Open source Technology

Object- Relational Persistence in Smalltalk

Introduction to MongoDB

Scaling your website

Getting Started with Amazon Redshift

Spark Summit EU talk by Shay Nativ and Dvir Volk

AWS Webcast - Build high-scale applications with Amazon DynamoDB

MinneBar 2013 - Scaling with Cassandra

Why databases cry at night

Deep Dive in Big Data

Agility and Scalability with MongoDB

From a student to an apache committer practice of apache io tdb

Case Study: Elasticsearch Ingest Using StreamSets at Cisco Intercloud

Case Study: Elasticsearch Ingest Using StreamSets @ Cisco Intercloud

Introduction to Azure DocumentDB

Java EE 7 with Apache Spark for the World’s Largest Credit Card Core Systems ...

Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010

Hadoop and Voldemort @ LinkedIn

Kürzlich hochgeladen

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...apidays

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot

CNIC Information System with Pakdata Cf In Pakistandanishmna97

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood

Platformless Horizons for Digital AdaptabilityWSO2

Corporate and higher education May webinar.pptxRustici Software

Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya

FWD Group - Insurer Innovation Award 2024The Digital Insurer

[BuildWithAI] Introduction to Gemini.pdfSandro Moreira

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10

Exploring Multimodal Embeddings with MilvusZilliz

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software

Apidays New York 2024 - The value of a flexible API Management solution for O...apidays

TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz

Kürzlich hochgeladen (20)

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

CNIC Information System with Pakdata Cf In Pakistan

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Platformless Horizons for Digital Adaptability

Corporate and higher education May webinar.pptx

Artificial Intelligence Chap.5 : Uncertainty

FWD Group - Insurer Innovation Award 2024

[BuildWithAI] Introduction to Gemini.pdf

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Exploring Multimodal Embeddings with Milvus

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Apidays New York 2024 - The value of a flexible API Management solution for O...

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

MySQL And Search At Craigslist

3. What is Craigslist?

9. Craigslist Internals Overview Perl + memcached Apache 1.3 + mod_perl Perl + memcached MySQL 5.0.xx Sphinx ... Load Balancer Read Proxy Array Write Proxy Array Web Read Array Object Cache Read DB Cluster Not Included : - user db, image db - async tasks, email - accounting, internal tools - and more! Search Cluster

10. Vertical Partitioning: Roles Users Classifieds Users Classifieds Forums Stats Archive Write Read Long Trash

11.

12. Horizontal Partitioning: Hydra cluster_01 cluster_02 cluster_03 cluster_N ... client

13.

14.

15.

16.

17.

18.

19. Sphinx Incremental Indexing

20.

21.

22.

23.

24.

25.

26.

27.

28.

29. Questions?