Fusion-io and MySQL at Craigslist

•Als PPTX, PDF herunterladen•

16 gefällt mir•3,943 views

J

My talk from the 2011 Percona Live conference in San Francisco.

Fusion-io and MySQL 5.5at Craigslist Jeremy Zawodny Jeremy@Zawodny.com jzawodn@craigslist.org

Story Time (but first, some architecture and numbers)

Some Numbers ~100,000,000 postings in live database Over 1,000,000,000 page views daily High churn rate (avg lifetime ~14 days) ~350-500GB on disk MySQL 5.5.x and InnoDB Compression Used to be ~100-150GB larger (or more!) All records touched multiple times 98% of queries are OLTP

The Posting Cache Web Server Tier (apache/mod_perl) Posting Cache Tier (memcached + perl) Database Tier (MySQL)

The Problem Adding more memcached nodes Lots of cache misses initially MySQL boxes take a big query load (time passes) MySQL boxes pegged many hours later (time passes) Next day: WTF?!

Fire! Web Server Tier (apache/mod_perl) We were sending nearly 30% of requests all the way back to the DB tier instead of the normal 2-5% Posting Cache Tier (memcached + perl) Database Tier (MySQL)

Solution Let’s put the New Hardware in the pool Add 4 machines And it still sucked… The 4 were fast but only took ~20% of the hits Remove all the Old Hardware Remove 14 of 18 machines Sounds totally sane, right?

Old Hardware 3 years old 3U, Dual AMD 2218 HE 32GB RAM 16 15k RPM SAS disks RAID-10 ~2,000 iops/sec ~325 watts

New Hardware HP DL-380G6 Intel Xeon X5570 Dual Proc, Quad Core, HT 16 “cores” Dual Fusion-io 640GB SLC Software RAID-0 ~80,000 iops/sec (conservative) ~200 watts

Before and After Load Average I/O Capacity of Data Disks Night and Day! Old boxes return to “steady state”

This Chart Should be Green Average power for Fusion-io equipped server: ~200 watts. It was closer to 160 when replicating but not serving traffic.

Fusion-io FTW Can you tell when this machine started getting live traffic? OLTP means disk matters WAY more than CPU Into the fire!

The Numbers Old: 2,000iops / 325W = 6.15 iops/watt New: 40,000iops / 200W = 200 iops/watt Conservatively assumes a lot of degradation 33-66x performance/watt But let’s just call it 50x

Epilogue A week later, we re-purposed 1 Fusion-io box The cache eventually did fill Poor slab size configuration had been causing early expiration of cached objects 14 “old” servers: 4,500 watts 28,000 iops/sec capacity 3 “new” servers: 570 watts 240,000+ iops/sec capacity What to do with 10+ spare “db class” boxes?

Weitere ähnliche Inhalte

Was ist angesagt?

A presentation by Redis Labs' CTO, Yiftach Shoolman, given at the July 2nd meet up, hosted by I am OnDemand and IGT Cloud at the Microsoft ILDC Auditorium. See the video at: https://www.youtube.com/watch?v=eymqHZaUOH4 In this In this session Yiftach shares tips on how the company manages 50,000+ scalable and highly avaliable Redis databases over the 4 largest public clouds, 8 leading Platforms-as-a-Service, and across 10 geographical regions. He explains the service's back-end architecture, the open-source projects it uses, and which tools the company builds in-house. Shoolman also shares what Redis Labs' small DevOps team does automatically, and what it still does manually. Finally, he offers advice on how to build a strong R&D team that lives and breathes DevOps. Since the company launched its Redis Cloud service, it has dealt with 150+ node failure events and a half-dozen complete data-center outages. In addition, its team has experienced many interesting scenarios, such as hard to believe scaling patterns like 0 to a few hundreds gigabytes of in-memory data in just a few minutes, and 0 to 300K+ ops/sec in just a few seconds.

Managing 50K+ Redis Databases Over 4 Public Clouds ... with a Tiny Devops Team

Managing 50K+ Redis Databases Over 4 Public Clouds ... with a Tiny Devops Team

Managing 50K+ Redis Databases Over 4 Public Clouds ... with a Tiny Devops Team

Optimizing MongoDB: Lessons Learned at Localytics

Optimizing MongoDB: Lessons Learned at Localytics

Optimizing MongoDB: Lessons Learned at Localytics

В этом докладе я собираюсь поделиться нашим опытом обхода испанского интернета. Мы поставили перед собой задачу обойти около 600 тысяч веб-сайтов в зоне .es с целью сбора статистики об узлах и их размерах. Я расскажу об архитектуре робота, хранилища, проблемах, с которыми мы столкнулись при обходе, и их решении. Наше решение доступно в форме open source фреймворка Frontera. Фреймворк позволяет построить распределенного робота для скачивания страниц из Интернета в больших объемах в реальном времени. Также он может быть использован для построения сфокусированных роботов для выкачивания подмножества заранее известных веб-сайтов. Фреймворк предлагает: настраиваемое хранилище URL документов (RDBMS или Key Value), управление стратегиями обхода, абстракцию транспортного уровня, абстракцию модуля загрузки. Доклад построен в увлекательной форме: описание проблемы, решение и проблемы, которые возникли в ходе разработки решения.

Frontera распределенный робот для обхода веба в больших объемах / Александр С...

Frontera распределенный робот для обхода веба в больших объемах / Александр С...

Frontera распределенный робот для обхода веба в больших объемах / Александр С...

«Scrapy internals» Александр Сибиряков, Scrapinghub

«Scrapy internals» Александр Сибиряков, Scrapinghub

«Scrapy internals» Александр Сибиряков, Scrapinghub

Introduction to Redis

Introduction to Redis

Introduction to Redis

MongoUK - Approaching 1 billion documents with MongoDB1 Billion Documents

MongoUK - Approaching 1 billion documents with MongoDB1 Billion Documents

MongoUK - Approaching 1 billion documents with MongoDB1 Billion Documents

Webinar - Approaching 1 billion documents with MongoDB

Webinar - Approaching 1 billion documents with MongoDB

Webinar - Approaching 1 billion documents with MongoDB

This is an intro to Sphinx and PHP. It will take you through the very basics of how Sphinx works, how you can set up an index, and using the mysql client to search your index. Then, it culminates in a quick little PHP script that builds a small search interface around your index. I will be posting the example code into my github account soon. This presentation was given to the LV PHP meetup on August 5th.

Using Sphinx for Search in PHP

Using Sphinx for Search in PHP

Using Sphinx for Search in PHP

Boosting Machine Learning with Redis Modules and Spark

Boosting Machine Learning with Redis Modules and Spark

Boosting Machine Learning with Redis Modules and Spark

MongoFr : MongoDB as a log Collector

MongoFr : MongoDB as a log Collector

MongoFr : MongoDB as a log Collector

企業・業界情報プラットフォームSPEEDAにおけるElasticsearchの活用

企業・業界情報プラットフォームSPEEDAにおけるElasticsearchの活用

企業・業界情報プラットフォームSPEEDAにおけるElasticsearchの活用

With growing trend of Big data, companies are tend to rely on high cost SIEM solutions. However, with introduction of open source and lightweight cluster management solution like ElasticSearch this has been the highlight of the year. Similarly, the log aggregation has been simplified by logstash and kibana providing a visual look to the complex data structure. This presentation will exactly cater to this need of having a appropriate log analysis+Detecting Intrusion+Visualizing data in a powerful interface.

Attack monitoring using ElasticSearch Logstash and Kibana

Attack monitoring using ElasticSearch Logstash and Kibana

Attack monitoring using ElasticSearch Logstash and Kibana

Prajal Kulkarni

A simple introduction to redis

A simple introduction to redis

A simple introduction to redis

MyRocks Deep Dive

MyRocks Deep Dive

MyRocks Deep Dive

Yoshinori Matsunobu

Ops Jumpstart: Admin 101

Ops Jumpstart: Admin 101

Ops Jumpstart: Admin 101

Fluentd - Flexible, Stable, Scalable

Fluentd - Flexible, Stable, Scalable

Fluentd - Flexible, Stable, Scalable

Webinar Back to Basics 3 - Introduzione ai Replica Set

Webinar Back to Basics 3 - Introduzione ai Replica Set

Webinar Back to Basics 3 - Introduzione ai Replica Set

Monitoramento com ELK - Elasticsearch - Logstash - Kibana

Monitoramento com ELK - Elasticsearch - Logstash - Kibana

Monitoramento com ELK - Elasticsearch - Logstash - Kibana

PostgreSQL - масштабирование в моде, Valentine Gogichashvili (Zalando SE)

PostgreSQL - масштабирование в моде, Valentine Gogichashvili (Zalando SE)

PostgreSQL - масштабирование в моде, Valentine Gogichashvili (Zalando SE)

Mongodb

Was ist angesagt? (20)

Managing 50K+ Redis Databases Over 4 Public Clouds ... with a Tiny Devops Team

Managing 50K+ Redis Databases Over 4 Public Clouds ... with a Tiny Devops Team

Managing 50K+ Redis Databases Over 4 Public Clouds ... with a Tiny Devops Team

Optimizing MongoDB: Lessons Learned at Localytics

Optimizing MongoDB: Lessons Learned at Localytics

Optimizing MongoDB: Lessons Learned at Localytics

Frontera распределенный робот для обхода веба в больших объемах / Александр С...

Frontera распределенный робот для обхода веба в больших объемах / Александр С...

Frontera распределенный робот для обхода веба в больших объемах / Александр С...

«Scrapy internals» Александр Сибиряков, Scrapinghub

«Scrapy internals» Александр Сибиряков, Scrapinghub

«Scrapy internals» Александр Сибиряков, Scrapinghub

Introduction to Redis

Introduction to Redis

Introduction to Redis

MongoUK - Approaching 1 billion documents with MongoDB1 Billion Documents

MongoUK - Approaching 1 billion documents with MongoDB1 Billion Documents

MongoUK - Approaching 1 billion documents with MongoDB1 Billion Documents

Webinar - Approaching 1 billion documents with MongoDB

Webinar - Approaching 1 billion documents with MongoDB

Webinar - Approaching 1 billion documents with MongoDB

Using Sphinx for Search in PHP

Using Sphinx for Search in PHP

Using Sphinx for Search in PHP

Boosting Machine Learning with Redis Modules and Spark

Boosting Machine Learning with Redis Modules and Spark

Boosting Machine Learning with Redis Modules and Spark

MongoFr : MongoDB as a log Collector

MongoFr : MongoDB as a log Collector

MongoFr : MongoDB as a log Collector

企業・業界情報プラットフォームSPEEDAにおけるElasticsearchの活用

企業・業界情報プラットフォームSPEEDAにおけるElasticsearchの活用

企業・業界情報プラットフォームSPEEDAにおけるElasticsearchの活用

Attack monitoring using ElasticSearch Logstash and Kibana

Attack monitoring using ElasticSearch Logstash and Kibana

Attack monitoring using ElasticSearch Logstash and Kibana

A simple introduction to redis

A simple introduction to redis

A simple introduction to redis

MyRocks Deep Dive

MyRocks Deep Dive

MyRocks Deep Dive

Ops Jumpstart: Admin 101

Ops Jumpstart: Admin 101

Ops Jumpstart: Admin 101

Fluentd - Flexible, Stable, Scalable

Fluentd - Flexible, Stable, Scalable

Fluentd - Flexible, Stable, Scalable

Webinar Back to Basics 3 - Introduzione ai Replica Set

Webinar Back to Basics 3 - Introduzione ai Replica Set

Webinar Back to Basics 3 - Introduzione ai Replica Set

Monitoramento com ELK - Elasticsearch - Logstash - Kibana

Monitoramento com ELK - Elasticsearch - Logstash - Kibana

Monitoramento com ELK - Elasticsearch - Logstash - Kibana

PostgreSQL - масштабирование в моде, Valentine Gogichashvili (Zalando SE)

PostgreSQL - масштабирование в моде, Valentine Gogichashvili (Zalando SE)

PostgreSQL - масштабирование в моде, Valentine Gogichashvili (Zalando SE)

Mongodb

Andere mochten auch

SphinxSearch

Przemyslaw Wroblewski

Managing Big Data with MySQL

Managing Big Data with MySQL

Managing Big Data with MySQL

mwasaha mwagambo

Sphinx - High performance full-text search for MySQL

Sphinx - High performance full-text search for MySQL

Sphinx - High performance full-text search for MySQL

Nguyen Van Vuong

MySQL Indexing - Best practices for MySQL 5.6

MySQL Indexing - Best practices for MySQL 5.6

MySQL Indexing - Best practices for MySQL 5.6

The technology has almost written off MySQL as a database for new fancy NoSQL databases like MongoDB and Cassandra or even Hadoop for aggregation. But MySQL has a lot to offer in terms of 'ACID'ity, performance and simplicity. For many use-cases MySQL works well. In this week's ShareThis workshop we discuss different tips & techniques to improve performance and extend the lifetime of your MySQL deployment.

MySQL Performance Tips & Best Practices

MySQL Performance Tips & Best Practices

MySQL Performance Tips & Best Practices

As your data grows, the need to establish proper indexes becomes critical to performance. MongoDB supports a wide range of indexing options to enable fast querying of your data, but what are the right strategies for your application? In this talk we’ll cover how indexing works, the various indexing options, and use cases where each can be useful. We'll dive into common pitfalls using real-world examples to ensure that you're ready for scale.

Fast querying indexing for performance (4)

Fast querying indexing for performance (4)

Fast querying indexing for performance (4)

MySQL Performance Tuning: Top 10 Tips intended for PHP, Ruby and Java developers on performance tuning and optimization of MySQL. We will cover the deadly mistakes to be avoided. We will take real life examples of optimizing application many times. Here is the summary of what we intend to cover: • Selection of Storage Engine • Schema Optimization • Server Tuning • Hardware Selection and Tuning • Effective uses of Index, when to use and when not to use. • Partitions • Speeding up using Stored Procedures • Implementing prepared statements? • Deadly Sins to be avoided • Performance Tuning and Benchmarking Tools

MySQL Performance Tuning: Top 10 Tips

MySQL Performance Tuning: Top 10 Tips

MySQL Performance Tuning: Top 10 Tips

How to Design Indexes, Really

How to Design Indexes, Really

How to Design Indexes, Really

Karwin Software Solutions LLC

SQL is the winning language of Big Data. Whether you’re running a classic relational database, a column store (“NewSQL”), or a non-relational storage system (“NoSQL”), a powerful, declarative, SQL-based query language makes the difference. The SQL standard has evolved drastically in the past decades, and so have its commercial and open source implementations. In this fast-paced talk, we’re going to look at very peculiar and interesting data problems and how we can solve them with SQL. We’ll explore common table expressions, hierarchical SQL, table-valued functions, lateral joins, row value expressions, window functions, and advanced data types, such as XML and JSON. And we’ll look at Oracle’s mysterious MODEL and MATCH_RECOGNIZE clauses, devices whose mystery is only exceeded by their power. Most importantly, however, we’re going to learn that everyone can write advanced SQL. Once you learn the basics in these tricks, you’re going to love SQL even more.

10 SQL Tricks that You Didn't Think Were Possible

10 SQL Tricks that You Didn't Think Were Possible

10 SQL Tricks that You Didn't Think Were Possible

Video available here: http://vivu.tv/portal/archive.jsp?flow=783-586-4282&id=1270584002677 We all know that MongoDB is one of the most flexible and feature-rich databases available. In this webinar we'll discuss how you can leverage this feature set and maintain high performance with your project's massive data sets and high loads. We'll cover how indexes can be designed to optimize the performance of MongoDB. We'll also discuss tips for diagnosing and fixing performance issues should they arise.

Indexing with MongoDB

Indexing with MongoDB

Indexing with MongoDB

Andere mochten auch (10)

SphinxSearch

Managing Big Data with MySQL

Managing Big Data with MySQL

Managing Big Data with MySQL

Sphinx - High performance full-text search for MySQL

Sphinx - High performance full-text search for MySQL

Sphinx - High performance full-text search for MySQL

MySQL Indexing - Best practices for MySQL 5.6

MySQL Indexing - Best practices for MySQL 5.6

MySQL Indexing - Best practices for MySQL 5.6

MySQL Performance Tips & Best Practices

MySQL Performance Tips & Best Practices

MySQL Performance Tips & Best Practices

Fast querying indexing for performance (4)

Fast querying indexing for performance (4)

Fast querying indexing for performance (4)

MySQL Performance Tuning: Top 10 Tips

MySQL Performance Tuning: Top 10 Tips

MySQL Performance Tuning: Top 10 Tips

How to Design Indexes, Really

How to Design Indexes, Really

How to Design Indexes, Really

10 SQL Tricks that You Didn't Think Were Possible

10 SQL Tricks that You Didn't Think Were Possible

10 SQL Tricks that You Didn't Think Were Possible

Indexing with MongoDB

Indexing with MongoDB

Indexing with MongoDB

Ähnlich wie Fusion-io and MySQL at Craigslist

The Smug Mug Tale

The Smug Mug Tale

The Smug Mug Tale

MySQLConference

My Sql Performance On Ec2

My Sql Performance On Ec2

My Sql Performance On Ec2

MySQLConference

Hadoop has become a critical part of Criteo's operations. What started out as a proof of concept has turned into two in-house bare-metal clusters of over 2200 nodes. Hadoop contains the data required for billing and, perhaps even more importantly, the data used to create the machine learning models, computed every 6 hours by Hadoop, that participate in real time bidding for online advertising. Two clusters do not necessarily mean a redundant system, so Criteo must plan for any of the disasters that can destroy a cluster. This talk describes how Criteo built its second cluster in a new datacenter and how to do it better next time. How a small team is able to run and expand these clusters is explained. More importantly the talk describes how a redundant data and compute solution at this scale must function, what Criteo has already done to create this solution and what remains undone.

Pilot Hadoop Towards 2500 Nodes and Cluster Redundancy

Pilot Hadoop Towards 2500 Nodes and Cluster Redundancy

Pilot Hadoop Towards 2500 Nodes and Cluster Redundancy

IO Dubi Lebel

sqlserver.co.il

Sanger HPC infrastructure Report (2007)

Sanger HPC infrastructure Report (2007)

Sanger HPC infrastructure Report (2007)

SUE 2018 - Migrating a 130TB Cluster from Elasticsearch 2 to 5 in 20 Hours Wi...

SUE 2018 - Migrating a 130TB Cluster from Elasticsearch 2 to 5 in 20 Hours Wi...

SUE 2018 - Migrating a 130TB Cluster from Elasticsearch 2 to 5 in 20 Hours Wi...

Fred de Villamil

My Sql Performance In A Cloud

My Sql Performance In A Cloud

My Sql Performance In A Cloud

ABSTRACT: Fatture in Cloud was born in late 2013 on a single-server machine and scaled from zero to 35k customers at the end of 2018. Then, we faced the mandatory electronic invoicing which came into effect in Italy on 1st January 2019, and we experienced a huge growth to 350k customers in few months. In these 5 years, I've learned a lot about cloud architecture, scalability, optimization, DevOps, and we eventually achieved a 99,99% uptime even in the huge growth period. BIO: Daniele Ratti is the Founder and CEO of Fatture in Cloud, which is currently the leader invoicing platform in Italy, counting more than 350k customers.

Scaling an invoicing SaaS from zero to over 350k customers

Scaling an invoicing SaaS from zero to over 350k customers

Scaling an invoicing SaaS from zero to over 350k customers

Again music

Sql server scalability fundamentals

Sql server scalability fundamentals

Sql server scalability fundamentals

Have you heard that all in-memory databases are equally fast but unreliable, inconsistent and expensive? This session highlights in-memory technology that busts all those myths. Redis, the fastest database on the planet, is not a simply in-memory key-value data-store; but rather a rich in-memory data-structure engine that serves the world’s most popular apps. Redis Labs’ unique clustering technology enables Redis to be highly reliable, keeping every data byte intact despite hundreds of cloud instance failures and dozens of complete data-center outages. It delivers full CP system characteristics at high performance. And with the latest Redis on Flash technology, Redis Labs achieves close to in-memory performance at 70% lower operational costs. Learn about the best uses of in-memory computing to accelerate everyday applications such as high volume transactions, real time analytics, IoT data ingestion and more.

IMCSummit 2015 - Day 2 IT Business Track - 4 Myths about In-Memory Databases ...

IMCSummit 2015 - Day 2 IT Business Track - 4 Myths about In-Memory Databases ...

IMCSummit 2015 - Day 2 IT Business Track - 4 Myths about In-Memory Databases ...

In-Memory Computing Summit

A presentation about the deployment of an ELK stack at bol.com At bol.com we use Elasticsearch, Logstash and Kibana in a logsearch system that allows our developers and operations people to easilly access and search thru logevents coming from all layers of its infrastructure. The presentations explains the initial design and its failures. It continues with explaining the latest design (mid 2014). Its improvements. And finally a set of tips are giving regarding Logstash and Elasticsearch scaling. These slides were first presented at the Elasticsearch NL meetup on September 22nd 2014 at the Utrecht bol.com HQ.

Scaling an ELK stack at bol.com

Scaling an ELK stack at bol.com

Scaling an ELK stack at bol.com

Criteo had an Hadoop cluster with 39 PB raw stockage, 13404 CPUs, 105 TB RAM, 40 TB data imported per day and over 100000 jobs per day. This cluster was critical in both stockage and compute but without backups. After many efforts to increase our redundancy, we now have two clusters that, combined, have more than 2000 nodes, 130 PB, two different versions of Hadoop and 200000 jobs per day but these clusters do not yet provide a redundant solution to our all storage and compute needs. This talk discusses the choices and issues we solved in creating a 1200 node cluster with new hardware in a new data centre. Some of the challenges involved in running two different clusters in parallel will be presented. We will also analyse what went right (and wrong) in our attempt to achieve redundancy and our plans to improve our capacity to handle the loss of a data centre.

Redundancy for Big Hadoop Clusters is hard - Stuart Pook

Redundancy for Big Hadoop Clusters is hard - Stuart Pook

Redundancy for Big Hadoop Clusters is hard - Stuart Pook

Hoodie: Incremental processing on hadoop

Hoodie: Incremental processing on hadoop

Hoodie: Incremental processing on hadoop

Prasanna Rajaperumal

Nexcess Magento Imagine 2014 Performance Breakout

Nexcess Magento Imagine 2014 Performance Breakout

Nexcess Magento Imagine 2014 Performance Breakout

Nexcess.net LLC

ABSTRACT: Perlmutter is the newest supercomputer at Berkeley Lab, California, and features a whopping 35 PB all-flash Lustre file system. Let's dive into its architecture, showing some early performance figures and unique performance considerations, using low-level Lustre tests that achieve over 90% of the theoretical bandwidth of the SSDs, to showcase how Perlmutter achieves the performance of a burst buffer and the resilience of a scratch file system. Lastly, some performance considerations unique to an all-flash Lustre file system, along with tips on how better I/O patterns can make the most of such powerful architectures. BIO: Alberto Chiusole studied Data Science and Scientific Computing in Trieste when he had the opportunity to spend some months at CERN, in Geneva, benchmarking their Ceph file system against a classic Lustre file system from eXact lab, the HPC consulting company in Trieste he was working for at the time. After Trieste, he worked as a Storage and I/O Software Engineer at Berkeley Lab, California, a national scientific laboratory, where he assisted scientists with improving their I/O and data needs. He now works for Seqera Labs as an HPC DevOps Engineer, focusing on infrastructure support.

Architecting a 35 PB distributed parallel file system for science

Architecting a 35 PB distributed parallel file system for science

Architecting a 35 PB distributed parallel file system for science

How We Use MongoDB in Our Advertising System

How We Use MongoDB in Our Advertising System

How We Use MongoDB in Our Advertising System

LUG 2014

Apache con na_2013_updated_2016

Apache con na_2013_updated_2016

Apache con na_2013_updated_2016

Oracle Open World 2014: Lies, Damned Lies, and I/O Statistics [ CON3671]

Oracle Open World 2014: Lies, Damned Lies, and I/O Statistics [ CON3671]

Oracle Open World 2014: Lies, Damned Lies, and I/O Statistics [ CON3671]

Ähnlich wie Fusion-io and MySQL at Craigslist (20)

The Smug Mug Tale

The Smug Mug Tale

The Smug Mug Tale

My Sql Performance On Ec2

My Sql Performance On Ec2

My Sql Performance On Ec2

Pilot Hadoop Towards 2500 Nodes and Cluster Redundancy

Pilot Hadoop Towards 2500 Nodes and Cluster Redundancy

Pilot Hadoop Towards 2500 Nodes and Cluster Redundancy

IO Dubi Lebel

Sanger HPC infrastructure Report (2007)

Sanger HPC infrastructure Report (2007)

Sanger HPC infrastructure Report (2007)

SUE 2018 - Migrating a 130TB Cluster from Elasticsearch 2 to 5 in 20 Hours Wi...

SUE 2018 - Migrating a 130TB Cluster from Elasticsearch 2 to 5 in 20 Hours Wi...

SUE 2018 - Migrating a 130TB Cluster from Elasticsearch 2 to 5 in 20 Hours Wi...

My Sql Performance In A Cloud

My Sql Performance In A Cloud

My Sql Performance In A Cloud

Scaling an invoicing SaaS from zero to over 350k customers

Scaling an invoicing SaaS from zero to over 350k customers

Scaling an invoicing SaaS from zero to over 350k customers

Again music

Sql server scalability fundamentals

Sql server scalability fundamentals

Sql server scalability fundamentals

IMCSummit 2015 - Day 2 IT Business Track - 4 Myths about In-Memory Databases ...

IMCSummit 2015 - Day 2 IT Business Track - 4 Myths about In-Memory Databases ...

IMCSummit 2015 - Day 2 IT Business Track - 4 Myths about In-Memory Databases ...

Scaling an ELK stack at bol.com

Scaling an ELK stack at bol.com

Scaling an ELK stack at bol.com

Redundancy for Big Hadoop Clusters is hard - Stuart Pook

Redundancy for Big Hadoop Clusters is hard - Stuart Pook

Redundancy for Big Hadoop Clusters is hard - Stuart Pook

Hoodie: Incremental processing on hadoop

Hoodie: Incremental processing on hadoop

Hoodie: Incremental processing on hadoop

Nexcess Magento Imagine 2014 Performance Breakout

Nexcess Magento Imagine 2014 Performance Breakout

Nexcess Magento Imagine 2014 Performance Breakout

Architecting a 35 PB distributed parallel file system for science

Architecting a 35 PB distributed parallel file system for science

Architecting a 35 PB distributed parallel file system for science

How We Use MongoDB in Our Advertising System

How We Use MongoDB in Our Advertising System

How We Use MongoDB in Our Advertising System

LUG 2014

Apache con na_2013_updated_2016

Apache con na_2013_updated_2016

Apache con na_2013_updated_2016

Oracle Open World 2014: Lies, Damned Lies, and I/O Statistics [ CON3671]

Oracle Open World 2014: Lies, Damned Lies, and I/O Statistics [ CON3671]

Oracle Open World 2014: Lies, Damned Lies, and I/O Statistics [ CON3671]

Kürzlich hochgeladen

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

A Principled Technologies deployment guide Conclusion Deploying VMware Cloud Foundation 5.1 on next gen Dell PowerEdge servers brings together critical virtualization capabilities and high-performing hardware infrastructure. Relying on our hands-on experience, this deployment guide offers a comprehensive roadmap that can guide your organization through the seamless integration of advanced VMware cloud solutions with the performance and reliability of Dell PowerEdge servers. In addition to the deployment efficiency, the Cloud Foundation 5.1 and PowerEdge solution delivered strong performance while running a MySQL database workload. By leveraging VMware Cloud Foundation 5.1 and PowerEdge servers, you could help your organization embrace cloud computing with confidence, potentially unlocking a new level of agility, scalability, and efficiency in your data center operations.

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Principled Technologies

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

Why Teams call analytics are critical to your entire business

Why Teams call analytics are critical to your entire business

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

Gabriella Davis

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organization

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

Manulife - Insurer Innovation Award 2024

Manulife - Insurer Innovation Award 2024

Manulife - Insurer Innovation Award 2024

The Digital Insurer

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Real Time Object Detection Using Open CV

Real Time Object Detection Using Open CV

Real Time Object Detection Using Open CV

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Kürzlich hochgeladen (20)

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Why Teams call analytics are critical to your entire business

Why Teams call analytics are critical to your entire business

Why Teams call analytics are critical to your entire business

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organization

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

Manulife - Insurer Innovation Award 2024

Manulife - Insurer Innovation Award 2024

Manulife - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Real Time Object Detection Using Open CV

Real Time Object Detection Using Open CV

Real Time Object Detection Using Open CV

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Fusion-io and MySQL at Craigslist

1. Fusion-io and MySQL 5.5at Craigslist Jeremy Zawodny Jeremy@Zawodny.com jzawodn@craigslist.org

2. Story Time (but first, some architecture and numbers)

3. Some Numbers ~100,000,000 postings in live database Over 1,000,000,000 page views daily High churn rate (avg lifetime ~14 days) ~350-500GB on disk MySQL 5.5.x and InnoDB Compression Used to be ~100-150GB larger (or more!) All records touched multiple times 98% of queries are OLTP

4. The Posting Cache Web Server Tier (apache/mod_perl) Posting Cache Tier (memcached + perl) Database Tier (MySQL)

5. The Problem Adding more memcached nodes Lots of cache misses initially MySQL boxes take a big query load (time passes) MySQL boxes pegged many hours later (time passes) Next day: WTF?!

6. Fire! Web Server Tier (apache/mod_perl) We were sending nearly 30% of requests all the way back to the DB tier instead of the normal 2-5% Posting Cache Tier (memcached + perl) Database Tier (MySQL)

7. Solution Let’s put the New Hardware in the pool Add 4 machines And it still sucked… The 4 were fast but only took ~20% of the hits Remove all the Old Hardware Remove 14 of 18 machines Sounds totally sane, right?

8. Old Hardware 3 years old 3U, Dual AMD 2218 HE 32GB RAM 16 15k RPM SAS disks RAID-10 ~2,000 iops/sec ~325 watts

9. New Hardware HP DL-380G6 Intel Xeon X5570 Dual Proc, Quad Core, HT 16 “cores” Dual Fusion-io 640GB SLC Software RAID-0 ~80,000 iops/sec (conservative) ~200 watts

10. Before and After Load Average I/O Capacity of Data Disks Night and Day! Old boxes return to “steady state”

11. This Chart Should be Green Average power for Fusion-io equipped server: ~200 watts. It was closer to 160 when replicating but not serving traffic.

12. Fusion-io FTW Can you tell when this machine started getting live traffic? OLTP means disk matters WAY more than CPU Into the fire!

13. The Numbers Old: 2,000iops / 325W = 6.15 iops/watt New: 40,000iops / 200W = 200 iops/watt Conservatively assumes a lot of degradation 33-66x performance/watt But let’s just call it 50x

14. Epilogue A week later, we re-purposed 1 Fusion-io box The cache eventually did fill Poor slab size configuration had been causing early expiration of cached objects 14 “old” servers: 4,500 watts 28,000 iops/sec capacity 3 “new” servers: 570 watts 240,000+ iops/sec capacity What to do with 10+ spare “db class” boxes?