Cassandra at Glogster

•

0 gefällt mir•132 views

Roman Komkov presented on Cassandra at Glogster. Glogster EDU is an online platform used by 19 million users for presentation and learning, generating over 45,000 new projects daily. Glogster has used Cassandra since 2011 as its primary database, starting with 0.6-0.8 and upgrading over time. Currently it uses a 5 node cluster storing 600GB of data. Upgrades brought challenges around migration, repairs, and a data loss incident that took 10 days to repair after decommissioning an old datacenter without proper hints handling. Lessons included increasing repair windows, enabling parallel repairs, and regularly scheduling backups and repairs.

Software

Cassandra at Glogster
Roman Komkov – roman@glogster.com
System Engineer at Glogster
Prague Cassandra Meet up
03.09.2015

About me
  2 years at Glogster EDU as System Engineer
  5+ years of Linux administration
  5+ years of Python development
  Cluster, HA, Orchestration
  CI, CD…
  Twitter - @alkoengineering
GitHub, Freenode - decayofmind

About Glogster EDU
  Started in 2009
  Platform for presentation and interactive learning mainly
used by educators and students
  19 million users
  Over 45 million glogs
  40000 new glogs daily
  Web service, mobile applications
  http://edu.glogster.com

Cassandra at Glogster
  From 2011 as primary DB for initial Glogster.com
  From 2012 as backend (storage) DB for Glogster EDU
  Started from 0.6… or 0.8, I guess…
  10 nodes
  RF=5, QUORUM
  SATA disks
OrderPreservingPartitioner ¯_(ツ)_/¯

Cassandra now
  5 nodes cluster
  ~600Gb average node size
  RF=5, QUORUM
  SSD disks
VNodes
OrderPreservingPartitioner…
pycassa + datastax-driver

0.8 problems
  Migration with downtime by transferring a copy of data
HintedHandoff hell
  No repairs, no cleanups
  Enormous HeapSize (20GB)
  Different time on servers
SOLUTION!
  Upgrade to 1.0

1.1 problems
  Cassandra guy left Glogster
  Don’t touch it while it works
BUT…
  Load averages like 14.0-16.0
  2 disks failed
  Everything is slow
  Repairs? Never heard!

1.1 solutions
  Replace disks, rebuild nodes.
  Don’t try to run repair on new node instead of ReplaceToken
  Move old Glogster.com keyspace to another cluster
  Load gone
https://glogster.github.io/posts/2015/03/23/cassandra-
migration.html
  Nodes are fast again
  Regular repairs and cleanups? Never did!
OpsCenter installed
  Cluster upgraded to 1.2

1.2 and migration
  Cluster migrated to the new servers without
downtime
http://www.planetcassandra.org/blog/cassandra-migration-
to-ec2/
Vnodes
…

Old datacenter, connected to production was disconnected
from new datacenter
  Forgot about Hints TTL (max_hint_window_in_ms ~ 3 hours)
  Forgot to run repair on cluster after
  Old DC was decommissioned
  Application switched the new one
  …
DATA GONE

Here the hell begins
  ~ 1200 glogs remain on old decommissioned datacenter
  Thanks God, we have RF=<N of nodes>
  Transfer data from one old node to the new server
  Run Cassandra on it, add node to the cluster
  Run repair on entire cluster
  Increase repair chance with read_repair_chance
  Peacefully wait until done…
  Do your complicated repairs through OpsCenter, cause it can
continue if failed.

Conclusions and Improvements
  Increase max_hint_window_in_ms value to something like 3
days
  Make use of parallel things
  CQL3 and datastax-driver
  Upgrade to Cassandra 2.2
  faster repairs and other operations
  New OpsCenter
  Schedule regular backups and repairs
  We still love Cassandra!

Weitere ähnliche Inhalte

Was ist angesagt?

CERN, the European Organization for Nuclear Research, is running for several years a large OpenStack Cloud that helps thousands of scientists to analyze the data from the LHC. In 2012, early in the design phase of the CERN Cloud we decided to use Nova Cells to enable the infrastructure to scale to thousands of nodes. Now with more than 280K cores spread across 70 cells that are hosted in two data centres we were faced with the challenge to migrate to Nova Cells V2 required in the Pike release. In this presentation, we will describe how Nova Cells allowed CERN to scale to thousands of nodes, its advantages and how we mitigate the implementation issues of Nova Cells V1. Next, we will cover how we upgraded Nova from Newton with Cells V1 to Pike with Cells V2. We will explain the steps that we followed and the issues that we faced during the upgrade. Finally, we will report our experience with Cells V2 at scale, its caveats and how we are mitigate them. What can I expect to learn? This presentation describes how CERN migrated from Cells V1 to Cells V2 when upgraded from Newton to Pike release. You will learn the procedures followed by CERN in order to migrate Cells V1 to Cells V2 in a large production environment. The issues found during the upgrade and how we mitigate them will be discussed. Also, we will present how Cells V2 behaves in a large scale deployment with serveral thounsands nodes in 70 cells.

Moving from CellsV1 to CellsV2 at CERN

Belmiro Moreira

Stabilising the jenga tower

Gordon Chung

Processing Big Data in Real-Time - Yanai Franchi, Tikal

Codemotion Tel Aviv

CERN the European Laboratory for Nuclear Research and SKA the Square Kilmeter Array are preparing the next generation of research infrastructure for the new large scale scientific instruments that will produce new magnitudes of data. In Sydney OpenStack Summit we presented the collaboration and the platform that we plan to develop for scaling science. In this talk will present the work done related with Preemptible VMs and Containers on Baremetal. Preemptible VMs are instances that use idle allocated resources in the infrastructure and can be terminated when this capacity is required. Containers in Baremetal eliminate the virtualization overhead enabling the container full performance required for scientific workloads. We will present the current state, development and integration decisions and how these functionalities can be used in a common OpenStack infrastructure.

Containers on Baremetal and Preemptible VMs at CERN and SKA

Belmiro Moreira

A solid backup strategy is a DBA's bread and butter. Cassandra's nodetool snapshot makes it easy to back up the SSTable files, but there remains the question of where to put them and how. Knewton's backup strategy uses Ansible for distributed backups and stores them in S3. Unfortunately, it's all too easy to store backups that are essentially useless due to the absence of a coherent restoration strategy. This problem proved much more difficult and nuanced than taking the backups themselves. I will discuss Knewton's restoration strategy, which again leverages Ansible, yet I will focus on general principles and pitfalls to be avoided. In particular, restores necessitated modifying our backup strategy to generate cluster-wide metadata that is critical for a smooth automated restoration. Such pitfalls indicate that a restore-focused backup design leads to faster and more deterministic recovery. About the Speaker Joshua Wickman Database Engineer, Knewton Dr. Joshua Wickman is currently part of the database team at Knewton, a NYC tech company focused on adaptive learning. He earned his PhD at the University of Delaware in 2012, where he studied particle physics models of the early universe. After a brief stint teaching college physics, he entered the New York tech industry in 2014 working with NoSQL, first with MongoDB and then Cassandra. He was certified in Cassandra at his first Cassandra Summit in 2015.

Cassandra Backups and Restorations Using Ansible (Joshua Wickman, Knewton) | ...

DataStax

Cloud Solution Day 2016: Microservices on Mesos & Netflix OSS

AWS Vietnam Community

Mario on spark

Igor Berman

Gnocchi v3 brownbag

Gordon Chung

Cassandra at talkbits

Max Alexejev

Cern Cloud Architecture - February, 2016

Belmiro Moreira

Apache Incubator Samza: Stream Processing at LinkedIn

Chris Riccomini

Lightweight Transactions at Lightning Speed

ScyllaDB

20170926 cern cloud v4

Tim Bell

Frossie Economou & Angelo Fausti [Vera C. Rubin Observatory] | How InfluxDB H...

InfluxData

Let’s be honest: Running a distributed stateful stream processor that is able to handle terabytes of state and tens of gigabytes of data per second while being highly available and correct (in an exactly-once sense) does not work without any planning, configuration and monitoring. While the Flink developer community tries to make everything as simple as possible, it is still important to be aware of all the requirements and implications In this talk, we will provide some insights into the greatest operations mysteries of Flink from a high-level perspective: - Capacity and resource planning: Understand the theoretical limits. - Memory and CPU configuration: Distribute resources according to your needs. - Setting up High Availability: Planning for failures. - Checkpointing and State Backends: Ensure correctness and fast recovery For each of the listed topics, we will introduce the concepts of Flink and provide some best practices we have learned over the past years supporting Flink users in production.

Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...

Flink Forward

Multimaster

Stas Kelvich

Openstack Infrastructure Containerization

Keith Tobin

Clock

naniix21_3

Cloud Native Con 2016, Seattle: Talk by Moritz Kammerer (@phxql, Senior Software Engineer at QAware). Abstract: Prometheus is great when it comes to monitoring and alerting. But the long term storage opportunities are comparatively weak compared to related time series databases (missing data distribution, sharding etc.). At this point Chronix enters the stage. Chronix is an open source time series database. It focuses on an efficient long term storage both in terms of storage volume and access times. Chronix achieves a compression rate of 98% compared to data in CSV files while an average query took 21 milliseconds, determined in a benchmark asking 96 queries for different time ranges and time series. Chronix offers a multi-dimensional generic data model for storing all kinds of time series, functions for anomaly detection used in the frameworks EGADS and SAX, and an integration with Apache Spark allows for distributed time series processing. In this code-intense session we show the integration of Prometheus and Chronix. We also dig into the details of Chronix and explain why Chronix <3 Prometheus and vice versa. Furthermore we demonstrate a toolchain: collect data with Prometheus, pipe them to Chronix, visualize both data sources in Grafana [5], and easily analyze tons of data with Spark and Apache Zeppelin.

Chronix as Long-Term Storage for Prometheus

QAware GmbH

Shipping Data from Postgres to Clickhouse, by Murat Kabilov, Adjust

Altinity Ltd

Was ist angesagt? (20)

Moving from CellsV1 to CellsV2 at CERN

Stabilising the jenga tower

Processing Big Data in Real-Time - Yanai Franchi, Tikal

Containers on Baremetal and Preemptible VMs at CERN and SKA

Cassandra Backups and Restorations Using Ansible (Joshua Wickman, Knewton) | ...

Cloud Solution Day 2016: Microservices on Mesos & Netflix OSS

Mario on spark

Gnocchi v3 brownbag

Cassandra at talkbits

Cern Cloud Architecture - February, 2016

Apache Incubator Samza: Stream Processing at LinkedIn

Lightweight Transactions at Lightning Speed

20170926 cern cloud v4

Frossie Economou & Angelo Fausti [Vera C. Rubin Observatory] | How InfluxDB H...

Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...

Multimaster

Openstack Infrastructure Containerization

Clock

Chronix as Long-Term Storage for Prometheus

Shipping Data from Postgres to Clickhouse, by Murat Kabilov, Adjust

Andere mochten auch

Javi

Estrellita Fugaz

SC=DCPP Final Report=JA= 29-7-2012

ASM Amanullah

The finance literature suggests that in almost any kind of investing, returns would at least have some relationship with risk-free rate of return (Rf), with investors demanding higher returns for greater risk. Risk-free asset is regarded as one where the investor knows the expected return with certainty. This leads to the notion of Equity Risk Premium (ERP), the extra return that, as compensation for the additional borne risk, the investor earns over the Rf , typically taken as 91-day Treasury bills (TB) rate of return. While similar studies have been performed in the past, the applicability of the ERP concept across financial markets and its economic implications as a risk measure has remained a contentious issue in the field, particular in emerging markets. The present study seeks to revisit the issue in the Nigerian context based on secondary data spanning 2000- 2011. The statistical analysis based on the capital asset pricing model shows that the country’s Rf proxied by TBs, had over the years traded at significantly higher levels of return than obtainable from market portfolio, thus creating a negative ERP phenomenon. The implications of this peculiarity for sustainable wealth creation, business development and valuation practice, are highlighted. Recent changes in the country’s Administration makes this study even more relevant, thus, the paper also renews the call for creating a more pro-industry fiscal policy climate if the national aspiration for sustainable inclusive growth is to be attained.

Equity Risk Premium in an Emerging Market Economy

iosrjce

Aspergillus terrreus

Pranav Narayanan

ALI IRTIZA 13-01-2016(1)

ALI irtiza

The Light House.PDF

Lynnmarie P. Cook

iPECS Solution Poster No.1

Ericsson-LG Enterprise

ICT (Information & Communication Technology) is converging today’s communications across all media types - voice, data, video, and applications - over one network. And most companies transfer to unified infrastructure using the same communications language. iPECS-CM realizes an easy and flexible migration into today’s unified communications environment to help increase revenue, save costs and enhance productivity.

Empower Your Business Communications with iPECS-CM

Ericsson-LG Enterprise

Design Your Business Communications with iPECS UCP

Ericsson-LG Enterprise

Tarea del seminario 3

RocioRomeroCastillo

Andere mochten auch (10)

Javi

SC=DCPP Final Report=JA= 29-7-2012

Equity Risk Premium in an Emerging Market Economy

Aspergillus terrreus

ALI IRTIZA 13-01-2016(1)

The Light House.PDF

iPECS Solution Poster No.1

Empower Your Business Communications with iPECS-CM

Design Your Business Communications with iPECS UCP

Tarea del seminario 3

Ähnlich wie Cassandra at Glogster

Netflix has updated and added new tools and benchmarks for Cassandra in the last year. In this talk we will cover the latest additions and recipes for the Astyanax Java client, updates to Priam to support Cassandra 1.2 Vnodes, plus newly released and upcoming tools that are all part of the NetflixOSS platform. Following on from the Cassandra on SSD on AWS benchmark that was run live during the 2012 Summit, we've been benchmarking a large write intensive multi-region cluster to see how far we can push it. Cassandra is the data storage and global replication foundation for the Cloud Native architecture that runs Netflix streaming for 36 Million users. Netflix is also offering a Cloud Prize for open source contributions to NetflixOSS, and there are ten categories including Best Datastore Integration and Best Contribution to Performance Improvements, with $10K cash and $5K of AWS credits for each winner. We'd like to pay you to use our free software!

C* Summit 2013: Netflix Open Source Tools and Benchmarks for Cassandra by Adr...

DataStax Academy

Opera chose Scylla over Cassandra to sync the data of millions of browsers to a back-end data repository. The results of the migration and further optimizations they made in their stack helped Opera to gain better latency/throughput and lower resources usage beyond their expectations. Attend this session to learn how to Migrate your data in a sane way, without any downtime Connect a Python+Django web app to Scylla, how to use intranode sharding to improve your application

How Opera Syncs Tens of Millions of Browsers and Sleeps Well at Night

ScyllaDB

Sanger OpenStack presentation March 2017

Dave Holland

Postgres clusters

Stas Kelvich

This session will describe how members of the US Large Hadron Collider (LHC) community have benchmarked the usage of Amazon Elastic Compute Cloud (Amazon EC2) resource to simulate events observed by experiments at the European Organization for Nuclear Research (CERN). Miron Livny from the University of Wisconsin-Madison who has been collaborating with the US-LHC community for more than a decade will detail the process for benchmarking high-throughput computing (HTC) applications running across multiple AWS regions using the open source HTCondor distributed computing software. The presentation will also outline the different ways that AWS and HTCondor can help meet the needs of compute intensive applications from other scientific disciplines.

Finding New Sub-Atomic Particles on the AWS Cloud (BDT402) | AWS re:Invent 2013

Amazon Web Services

Arun

123aruntajne

DeveloperWeek Management 2022 Conference Presentation https://www.developerweek.com/global/conference/management/schedule/ In the last decade, the development of modern horizontally scalable open-source Big Data technologies such as Apache Cassandra (for data storage), and Apache Kafka (for data streaming) enabled cost-effective, highly scalable, reliable, low-latency applications, and made these technologies increasingly ubiquitous. To enable reliable horizontal scalability, both Cassandra and Kafka utilize partitioning (for concurrency) and replication (for reliability and availability) across clustered servers. But building scalable applications isn’t as easy as just throwing more servers at the clusters, and unexpected speed humps are common. Consequently, you also need to understand the performance impact of partitions, replication, and clusters; monitor the correct metrics to have an end-to-end view of applications and clusters; conduct careful benchmarking, and scale and tune iteratively to take into account performance insights and optimizations. In this presentation, I will explore some of the performance goals, challenges, solutions, and results I discovered over the last 5 years building multiple realistic demonstration applications. The examples will include trade-offs with elastic Cassandra auto-scaling, scaling a Cassandra and Kafka anomaly detection application to 19 Billion checks per day, and building low-latency streaming data pipelines using Kafka Connect for multiple heterogeneous source and sink systems.

OPEN Talk: Scaling Open Source Big Data Cloud Applications is Easy/Hard

Paul Brebner

Exascale Capabl

Sagar Dolas

Netflix Global Applications - NoSQL Search Roadshow

Adrian Cockcroft

Kubernetes: My BFF

Jonathan Yu, P.Eng.

Challenges with Gluster and Persistent Memory with Dan Lambright

Gluster.org

Apache hadoop 3.x state of the union and upgrade guidance - Strata 2019 NY

Wangda Tan

Golden Gate - How to start such a project?

Trivadis

Introduction to Docker at the Azure Meet-up in New York

Jérôme Petazzoni

Openstack For Beginners

cpallares

Cassandra To Infinity And Beyond

Romain Hardouin

Presented by Rags Srinivas, Developer Advocate/Architect at Datastax at Kubernetes Community Days, Washington DC, September 14, 2022. Cassandra is designed for multi-region ● Partition tolerant ● Each node in the cluster maintains the full topology ● Nodes automatically route traffic to nearby neighbors ● Data is automatically and asynchronously replicated ● The cluster is homogenous ● Any node can service any client request ● Clients can be configured to automatically route traffic to the local datacenter Kubernetes was not designed for multi-region ● Increased latencies ● The cost is higher consensus request latency from crossing data center boundaries ● Loss of connectivity to ectd could cause outages ● Services should route traffic to nearby endpoints

Multi-cluster k8ssandra

KubernetesCommunityD

We leave in the era where the atomic building elements of silicon computers, e.g., transistors and wires, are no longer visible using traditional optical microscopes and their sizes are measured in just tens of Angstroms. In addition, power dissipation per unit volume is bounded by the laws of Physics that all resulted among others in stagnating processor clock frequencies. Adding more and more processor cores that perform simpler and simpler tasks in an attempt to efficiently fill the available on-chip area seems to be the current trend taken by the Industry.

Programmable Exascale Supercomputer

Sagar Dolas

Vast volume of our processed data is Time Series data and once you start working with distributed systems, you start tackling many scale and performance problems: How to handle missing data?Should I handle both serving and backed process or separating them out? Best Performance for Money? In the talk we will tell the tale of all of the transformations we’ve made to our data model@Windward, some of the problems we’ve handled, review the multiple data persistency layers like: S3, MongoDB, Apache Cassandra, MySQL. And I’ll try my best NOT to answer the question “Which one of them is the Best?"

S3, Cassandra or Outer Space? Dumping Time Series Data using Spark - Demi Be...

Codemotion

Scaling Cassandra for Big Data

DataStax Academy

Ähnlich wie Cassandra at Glogster (20)

C* Summit 2013: Netflix Open Source Tools and Benchmarks for Cassandra by Adr...

How Opera Syncs Tens of Millions of Browsers and Sleeps Well at Night

Sanger OpenStack presentation March 2017

Postgres clusters

Finding New Sub-Atomic Particles on the AWS Cloud (BDT402) | AWS re:Invent 2013

Arun

OPEN Talk: Scaling Open Source Big Data Cloud Applications is Easy/Hard

Exascale Capabl

Netflix Global Applications - NoSQL Search Roadshow

Kubernetes: My BFF

Challenges with Gluster and Persistent Memory with Dan Lambright

Apache hadoop 3.x state of the union and upgrade guidance - Strata 2019 NY

Golden Gate - How to start such a project?

Introduction to Docker at the Azure Meet-up in New York

Openstack For Beginners

Cassandra To Infinity And Beyond

Multi-cluster k8ssandra

Programmable Exascale Supercomputer

S3, Cassandra or Outer Space? Dumping Time Series Data using Spark - Demi Be...

Scaling Cassandra for Big Data

Kürzlich hochgeladen

(Vivek)Call Us, 8448380779,Call girls in Delhi NCr – We Offer best in class call girls. escort Service At Affordable Price At low Rate with Space Night 8000 We Are One Of The Oldest Escort and Call girls Agencies in Delhi. You Will Find That Our Female Escorts Are Full Of Fun, Sexy And They Would Love Enjoy Your Company. We Have A Fantastic Selection Of Escort Ladies Available For In-Calls As Well As Out-Calls. Our Escorts Are Not Only Beautiful But All Have Great Personalities Making Them The Perfect Companion For Any Occasion. In-Call:- You Can Come At Our Place in Delhi Our place Which Is Very Clean Hygienic 100% safe Accommodation. Out-Call:- You have To Come Pick The Girl From My Place We Are Also Provide Door Step Services (Delhi Ncr, Noida, Gurgaon, Faridabad, Ghaziabad Note:- Pic Collectors Time Passers Bargainers Stay Away As We Respect The Value For Your Money Time And Expect The Same From You Hygienic:- Full Ac room And Clean Rooms Available In Hotel 24 * 7 Hourly In Delhi NCR More Details, With WhatsApp Number, +91-8448380779

call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️

Delhi Call girls

+971565801893 Mtp-Kit (500MG) Prices » Dubai [(+971565801893**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Leen Whatsapp +971565801893 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971565801893''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971565801893' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Clinic in Abu Dhabi, United Arab Emirates.+971565801893

+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...

Health

Azure Native Qumulo scales elastically for common High Performance Compute (HPC) workloads based on application requirements for: Financial Services, Automotive, Genomics / Life Sciences, Media and Entertainment, Energy, Oil and Gas, etc. Performance can be dialed UP (and back down) much higher than the examples shown here. These slides offer a glimpse into ANQ's HPC capabilities, although at a smaller scale. We invite YOU to do your own testing (with a free ANQ trial) and work with us to test your HPC workloads in Azure.

Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf

ryanfarris8

InShot proinshot.com stands tall among its peers as the ultimate video editing app, offering simplicity, versatility, and power in one package. With its intuitive interface and comprehensive feature set, InShot caters to both beginners and seasoned editors alike. Whether you're creating content for social media, YouTube, or personal projects, InShot empowers you to unleash your creativity and transform your videos into captivating masterpieces. Join the millions of users who trust InShot https://www.proinshot.com/ for all their video editing needs and discover the difference for yourself!

Exploring the Best Video Editing App.pdf

proinshot.com

VTU technical seminar 8Th Sem on Scikit-learn

AmarnathKambale

Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified

Delhi Call girls

Craft an AI & Machine Learning Pitch with our Editable Professional PowerPoint Template. Ignite your AI & Machine Learning pitch with our cutting-edge PowerPoint template tailored for the industry. Perfect for AI conferences, investor presentations, sales pitches to tech-focused companies, training sessions, and educational programs. - 20+ editable slides: Get a variety of options to choose from for your presentation. - Time-saving solution: Download, replace text/images with a few clicks. - User-friendly customization: Easy to use and personalize. - Modern and attractive design: Captivating visuals, sleek layout. - Tailored to your requirements: Fully alterable for customization. - Well-organized slides: Complete control over content. - Thematic specificity: Reflects healthcare industry with relevant graphics. - Showcase your business idea: Communicate value proposition effectively.

AI & Machine Learning Presentation Template

Presentation.STUDIO

MakeMyPass" Online Bus Pass Management System illustrates the flow of activities and actions that occur within the system to accomplish specific tasks or use cases. This type of diagram focuses on representing the sequence of activities and decision points involved in a particular process. Below is an example outline and description of key elements that could be included in an Activity Diagram for the system:

BUS PASS MANGEMENT SYSTEM USING PHP.pptx

alwaysnagaraju26

In the realm of real-time applications, Large Language Models (LLMs) have long dominated language-centric tasks, while tools like OpenCV have excelled in the visual domain. However, the future (maybe) lies in the fusion of LLMs and deep learning, giving birth to the revolutionary concept of Large Action Models (LAMs). Imagine a world where AI not only comprehends language but mimics human actions on technology interfaces. For example, the Rabbit r1 device presented at CES 2024, driven by an AI operating system and LAM, brings this vision to life. It executes complex commands, leveraging GUIs with unprecedented ease. In this presentation, join me on a journey as a software engineer tinkering with WebRTC, Janus, and LLM/LAMs. Together, we’ll evaluate the current state of these AI technologies, unraveling the potential they hold for shaping the future of real-time applications.

Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications

Alberto González Trastoy

introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf

VishalKumarJha10

Define the academic and professional writing..pdf

PearlKirahMaeRagusta1

The title is not connected to what is inside

shinachiaurasa2

Technology has taken up space all over the world. From generating content with a single command on ChatGPT to getting your food served by Robots at your favorite restaurant, artificial advancements have ruled every space. Every industry is set to develop top-notch technology in every sector; finance, IT, healthcare, gaming, and banking, with competitive market standards. One of these rapidly growing industries is Mobile App Development. According to the Straits Research report, it is expected to reach USD 583.03 billion at a CAGR OF 12.8% between (2022 and 2030). It clearly shows how mobile app development has become an integral part of the digital landscape and revolutionized technology.

The Top App Development Trends Shaping the Industry in 2024-25 .pdf

ayushiqss

Looking for an efficient way to manage your finances? Look no further than our money management app. With easy-to-use features, you can track your expenses, create budgets, and monitor your savings goals all in one place. Our app provides real-time updates on your spending habits and helps you make smarter financial decisions. Take control of your finances today with our user-friendly money management app.

Right Money Management App For Your Financial Goals

Jhone kinadey

Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid

Philip Schwarz

LEVEL 5 - SESSION 1 2023 (1).pptx - PDF 123456

KiaraTiradoMicha

%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain

masabamasaba

%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein

masabamasaba

How To Troubleshoot Collaboration Apps for the Modern Connected Worker

ThousandEyes

A great deal of attention in medical devices has shifted towards cybersecurity with the ratification of section 524B of the FD&C act. This new law enables the FDA to enforce cybersecurity controls in any medical device that is capable of networked communications or that has software. In this webinar we will recap the process for managing vulnerabilities, identify categories of vulnerabilities and solutions and more.

The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...

ICS

Kürzlich hochgeladen (20)

call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️

+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...

Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf

Exploring the Best Video Editing App.pdf

VTU technical seminar 8Th Sem on Scikit-learn

Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified

AI & Machine Learning Presentation Template

BUS PASS MANGEMENT SYSTEM USING PHP.pptx

Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications

introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf

Define the academic and professional writing..pdf

The title is not connected to what is inside

The Top App Development Trends Shaping the Industry in 2024-25 .pdf

Right Money Management App For Your Financial Goals

Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid

LEVEL 5 - SESSION 1 2023 (1).pptx - PDF 123456

%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain

%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein

How To Troubleshoot Collaboration Apps for the Modern Connected Worker

The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...

Cassandra at Glogster

1. Cassandra at Glogster Roman Komkov – roman@glogster.com System Engineer at Glogster Prague Cassandra Meet up 03.09.2015

2. About me   2 years at Glogster EDU as System Engineer   5+ years of Linux administration   5+ years of Python development   Cluster, HA, Orchestration   CI, CD…   Twitter - @alkoengineering GitHub, Freenode - decayofmind

3. About Glogster EDU   Started in 2009   Platform for presentation and interactive learning mainly used by educators and students   19 million users   Over 45 million glogs   40000 new glogs daily   Web service, mobile applications   http://edu.glogster.com

4. Cassandra at Glogster   From 2011 as primary DB for initial Glogster.com   From 2012 as backend (storage) DB for Glogster EDU   Started from 0.6… or 0.8, I guess…   10 nodes   RF=5, QUORUM   SATA disks OrderPreservingPartitioner ¯_(ツ)_/¯

5. Architecture

6. Cassandra now   5 nodes cluster   ~600Gb average node size   RF=5, QUORUM   SSD disks VNodes OrderPreservingPartitioner… pycassa + datastax-driver

8. 0.8 problems   Migration with downtime by transferring a copy of data HintedHandoff hell   No repairs, no cleanups   Enormous HeapSize (20GB)   Different time on servers SOLUTION!   Upgrade to 1.0

9. 1.1 problems   Cassandra guy left Glogster   Don’t touch it while it works BUT…   Load averages like 14.0-16.0   2 disks failed   Everything is slow   Repairs? Never heard!

10. 1.1 solutions   Replace disks, rebuild nodes.   Don’t try to run repair on new node instead of ReplaceToken   Move old Glogster.com keyspace to another cluster   Load gone https://glogster.github.io/posts/2015/03/23/cassandra- migration.html   Nodes are fast again   Regular repairs and cleanups? Never did! OpsCenter installed   Cluster upgraded to 1.2

11. 1.2 and migration   Cluster migrated to the new servers without downtime http://www.planetcassandra.org/blog/cassandra-migration- to-ec2/ Vnodes …

12.

13.   Old datacenter, connected to production was disconnected from new datacenter   Forgot about Hints TTL (max_hint_window_in_ms ~ 3 hours)   Forgot to run repair on cluster after   Old DC was decommissioned   Application switched the new one   … DATA GONE

14. Here the hell begins   ~ 1200 glogs remain on old decommissioned datacenter   Thanks God, we have RF=<N of nodes>   Transfer data from one old node to the new server   Run Cassandra on it, add node to the cluster   Run repair on entire cluster   Increase repair chance with read_repair_chance   Peacefully wait until done…   Do your complicated repairs through OpsCenter, cause it can continue if failed.

15. Full repair?

16.

17. 10 DAYS!!!

18. Conclusions and Improvements   Increase max_hint_window_in_ms value to something like 3 days   Make use of parallel things   CQL3 and datastax-driver   Upgrade to Cassandra 2.2   faster repairs and other operations   New OpsCenter   Schedule regular backups and repairs   We still love Cassandra!

19. Questions?

Cassandra at Glogster

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (10)

Ähnlich wie Cassandra at Glogster

Ähnlich wie Cassandra at Glogster (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Cassandra at Glogster