Suche senden
Hochladen
Ch16
•
Als PPT, PDF herunterladen
•
0 gefällt mir
•
251 views
H
huangachou
Folgen
Technologie
News & Politik
Melden
Teilen
Melden
Teilen
1 von 11
Jetzt herunterladen
Empfohlen
Comparison between OCFS2 and GFS2 in features/performance/community
Comparison between OCFS2 and GFS2
Comparison between OCFS2 and GFS2
Gang He
The current Linux kernel /proc/PID interface is great, time-proven and reliable way to get info about processes running on a system. Right? Well, yes and no. We found out (and you, too, might have noticed it) this is what makes ps and top slow when there are thousands of processes running. Besides the speed, there are a number of other problems with the current /proc/PID interface. The talk describes all those in great details, then goes on to the alternative we are proposing for inclusion to the kernel, a new interface called task_diag. The new interface is slick, fast (5-10x speed improvement), and extendable.
Time to rethink /proc
Time to rethink /proc
Kir Kolyshkin
Dedupe nmamit
Dedupe nmamit
Dedupe nmamit
Gluster.org
Challenges with Gluster and Persistent Memory with Dan Lambright at Gluster Developer Summit 2016
Challenges with Gluster and Persistent Memory with Dan Lambright
Challenges with Gluster and Persistent Memory with Dan Lambright
Gluster.org
Gluster fs hadoop_fifth-elephant
Gluster fs hadoop_fifth-elephant
Gluster fs hadoop_fifth-elephant
Gluster.org
Gluster Developer Summit 2016
Life as a GlusterFS Consultant with Ivan Rossi
Life as a GlusterFS Consultant with Ivan Rossi
Gluster.org
Tiering barcelona
Tiering barcelona
Tiering barcelona
Gluster.org
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Ontico
Empfohlen
Comparison between OCFS2 and GFS2 in features/performance/community
Comparison between OCFS2 and GFS2
Comparison between OCFS2 and GFS2
Gang He
The current Linux kernel /proc/PID interface is great, time-proven and reliable way to get info about processes running on a system. Right? Well, yes and no. We found out (and you, too, might have noticed it) this is what makes ps and top slow when there are thousands of processes running. Besides the speed, there are a number of other problems with the current /proc/PID interface. The talk describes all those in great details, then goes on to the alternative we are proposing for inclusion to the kernel, a new interface called task_diag. The new interface is slick, fast (5-10x speed improvement), and extendable.
Time to rethink /proc
Time to rethink /proc
Kir Kolyshkin
Dedupe nmamit
Dedupe nmamit
Dedupe nmamit
Gluster.org
Challenges with Gluster and Persistent Memory with Dan Lambright at Gluster Developer Summit 2016
Challenges with Gluster and Persistent Memory with Dan Lambright
Challenges with Gluster and Persistent Memory with Dan Lambright
Gluster.org
Gluster fs hadoop_fifth-elephant
Gluster fs hadoop_fifth-elephant
Gluster fs hadoop_fifth-elephant
Gluster.org
Gluster Developer Summit 2016
Life as a GlusterFS Consultant with Ivan Rossi
Life as a GlusterFS Consultant with Ivan Rossi
Gluster.org
Tiering barcelona
Tiering barcelona
Tiering barcelona
Gluster.org
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Ontico
Sharding: Past, Present and Future with Krutika Dhananjay at Gluster Developer Summit
Sharding: Past, Present and Future with Krutika Dhananjay
Sharding: Past, Present and Future with Krutika Dhananjay
Gluster.org
This is the presentation given during CentOS Dojo Bangalore. The slides are originally authored by Vijay Bellur, Lalatendu Mohanty. Added a few slides at the end for CentOS setup.
GlusterFS Talk for CentOS Dojo Bangalore
GlusterFS Talk for CentOS Dojo Bangalore
Raghavendra Talur
MongoDB is a non-relations database and well known in the latest trends for storing data in json form. This slide will help you to understand the advanced concept of MongoDB with the help of sharding. This slide will cover: Architecture of sharded cluster. Query handling in sharded cluster. Data Distribution Method. Replica Sets.
Mongo db cluster administration and Shredded Databases
Mongo db cluster administration and Shredded Databases
Abhinav Jha
Bricks and Translators - The distributed file system made by Red Hat (spring 2013)
Lt2013 glusterfs.talk
Lt2013 glusterfs.talk
Udo Seidel
LFS file system introduction
Learn about log structured file system
Learn about log structured file system
Gang He
Андрей Годин - Базы данных: Документоориентированная горизонтально масштабиру...
Андрей Годин - Базы данных: Документоориентированная горизонтально масштабиру...
Yandex
Server as the core of the information systems in today's business operations playing a pivotal role, data storage on server is becoming the lifeline to maintain the normal operation of the millions of businesses and organizations. Correct choice of independent control of the server or cluster systems and storage devices can improve system performance and operational capabilities. The user request rate and response time of business server data storage system are dependent on the selection of the storage devices. These devices can greatly affect system performance. To effectively protect data and give linear performance for iSCSI initiator, it is required to modify the iSCSI target driver to provide Gluster file system backend storage as distributed block device. This paper aims at discussing ways of modifying iSCSI Target (ISTGT) driver to support Gluster file system.
Integrating GlusterFS with iSCSI Target
Integrating GlusterFS with iSCSI Target
ijsrd.com
Abstract Since its creation, the DragonFly operating system had contained a giant lock in its kernel, preventing more than one thread to use kernel resources at the same time. This big lock was finally removed after the 2.10 release. I then started to look for a good way to test the multi-processor performance and scalability of the operating system. PostgreSQL seemed to fit the bill with its PGbench tool. This talk focuses on how PostgreSQL was used as a benchmarking tool to check and improve DragonFly's performance and scalability. Speaker bio Francois Tigeot is independent consultant and sysadmin doing *BSD and PostgreSQL since 1999. DragonFly developer since 2011
Improving DragonFly's performance with PostgreSQL by Francois Tigeot
Improving DragonFly's performance with PostgreSQL by Francois Tigeot
eurobsdcon
There are some major differences between clustered Data ONTAP configurations and the configurations, operating with Data ONTAP in 7-Mode. In the clustered data ONTAP, the cluster configuration contains two HA pairs, with each HA in a separate cluster and at physically different sites. Please read here the complete post http://www.vidhyalive.com/netapp-cluster-mode/
Difference between net app 7 mode and netapp cluster mode
Difference between net app 7 mode and netapp cluster mode
Vidhyalive
Hardware once reserved to HPC systems is entering the datacenter. Cyprien will describe an effort to help developers leverage its new capabilities. Its integration to H2O, along with tools like Caffe, is accelerating and making the platform more powerful. #h2ony
Caffe + H2O - By Cyprien noel
Caffe + H2O - By Cyprien noel
Sri Ambati
So-Called shared file systems have been known in the Unix / Linux-environment for a long time. The network-based and cluster data systems are thereby almost an old hat. The project XtreemFS– a part of the grid operating system XtreemOS – is a quite new but budded alternative in this field. The current version finally has some important features and is worth taking a closer look. This presentation gives an insight into the data systems approaches, explains the architecture and describes the first steps of a XtreemFS-Cluster set-up.
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo Seidel
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo Seidel
NETWAYS
Glusterfs architecture & roadmap Vijay Bellur Linuxcon EU 2013
GlusterFs Architecture & Roadmap - LinuxCon EU 2013
GlusterFs Architecture & Roadmap - LinuxCon EU 2013
Gluster.org
Gluster fs current_features_and_roadmap
Gluster fs current_features_and_roadmap
Gluster fs current_features_and_roadmap
Gluster.org
Audience Level Intermediate Synopsis Ceph – the most popular storage solution for OpenStack – stores all data as a collection of objects. This object store was originally implemented on top of a POSIX filesystem, an approach that turned out to have a number of problems, notably with performance and complexity. BlueStore, a new storage backend for Ceph, was created to solve these issues; the Ceph Jewel release included an early prototype. The code and on-disk format were declared stable (but experimental) for Ceph Kraken, and now in the upcoming Ceph Luminous release, BlueStore will be the recommended default storage backend. With a 2-3x performance boost, you’ll want to look at migrating your Ceph clusters to BlueStore. This talk goes into detail about what BlueStore does, the problems it solves, and what you need to do to use it. Speaker Bio: Tim works for SUSE, hacking on Ceph and related technologies. He has spoken often about distributed storage and high availability at conferences such as linux.conf.au. In his spare time he wrangles pigs, chickens, sheep and ducks, and was declared by one colleague “teammate most likely to survive the zombie apocalypse”.
Understanding blue store, Ceph's new storage backend - Tim Serong, SUSE
Understanding blue store, Ceph's new storage backend - Tim Serong, SUSE
OpenStack
Basic introduction to HDFS internals
Hdfs internals
Hdfs internals
Bhupesh Chawda
PFcache - LinuxCon 2015
PFcache - LinuxCon 2015
PFcache - LinuxCon 2015
OpenVZ
Denser containers with PF cache - Pavel Emelyanov LinuxCon 2015
Denser containers with PF cache - Pavel Emelyanov
Denser containers with PF cache - Pavel Emelyanov
OpenVZ
Sdc 2012-challenges
Sdc 2012-challenges
Sdc 2012-challenges
Gluster.org
Once you settle for the cheapest loan,we then forward their terms and conditions to you to give you a clear understanding of the loan you have selected. For More Information,Visit: http://www.loanstars.co.uk
Cheapest loans
Cheapest loans
christjohnslide
22
22
Seo-design
Radio advert evaluation
Radio advert evaluation
massivegayl0rd
Frukt och grönsaker
Frukt och grönsaker
Christina Hammarlund
Weitere ähnliche Inhalte
Was ist angesagt?
Sharding: Past, Present and Future with Krutika Dhananjay at Gluster Developer Summit
Sharding: Past, Present and Future with Krutika Dhananjay
Sharding: Past, Present and Future with Krutika Dhananjay
Gluster.org
This is the presentation given during CentOS Dojo Bangalore. The slides are originally authored by Vijay Bellur, Lalatendu Mohanty. Added a few slides at the end for CentOS setup.
GlusterFS Talk for CentOS Dojo Bangalore
GlusterFS Talk for CentOS Dojo Bangalore
Raghavendra Talur
MongoDB is a non-relations database and well known in the latest trends for storing data in json form. This slide will help you to understand the advanced concept of MongoDB with the help of sharding. This slide will cover: Architecture of sharded cluster. Query handling in sharded cluster. Data Distribution Method. Replica Sets.
Mongo db cluster administration and Shredded Databases
Mongo db cluster administration and Shredded Databases
Abhinav Jha
Bricks and Translators - The distributed file system made by Red Hat (spring 2013)
Lt2013 glusterfs.talk
Lt2013 glusterfs.talk
Udo Seidel
LFS file system introduction
Learn about log structured file system
Learn about log structured file system
Gang He
Андрей Годин - Базы данных: Документоориентированная горизонтально масштабиру...
Андрей Годин - Базы данных: Документоориентированная горизонтально масштабиру...
Yandex
Server as the core of the information systems in today's business operations playing a pivotal role, data storage on server is becoming the lifeline to maintain the normal operation of the millions of businesses and organizations. Correct choice of independent control of the server or cluster systems and storage devices can improve system performance and operational capabilities. The user request rate and response time of business server data storage system are dependent on the selection of the storage devices. These devices can greatly affect system performance. To effectively protect data and give linear performance for iSCSI initiator, it is required to modify the iSCSI target driver to provide Gluster file system backend storage as distributed block device. This paper aims at discussing ways of modifying iSCSI Target (ISTGT) driver to support Gluster file system.
Integrating GlusterFS with iSCSI Target
Integrating GlusterFS with iSCSI Target
ijsrd.com
Abstract Since its creation, the DragonFly operating system had contained a giant lock in its kernel, preventing more than one thread to use kernel resources at the same time. This big lock was finally removed after the 2.10 release. I then started to look for a good way to test the multi-processor performance and scalability of the operating system. PostgreSQL seemed to fit the bill with its PGbench tool. This talk focuses on how PostgreSQL was used as a benchmarking tool to check and improve DragonFly's performance and scalability. Speaker bio Francois Tigeot is independent consultant and sysadmin doing *BSD and PostgreSQL since 1999. DragonFly developer since 2011
Improving DragonFly's performance with PostgreSQL by Francois Tigeot
Improving DragonFly's performance with PostgreSQL by Francois Tigeot
eurobsdcon
There are some major differences between clustered Data ONTAP configurations and the configurations, operating with Data ONTAP in 7-Mode. In the clustered data ONTAP, the cluster configuration contains two HA pairs, with each HA in a separate cluster and at physically different sites. Please read here the complete post http://www.vidhyalive.com/netapp-cluster-mode/
Difference between net app 7 mode and netapp cluster mode
Difference between net app 7 mode and netapp cluster mode
Vidhyalive
Hardware once reserved to HPC systems is entering the datacenter. Cyprien will describe an effort to help developers leverage its new capabilities. Its integration to H2O, along with tools like Caffe, is accelerating and making the platform more powerful. #h2ony
Caffe + H2O - By Cyprien noel
Caffe + H2O - By Cyprien noel
Sri Ambati
So-Called shared file systems have been known in the Unix / Linux-environment for a long time. The network-based and cluster data systems are thereby almost an old hat. The project XtreemFS– a part of the grid operating system XtreemOS – is a quite new but budded alternative in this field. The current version finally has some important features and is worth taking a closer look. This presentation gives an insight into the data systems approaches, explains the architecture and describes the first steps of a XtreemFS-Cluster set-up.
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo Seidel
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo Seidel
NETWAYS
Glusterfs architecture & roadmap Vijay Bellur Linuxcon EU 2013
GlusterFs Architecture & Roadmap - LinuxCon EU 2013
GlusterFs Architecture & Roadmap - LinuxCon EU 2013
Gluster.org
Gluster fs current_features_and_roadmap
Gluster fs current_features_and_roadmap
Gluster fs current_features_and_roadmap
Gluster.org
Audience Level Intermediate Synopsis Ceph – the most popular storage solution for OpenStack – stores all data as a collection of objects. This object store was originally implemented on top of a POSIX filesystem, an approach that turned out to have a number of problems, notably with performance and complexity. BlueStore, a new storage backend for Ceph, was created to solve these issues; the Ceph Jewel release included an early prototype. The code and on-disk format were declared stable (but experimental) for Ceph Kraken, and now in the upcoming Ceph Luminous release, BlueStore will be the recommended default storage backend. With a 2-3x performance boost, you’ll want to look at migrating your Ceph clusters to BlueStore. This talk goes into detail about what BlueStore does, the problems it solves, and what you need to do to use it. Speaker Bio: Tim works for SUSE, hacking on Ceph and related technologies. He has spoken often about distributed storage and high availability at conferences such as linux.conf.au. In his spare time he wrangles pigs, chickens, sheep and ducks, and was declared by one colleague “teammate most likely to survive the zombie apocalypse”.
Understanding blue store, Ceph's new storage backend - Tim Serong, SUSE
Understanding blue store, Ceph's new storage backend - Tim Serong, SUSE
OpenStack
Basic introduction to HDFS internals
Hdfs internals
Hdfs internals
Bhupesh Chawda
PFcache - LinuxCon 2015
PFcache - LinuxCon 2015
PFcache - LinuxCon 2015
OpenVZ
Denser containers with PF cache - Pavel Emelyanov LinuxCon 2015
Denser containers with PF cache - Pavel Emelyanov
Denser containers with PF cache - Pavel Emelyanov
OpenVZ
Sdc 2012-challenges
Sdc 2012-challenges
Sdc 2012-challenges
Gluster.org
Was ist angesagt?
(18)
Sharding: Past, Present and Future with Krutika Dhananjay
Sharding: Past, Present and Future with Krutika Dhananjay
GlusterFS Talk for CentOS Dojo Bangalore
GlusterFS Talk for CentOS Dojo Bangalore
Mongo db cluster administration and Shredded Databases
Mongo db cluster administration and Shredded Databases
Lt2013 glusterfs.talk
Lt2013 glusterfs.talk
Learn about log structured file system
Learn about log structured file system
Андрей Годин - Базы данных: Документоориентированная горизонтально масштабиру...
Андрей Годин - Базы данных: Документоориентированная горизонтально масштабиру...
Integrating GlusterFS with iSCSI Target
Integrating GlusterFS with iSCSI Target
Improving DragonFly's performance with PostgreSQL by Francois Tigeot
Improving DragonFly's performance with PostgreSQL by Francois Tigeot
Difference between net app 7 mode and netapp cluster mode
Difference between net app 7 mode and netapp cluster mode
Caffe + H2O - By Cyprien noel
Caffe + H2O - By Cyprien noel
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo Seidel
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo Seidel
GlusterFs Architecture & Roadmap - LinuxCon EU 2013
GlusterFs Architecture & Roadmap - LinuxCon EU 2013
Gluster fs current_features_and_roadmap
Gluster fs current_features_and_roadmap
Understanding blue store, Ceph's new storage backend - Tim Serong, SUSE
Understanding blue store, Ceph's new storage backend - Tim Serong, SUSE
Hdfs internals
Hdfs internals
PFcache - LinuxCon 2015
PFcache - LinuxCon 2015
Denser containers with PF cache - Pavel Emelyanov
Denser containers with PF cache - Pavel Emelyanov
Sdc 2012-challenges
Sdc 2012-challenges
Andere mochten auch
Once you settle for the cheapest loan,we then forward their terms and conditions to you to give you a clear understanding of the loan you have selected. For More Information,Visit: http://www.loanstars.co.uk
Cheapest loans
Cheapest loans
christjohnslide
22
22
Seo-design
Radio advert evaluation
Radio advert evaluation
massivegayl0rd
Frukt och grönsaker
Frukt och grönsaker
Christina Hammarlund
Eline Adam (4AD) i.s.m. Zero Emisson Solutions en POM West-Vlaanderen over het parcours van muziekclub 4AD richting een volledig CO2- neutrale clubwerking. Muziekclub 4AD in Diksmuide wil het eerste klimaatneutraal concerthuis in Vlaanderen worden. De afgelopen jaren zette het daar al grote stappen voor. De laatste stappen blijken de moeilijkste voor een pionier. De muziekclub bekijkt samen met studie- en consultancy-bureau Zero Emission Solutions en Provinciale Ont- wikkelingsmaatschappij West-Vlaanderen (Certificaat duurzaam ondernemen) de mogelijke pistes en hindernissen. Ze zoeken een weg in de wirwar van milieu-certi- ficaten en vragen rond klimaatneutraliteit.
4AD - Naar een klimaatneutrale concertwerking
4AD - Naar een klimaatneutrale concertwerking
pulsenetwerk
Първа конференция на тема "Добрата храна е сила"
Първа конференция на тема "Добрата храна е сила"
Snezhana Georgieva
Trace32 lo-strumento-piu-completo-per-il-debug-di-un-sistema-linux
Trace32 lo-strumento-piu-completo-per-il-debug-di-un-sistema-linux
Develer S.r.l.
A knowledge worker is someone who is employed because of his or her knowledge of a subject matter, rather than ability to perform manual labor. They perform best when empowered to make the most of their deepest skills.
Managing Knowledge Workers
Managing Knowledge Workers
Olivier Serrat
8
8
diabmaher
www.bagan-lodge.com Bagan Lodge is listed among Hotel Updates all around the world by the Vacation and Travel Magazine in Oct/ Dec 2013 issue.
Bagan Lodge is featured in Vacations & Travel Magazine, October - December 20...
Bagan Lodge is featured in Vacations & Travel Magazine, October - December 20...
Hang Do
9
9
diabmaher
Andere mochten auch
(11)
Cheapest loans
Cheapest loans
22
22
Radio advert evaluation
Radio advert evaluation
Frukt och grönsaker
Frukt och grönsaker
4AD - Naar een klimaatneutrale concertwerking
4AD - Naar een klimaatneutrale concertwerking
Първа конференция на тема "Добрата храна е сила"
Първа конференция на тема "Добрата храна е сила"
Trace32 lo-strumento-piu-completo-per-il-debug-di-un-sistema-linux
Trace32 lo-strumento-piu-completo-per-il-debug-di-un-sistema-linux
Managing Knowledge Workers
Managing Knowledge Workers
8
8
Bagan Lodge is featured in Vacations & Travel Magazine, October - December 20...
Bagan Lodge is featured in Vacations & Travel Magazine, October - December 20...
9
9
Ähnlich wie Ch16
(Hugh O'Brien, Jet.com) Kafka Summit SF 2018 You’re doing disk IO wrong, let ZFS show you the way. ZFS on Linux is now stable. Say goodbye to JBOD, to directories in your reassignment plans, to unevenly used disks. Instead, have 8K Cloud IOPS for $25, SSD speed reads on spinning disks, in-kernel LZ4 compression and the smartest page cache on the planet. (Fear compactions no more!) Learn how Jet’s Kafka clusters squeeze every drop of disk performance out of Azure, all completely transparent to Kafka. -Striping cheap disks to maximize instance IOPS -Block compression to reduce disk usage by ~80% (JSON data) -Instance SSD as the secondary read cache (storing compressed data), eliminating >99% of disk reads and safe across host redeployments -Upcoming features: Compressed blocks in memory, potentially quadrupling your page cache (RAM) for free We’ll cover: -Basic Principles -Adapting ZFS for cloud instances (gotchas) -Performance tuning for Kafka -Benchmarks
Kafka on ZFS: Better Living Through Filesystems
Kafka on ZFS: Better Living Through Filesystems
confluent
This explains storage and buffer usage in Postgres and discusses about I/O and buffer management in Linux kernel.
Wish list from PostgreSQL - Linux Kernel Summit 2009
Wish list from PostgreSQL - Linux Kernel Summit 2009
Takahiro Itagaki
Jaime Peñalba - Kernel exploitation. ¿El octavo arte? [rooted2019]
Jaime Peñalba - Kernel exploitation. ¿El octavo arte? [rooted2019]
Jaime Peñalba - Kernel exploitation. ¿El octavo arte? [rooted2019]
RootedCON
Pldc2012 innodb architecture and internals
Pldc2012 innodb architecture and internals
Pldc2012 innodb architecture and internals
mysqlops
My short talk at a RocksDB meetup on 2/3/16 about the new Ceph OSD backend BlueStore and its use of rocksdb.
Ceph and RocksDB
Ceph and RocksDB
Sage Weil
Rocking the Database World with RocksDB Sage Weil, Ceph Principal Architect, Red Hat Sage helped design Ceph as part of his graduate research at the University of California, Santa Cruz. Since then, he has continued to refine the system with the goal of providing a stable next generation distributed storage system for Linux. Specialties: Distributed system design, storage and file systems, management, software development.
The Hive Think Tank: Ceph + RocksDB by Sage Weil, Red Hat.
The Hive Think Tank: Ceph + RocksDB by Sage Weil, Red Hat.
The Hive
the technology behind docker. This is for osdc.tw 2014
Docker 原理與實作
Docker 原理與實作
kao kuo-tung
Technical description of GNR ( GPFS Native RAID) write caching
Gnr writepath v1.0
Gnr writepath v1.0
Tomer Perry
Talk at LinuxCon Europe 2015 about application driven storage, RocksDB, and Open-Channel SSDs
Optimizing RocksDB for Open-Channel SSDs
Optimizing RocksDB for Open-Channel SSDs
Javier González
Docker is an open-source project to easily create lightweight, portable, self-sufficient containers from any application. The same container that a developer builds and tests on a laptop can run at scale, in production, on VMs, bare metal, OpenStack clusters, public clouds and more.
Deploying containers and managing them on multiple Docker hosts, Docker Meetu...
Deploying containers and managing them on multiple Docker hosts, Docker Meetu...
dotCloud
Slides presented at Percona Live Europe Open Source Database Conference 2019, Amsterdam, 2019-10-01. Imagine a world where all Wikipedia articles disappear due to a human error or software bug. Sounds unreal? According to some estimations, it would take an excess of hundreds of million person-hours to be written again. To prevent that scenario from ever happening, our SRE team at Wikimedia recently refactored the relational database recovery system. In this session, we will discuss how we backup 550TB of MariaDB data without impacting the 15 billion page views per month we get. We will cover what were our initial plans to replace the old infrastructure, how we achieved recovering 2TB databases in less than 30 minutes while maintaining per-table granularity, as well as the different types of backups we implemented. Lastly, we will talk about lessons learned, what went well, how our original plans changed and future work.
Backing up Wikipedia Databases
Backing up Wikipedia Databases
Jaime Crespo
In this presentation, we introduce liblightnvm, a user space library that manages provisioning and I/O submission for physical flash. We argue how liblightnvm can benefit I/O-intensive applications by providing predictable latency and reducing device write amplification, thus prolonging the device's endurance. We show how to integrate liblightnvm with RocksDB.
RocksDB meetup
RocksDB meetup
Javier González
Cephalocon APAC 2018 March 22-23, 2018 - Beijing, China Noah Watkins, UCSC Graduate Student
Experiences building a distributed shared log on RADOS - Noah Watkins
Experiences building a distributed shared log on RADOS - Noah Watkins
Ceph Community
Deploying Containers and Managing Them
Deploying Containers and Managing Them
Docker, Inc.
This is a slide desk presenting openshift in practice.
Ippevent : openshift Introduction
Ippevent : openshift Introduction
kanedafromparis
TokuDB — это реализация так называемых фрактальных деревьев для MySQL. Фрактальные деревья — это те же самые B+-деревья, но с буфером сообщений в каждой ноде. Сообщения описывают изменения данных. За счет того, что все изменения накапливаются в буферах сообщений и спускаются по дереву только по мере необходимости, при росте фрактальное дерево деградирует по скорости гораздо меньше, чем B+-дерево. Профессионалам в области разработки высоконагруженных систем хорошо известно устройство движка InnoDB для MySQL. Знание внутренних механизмов движка помогает понять, как правильно его настроить, диагностировать проседания в производительности. Целью этого доклада является рассказать об устройстве TokuDB. В рамках доклада будут рассмотрена реализация таких подсистем как caching, logging and recovery, checkpoints, transactions, MVCC, compression, locking.
TokuDB internals / Лесин Владислав (Percona)
TokuDB internals / Лесин Владислав (Percona)
Ontico
121 Pdfsam
121 Pdfsam
Emanuel Mateus
ORACLE RAC
121 Rac
121 Rac
Emanuel Mateus
My sql with enterprise storage
My sql with enterprise storage
Caroline_Rose
from the collection of hisham pasha
Flash memory as a hard drive replacement
Flash memory as a hard drive replacement
Blossoms
Ähnlich wie Ch16
(20)
Kafka on ZFS: Better Living Through Filesystems
Kafka on ZFS: Better Living Through Filesystems
Wish list from PostgreSQL - Linux Kernel Summit 2009
Wish list from PostgreSQL - Linux Kernel Summit 2009
Jaime Peñalba - Kernel exploitation. ¿El octavo arte? [rooted2019]
Jaime Peñalba - Kernel exploitation. ¿El octavo arte? [rooted2019]
Pldc2012 innodb architecture and internals
Pldc2012 innodb architecture and internals
Ceph and RocksDB
Ceph and RocksDB
The Hive Think Tank: Ceph + RocksDB by Sage Weil, Red Hat.
The Hive Think Tank: Ceph + RocksDB by Sage Weil, Red Hat.
Docker 原理與實作
Docker 原理與實作
Gnr writepath v1.0
Gnr writepath v1.0
Optimizing RocksDB for Open-Channel SSDs
Optimizing RocksDB for Open-Channel SSDs
Deploying containers and managing them on multiple Docker hosts, Docker Meetu...
Deploying containers and managing them on multiple Docker hosts, Docker Meetu...
Backing up Wikipedia Databases
Backing up Wikipedia Databases
RocksDB meetup
RocksDB meetup
Experiences building a distributed shared log on RADOS - Noah Watkins
Experiences building a distributed shared log on RADOS - Noah Watkins
Deploying Containers and Managing Them
Deploying Containers and Managing Them
Ippevent : openshift Introduction
Ippevent : openshift Introduction
TokuDB internals / Лесин Владислав (Percona)
TokuDB internals / Лесин Владислав (Percona)
121 Pdfsam
121 Pdfsam
121 Rac
121 Rac
My sql with enterprise storage
My sql with enterprise storage
Flash memory as a hard drive replacement
Flash memory as a hard drive replacement
Kürzlich hochgeladen
Copy of the slides presented by Matt Robison to the SFWelly Salesforce user group community on May 2 2024. The audience was truly international with attendees from at least 4 different countries joining online. Matt is an expert in data cloud and this was a brilliant session.
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
Anna Loughnan Colquhoun
ICT role in education and it's challenges. In which we learn about ICT, it's impact, benefits and challenges.
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
rafiqahmad00786416
Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc
DBX 1Q24 Investor Presentation
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
Dropbox
Terragrunt, Terraspace, Terramate, terra... whatever. What is wrong with Terraform so people keep on creating wrappers and solutions around it? How OpenTofu will affect this dynamic? In this presentation, we will look into the fundamental driving forces behind a zoo of wrappers. Moreover, we are going to put together a wrapper ourselves so you can make an educated decision if you need one.
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
Andrey Devyatkin
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
The Digital Insurer
The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
apidays
Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
sammart93
We present an architecture of embedding models, vector databases, LLMs, and narrow ML for tracking global news narratives across a variety of countries/languages/news sources. As an example, we explore the real-time application of this architecture for tracking the news narrative surrounding the death of Russian opposition leader Alexei Navalny coming from Russian, French, and English sources.
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Zilliz
Scalable LLM APIs for AI and Generative AI Application Development Ettikan Karuppiah, Director/Technologist - NVIDIA Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
apidays
Presentation from Melissa Klemke from her talk at Product Anonymous in April 2024
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
Product Anonymous
45-60 minute session deck from introducing Google Apps Script to developers, IT leadership, and other technical professionals.
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
wesley chun
Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Navi Mumbai Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Navi Mumbai Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Navi Mumbai Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Deepika Singh
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Jeffrey Haguewood
Presentation on the progress in the Domino Container community project as delivered at the Engage 2024 conference
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Martijn de Jong
Architecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
Nanddeep Nachan
The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
apidays
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving. A report by Poten & Partners as part of the Hydrogen Asia 2024 Summit in Singapore. Copyright Poten & Partners 2024.
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Edi Saputra
Presented by Mike Hicks
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
ThousandEyes
Kürzlich hochgeladen
(20)
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Architecting Cloud Native Applications
Architecting Cloud Native Applications
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
Ch16
1.
SYNOLOGY STUDY GROUP Linux
Kernel Development - Robert Love/3e Chapter 16 - cache Reporter: JeasonH /黃志勝
2.
Outlines ● Cache Mode ●
Cache Eviction ● Address space ● Radix tree ● Buffer cache ● Flusher thread
3.
Cache Mode Write
back Write through No Write
4.
Cache Eviction ● Clairvoyant
- adj.有超人之目力或洞察力的 n.千里眼) ● LRU - Least Recent Used ● LRU/2, LRU/n
5.
address_space (physical_pages_of_a_file)
6.
Radix tree
7.
Buffer cache (ch14 block
I/O device) Linux 2.4: ● Buffer cache – 以block為操作單位 ● Page cache – 以page為操作單位 一份資料可能同時cache在buffer與page 上 浪費記憶體空間,並且需要同步。
8.
Flusher thread ● dirty_background_ratio ●
dirty_expire_interval, dirty_writeback_interval ● sync(), fsync()
9.
Flusher thread Laptop mode
– /proc/sys/vm/lap_top_mode = 0/1 當寫回發生時,順便將所有其他的dirty資料寫回Disk (搭 順風車) 配合lap_top_mode將值調大 dirty_expire_interval, dirty_writeback_interval
10.
Flusher thread Linux 2.6
before – bdflush (dirty_background_ratio) kupdated (dirty_expire_interval) (dirty_writeback_interval) Linux 2.6 – pdfush : 2 to 8 threads Linux 2.6.32 – flusher : one thread for one block device
11.
THANKS YOUR ATTENTION!
Jetzt herunterladen