SlideShare ist ein Scribd-Unternehmen logo
1 von 24
Downloaden Sie, um offline zu lesen
Bacula
The leading Opensource Backup Solution
OpenSource Project
Bacula is a network backup solution, designed for
*BSD, Linux, Mac OS X, Unix and Windows systems.
Original project goals were to:
● backup any client from a Palm to a mainframe computer
● provide “Enterprise” features similar to the largest commercial applications
● assure data compatibility for 30 years
● use a Free and Open Source (GPL v2) license
Project History
Bacula = Backup + Dracula
● January 2000 – Project started
● 14 April 2002 – First release to Source Forge (version 1.16)
● 29 June 2006 – Release 1.38.11
● January 2007 – Release 2.0.0
● August 2007 – Release 2.2.0 (current 2.2.8)
● ...
Downloads 670,013 all versions 4.2 TB
Introduction
Do you do backups?
No
Yes, I did one last month
Yes, tarballs every week
Sometimes I rsync ...
Yes, CDs every week
I use custom scripts
Problems:
How do you find the files you need to restore?
How do you restore to a point in time?
What is on what medium?
How do you handle 2000 machines?
Government regulations
Introduction
Bacula to the rescue:
● Open Source (GPLv2)
● Centrally managed
● Network backup/restore
● Many platforms (*BSD, Linux, Mac OS X, Unix Win32, ...)
● Different media (Tape, disk, USB, CD/DVD)
● Reliable
● Knows what was backed up when and where
● Allows restoring files you want (Catalog + GUI)
● Restores to a point in time
● Scales to handle 10,000 machines
Five Main Components
The Five Bacula Components
● Control and administration for everything is centralized
● Basic unit is a Job (one client, one set of files, ...)
● Schedules, initiates and supervises all Jobs
● Maintains the catalog (SQL database)
● Typically one Director except in very large shops
● Does file backup, restore and verification requested by Director
● Installed on each machine as a service (daemon)
● Communicates over network with Director and Storage daemon
● Needs access to all files to be backed up (root, SYSTEM)
● Typically multiple File daemons per Director; one for each machine
● Reads and writes data to the physical medium
● Disk, Tape, CD/DVD, USB, ...
● Accepts orders and authorization from the Director
● Accepts and returns data to/from File daemons (FD)
● Sends file storage location to Director -> Catalog
● Typically one per Director but with multiple devices
The Five Bacula Components
● Allows user or administrator to control Bacula
● Communicates with Director via network
● Start jobs, review Job output, query/modify catalog
● Consoles available
○ TTY (bconsole)
○ bat a Qt 4 (GUI) – most comprehensive
○ wxWidgets (GUI) – Linux, Unix, Win32
○ Gnome (GUI) – deprecated
○ Several web interfaces (bweb is most comprehensive)
● Restricted consoles permit users to restore their own files
● Only component not written by Bacula team
● SQL database (MySQL, PostgreSQL, or SQLite) - unique
● Tracks Jobs run, Volumes used, File locations, ...
● Permits rapid restores
● Allows inquiry of when and where files were backed up
● Old data automatically pruned by Director
● Supports multiple databases for scaling
Features
● A central server and catalog with distributed backup
● All components communicate via the network.
● Internal scheduler for automatic and simultaneous job execution with priorities.
● Interactive restore with many options, for example:
○ current backup (most common)
○ prior backup of time and date
○ list of files/directories to restore
○ restore by JobId
● Simple administration with consoles (command line, GUI, and web)
● Labeled Volumes, to prevent accidental overwriting
● Support for ANSI / IBM labels
● Machine independent Volume data format - extensible
● Support for Unicode on Win32; UTF-8 on Unix
● Rescue CDROM for “bare metal” recovery (very complicated)
Bacula - Hardware Features
● Backups can span multiple volumes
● Multiple backups (jobs, clients, OSes) per volume
● Supports most tape drives with configurable Device resources
● Support for multiple drive autochangers (libraries)
● Supports tape barcode readers
● Extensive Pool and Volume library management
● Rapid restoration of individual files (one user reported 4 to 6
● hours with tar and 3 to 4 minutes with Bacula!).
Bacula - Security Feaures
● Daemon authorization with CRAM--MD5
● Director and Storage daemon can be run non--root
● MD5, SHA1, ... signatures for each file
● CRC checksum for each Volume block
● Restricted consoles and tray-monitors
● Communications (TLS) encryption
● Data (PKI) encryption
● Tripwire like intrusion detection (Verify)
Bacula - Jobs
who, what, where, when
Jobs are the basic unifying structure
Name – unique name (who)
Type – what to do: backup, Backup, Migrate, Admin, Restore
Level – level of detail of type: Full, Differential, Incremental
FileSet – what to files to backup
Client – where to get the files (machine name)
Storage – where to put the files (which hardware)
Pool – which set of Volumes (tapes, disk) to use
Schedule – when to do it
Bacula - Director Configuration File
Director {
Name = bacula-dir
Query File = “/usr/local/etc/query.sql”
Working Directory = “/var/bacula”
PID Directory = “/var/run”
Maximum Concurrent Jobs = 20
Password = “secret”
Messages = Standard
}
Bacula - Director Configuration File
Job { # who, what, where, when
Name = “Music”
Type = Backup
Client = bcli
FileSet = “Full Set”
Storage = File
Schedule = “Weekly”
Pool = Standard
Messages = Standard
Write Bootstrap = “/var/bacula/bcli.bsr”
}
Bacula - Director Configuration File
Client {
Name = bcli
Address = 10.0.0.1
Catalog = MyCatalog
Password = “secret--bcli”
File Retention = 30 days
Job Retention = 6 months
AutoPrune = yes
Maximum Concurrent Jobs = 20
}
Bacula Configuration - Fileset
● Include/Exclude files and/or directories
● Regex or wildcard for file/directory name selection
● Compression using similar selection criteria
● Which filesystem types to backup
● Backup OS Access Control List data (permissions)
● Sparse file handling
● Signature (MD5, SHA1, ...)
Bacula Configuration - Fileset
FileSet {
Name = “Full Set”
Include {
Options {
signature=SHA1;
regex = ".*.bak$";
exclude = yes
}
File = /
File = /usr
File = /var
}
Exclude {
File = /proc; File = /tmp; File = /sys; File = /.journal
}
}
Bacula Configuration - Schedule
Schedule {
Name = “Weekly”
Run = Level=Full 1st sun at 2:05
Run = Level=Differential 2nd--5th sun at 2:05
Run = Level=Incremental mon--sat at 2:05
}
Total directives per resource:
Director=27 Client=21 Storage=21 Job=60 Schedule=3, Device=52, ...
Bacula Configuration - Storage
Device {
Name = File
Archive Device = /var/bacula/backups
Device Type = File # Directory, DVD, FIFO, Tape
Media Type = File
Label Media = yes
Random Access = yes
...
}
Bacula Configuration - Storage
AutoChanger {
Name = LTO-Changer
Device = Drive-0, Drive-1
Changer Device = /dev/sg0
...
}
Device {
Name = Drive-0
Archive Device = /dev/nst0
Device Type = Tape # DVD, File, FIFO
Media Type = LTO-2
Autochanger = yes
...
}
Real Installation
● 53TB, 150,000,000 files, 90 clients, Linux
● 40TB, 40,000,000 files, 30 clients, Solaris
● LTO-3 libraries with several drives
● Large libraries with 100's of tape slots
● Libraries and drives connected with FC SAN
● 20GB, 200,000 files, 1 client, Linux disk and tape
Project Development
Project development
Site : http://www.bacula.org/
Development style:
○ SourceForge project
○ Developer's guide with code style guidelines
○ Developer SVN access. Currently 16 developers may commit
○ Patches and commits reviewed by K. Sibbald
○ Code tested using a regression test suite
○ Email list for developers (bacula-devel)
License:
○ GPL 2 copyright assigned to FSFE.
○ Freedom Task Force (FTF)
Resources
For users and system administrators
Manual: http://www.bacula.org/en/rel-manual/index.html
OS and Hardware compatibility lists (in manual)
Bugs reports: http://bugs.bacula.org/
Email support list: bacula-users@lists.sourceforge.net
For developers
Docs: http://www.bacula.org/en/developers/index.html
Email list: bacula-devel@lists.sourceforge.net,
bacula-commits@lists.sourceforge.net
SVN at Source Forge
Credits
Thanks
Dan Langille who created the original presentation
Karl Cunningham who updated it
This presentation draws heavily on their work
A .pdf copy of this presentation can be found at:
http://www.bacula.org -> Presentations -> ...
Many Thanks!
samba@netstudent.polito.it

Weitere ähnliche Inhalte

Was ist angesagt?

PostgreSQL continuous backup and PITR with Barman
 PostgreSQL continuous backup and PITR with Barman PostgreSQL continuous backup and PITR with Barman
PostgreSQL continuous backup and PITR with BarmanEDB
 
Ceph Introduction 2017
Ceph Introduction 2017  Ceph Introduction 2017
Ceph Introduction 2017 Karan Singh
 
Version Control with SVN
Version Control with SVNVersion Control with SVN
Version Control with SVNPHPBelgium
 
Introduction to Version Control and Configuration Management
Introduction to Version Control and Configuration ManagementIntroduction to Version Control and Configuration Management
Introduction to Version Control and Configuration ManagementPhilip Johnson
 
CONFidence 2017: Hacking embedded with OpenWrt (Vladimir Mitiouchev)
CONFidence 2017: Hacking embedded with OpenWrt (Vladimir Mitiouchev)CONFidence 2017: Hacking embedded with OpenWrt (Vladimir Mitiouchev)
CONFidence 2017: Hacking embedded with OpenWrt (Vladimir Mitiouchev)PROIDEA
 
Microsoft Windows Server 2012 R2 Hyper V server overview
Microsoft Windows Server 2012 R2 Hyper V server overviewMicrosoft Windows Server 2012 R2 Hyper V server overview
Microsoft Windows Server 2012 R2 Hyper V server overviewaboobakar sanjar
 
Linux : Booting and runlevels
Linux : Booting and runlevelsLinux : Booting and runlevels
Linux : Booting and runlevelsJohn Ombagi
 
“Practical DNN Quantization Techniques and Tools,” a Presentation from Facebook
“Practical DNN Quantization Techniques and Tools,” a Presentation from Facebook“Practical DNN Quantization Techniques and Tools,” a Presentation from Facebook
“Practical DNN Quantization Techniques and Tools,” a Presentation from FacebookEdge AI and Vision Alliance
 
Investing the Effects of Overcommitting YARN resources
Investing the Effects of Overcommitting YARN resourcesInvesting the Effects of Overcommitting YARN resources
Investing the Effects of Overcommitting YARN resourcesDataWorks Summit/Hadoop Summit
 
Extending Machine Learning Algorithms with PySpark
Extending Machine Learning Algorithms with PySparkExtending Machine Learning Algorithms with PySpark
Extending Machine Learning Algorithms with PySparkDatabricks
 
Performance Tuning of .NET Application
Performance Tuning of .NET ApplicationPerformance Tuning of .NET Application
Performance Tuning of .NET ApplicationMainul Islam, CSM®
 
SPACK: A Package Manager for Supercomputers, Linux, and MacOS
SPACK: A Package Manager for Supercomputers, Linux, and MacOSSPACK: A Package Manager for Supercomputers, Linux, and MacOS
SPACK: A Package Manager for Supercomputers, Linux, and MacOSinside-BigData.com
 
A brief introduction to version control systems
A brief introduction to version control systemsA brief introduction to version control systems
A brief introduction to version control systemsTim Staley
 
Course 102: Lecture 4: Using Wild Cards
Course 102: Lecture 4: Using Wild CardsCourse 102: Lecture 4: Using Wild Cards
Course 102: Lecture 4: Using Wild CardsAhmed El-Arabawy
 
Basic Linux Security
Basic Linux SecurityBasic Linux Security
Basic Linux Securitypankaj009
 

Was ist angesagt? (20)

PostgreSQL continuous backup and PITR with Barman
 PostgreSQL continuous backup and PITR with Barman PostgreSQL continuous backup and PITR with Barman
PostgreSQL continuous backup and PITR with Barman
 
Ceph Introduction 2017
Ceph Introduction 2017  Ceph Introduction 2017
Ceph Introduction 2017
 
Version Control with SVN
Version Control with SVNVersion Control with SVN
Version Control with SVN
 
Introduction to Version Control and Configuration Management
Introduction to Version Control and Configuration ManagementIntroduction to Version Control and Configuration Management
Introduction to Version Control and Configuration Management
 
CONFidence 2017: Hacking embedded with OpenWrt (Vladimir Mitiouchev)
CONFidence 2017: Hacking embedded with OpenWrt (Vladimir Mitiouchev)CONFidence 2017: Hacking embedded with OpenWrt (Vladimir Mitiouchev)
CONFidence 2017: Hacking embedded with OpenWrt (Vladimir Mitiouchev)
 
PostgreSQL.pptx
PostgreSQL.pptxPostgreSQL.pptx
PostgreSQL.pptx
 
Vagrant
VagrantVagrant
Vagrant
 
Version control
Version controlVersion control
Version control
 
Microsoft Windows Server 2012 R2 Hyper V server overview
Microsoft Windows Server 2012 R2 Hyper V server overviewMicrosoft Windows Server 2012 R2 Hyper V server overview
Microsoft Windows Server 2012 R2 Hyper V server overview
 
Linux : Booting and runlevels
Linux : Booting and runlevelsLinux : Booting and runlevels
Linux : Booting and runlevels
 
“Practical DNN Quantization Techniques and Tools,” a Presentation from Facebook
“Practical DNN Quantization Techniques and Tools,” a Presentation from Facebook“Practical DNN Quantization Techniques and Tools,” a Presentation from Facebook
“Practical DNN Quantization Techniques and Tools,” a Presentation from Facebook
 
Cat @ scale
Cat @ scaleCat @ scale
Cat @ scale
 
Investing the Effects of Overcommitting YARN resources
Investing the Effects of Overcommitting YARN resourcesInvesting the Effects of Overcommitting YARN resources
Investing the Effects of Overcommitting YARN resources
 
Extending Machine Learning Algorithms with PySpark
Extending Machine Learning Algorithms with PySparkExtending Machine Learning Algorithms with PySpark
Extending Machine Learning Algorithms with PySpark
 
Performance Tuning of .NET Application
Performance Tuning of .NET ApplicationPerformance Tuning of .NET Application
Performance Tuning of .NET Application
 
Backup strategy
Backup strategyBackup strategy
Backup strategy
 
SPACK: A Package Manager for Supercomputers, Linux, and MacOS
SPACK: A Package Manager for Supercomputers, Linux, and MacOSSPACK: A Package Manager for Supercomputers, Linux, and MacOS
SPACK: A Package Manager for Supercomputers, Linux, and MacOS
 
A brief introduction to version control systems
A brief introduction to version control systemsA brief introduction to version control systems
A brief introduction to version control systems
 
Course 102: Lecture 4: Using Wild Cards
Course 102: Lecture 4: Using Wild CardsCourse 102: Lecture 4: Using Wild Cards
Course 102: Lecture 4: Using Wild Cards
 
Basic Linux Security
Basic Linux SecurityBasic Linux Security
Basic Linux Security
 

Ähnlich wie Bacula Overview

Containerization Is More than the New Virtualization
Containerization Is More than the New VirtualizationContainerization Is More than the New Virtualization
Containerization Is More than the New VirtualizationC4Media
 
Introduction to containers
Introduction to containersIntroduction to containers
Introduction to containersNitish Jadia
 
Lamp1
Lamp1Lamp1
Lamp1Reka
 
Lamp
LampLamp
LampReka
 
24HOP Introduction to Linux for SQL Server DBAs
24HOP Introduction to Linux for SQL Server DBAs24HOP Introduction to Linux for SQL Server DBAs
24HOP Introduction to Linux for SQL Server DBAsKellyn Pot'Vin-Gorman
 
Highly efficient backups with percona xtrabackup
Highly efficient backups with percona xtrabackupHighly efficient backups with percona xtrabackup
Highly efficient backups with percona xtrabackupNilnandan Joshi
 
Backing up Wikipedia Databases
Backing up Wikipedia DatabasesBacking up Wikipedia Databases
Backing up Wikipedia DatabasesJaime Crespo
 
Percona xtrabackup - MySQL Meetup @ Mumbai
Percona xtrabackup - MySQL Meetup @ MumbaiPercona xtrabackup - MySQL Meetup @ Mumbai
Percona xtrabackup - MySQL Meetup @ MumbaiNilnandan Joshi
 
Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...Alluxio, Inc.
 
Linux kernel architecture
Linux kernel architectureLinux kernel architecture
Linux kernel architectureSHAJANA BASHEER
 
Lamp ppt
Lamp pptLamp ppt
Lamp pptReka
 

Ähnlich wie Bacula Overview (20)

Dumitru Enache - Bacula
Dumitru Enache - BaculaDumitru Enache - Bacula
Dumitru Enache - Bacula
 
Containerization Is More than the New Virtualization
Containerization Is More than the New VirtualizationContainerization Is More than the New Virtualization
Containerization Is More than the New Virtualization
 
Introduction to containers
Introduction to containersIntroduction to containers
Introduction to containers
 
Lamp1
Lamp1Lamp1
Lamp1
 
Lamp
LampLamp
Lamp
 
Lamp1
Lamp1Lamp1
Lamp1
 
24HOP Introduction to Linux for SQL Server DBAs
24HOP Introduction to Linux for SQL Server DBAs24HOP Introduction to Linux for SQL Server DBAs
24HOP Introduction to Linux for SQL Server DBAs
 
Highly efficient backups with percona xtrabackup
Highly efficient backups with percona xtrabackupHighly efficient backups with percona xtrabackup
Highly efficient backups with percona xtrabackup
 
Edubooktraining
EdubooktrainingEdubooktraining
Edubooktraining
 
Backing up Wikipedia Databases
Backing up Wikipedia DatabasesBacking up Wikipedia Databases
Backing up Wikipedia Databases
 
File
FileFile
File
 
Percona xtrabackup - MySQL Meetup @ Mumbai
Percona xtrabackup - MySQL Meetup @ MumbaiPercona xtrabackup - MySQL Meetup @ Mumbai
Percona xtrabackup - MySQL Meetup @ Mumbai
 
Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...
 
Linux kernel architecture
Linux kernel architectureLinux kernel architecture
Linux kernel architecture
 
Lamp ppt
Lamp pptLamp ppt
Lamp ppt
 
Puppet
PuppetPuppet
Puppet
 
All about InfluxDB.
All about InfluxDB.All about InfluxDB.
All about InfluxDB.
 
Lamp ppt
Lamp pptLamp ppt
Lamp ppt
 
Ioppt
IopptIoppt
Ioppt
 
Linux Internals - Part I
Linux Internals - Part ILinux Internals - Part I
Linux Internals - Part I
 

Kürzlich hochgeladen

Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024TopCSSGallery
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkPixlogix Infotech
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesBernd Ruecker
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 

Kürzlich hochgeladen (20)

Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App Framework
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 

Bacula Overview

  • 2. OpenSource Project Bacula is a network backup solution, designed for *BSD, Linux, Mac OS X, Unix and Windows systems. Original project goals were to: ● backup any client from a Palm to a mainframe computer ● provide “Enterprise” features similar to the largest commercial applications ● assure data compatibility for 30 years ● use a Free and Open Source (GPL v2) license
  • 3. Project History Bacula = Backup + Dracula ● January 2000 – Project started ● 14 April 2002 – First release to Source Forge (version 1.16) ● 29 June 2006 – Release 1.38.11 ● January 2007 – Release 2.0.0 ● August 2007 – Release 2.2.0 (current 2.2.8) ● ... Downloads 670,013 all versions 4.2 TB
  • 4. Introduction Do you do backups? No Yes, I did one last month Yes, tarballs every week Sometimes I rsync ... Yes, CDs every week I use custom scripts Problems: How do you find the files you need to restore? How do you restore to a point in time? What is on what medium? How do you handle 2000 machines? Government regulations
  • 5. Introduction Bacula to the rescue: ● Open Source (GPLv2) ● Centrally managed ● Network backup/restore ● Many platforms (*BSD, Linux, Mac OS X, Unix Win32, ...) ● Different media (Tape, disk, USB, CD/DVD) ● Reliable ● Knows what was backed up when and where ● Allows restoring files you want (Catalog + GUI) ● Restores to a point in time ● Scales to handle 10,000 machines
  • 7. The Five Bacula Components ● Control and administration for everything is centralized ● Basic unit is a Job (one client, one set of files, ...) ● Schedules, initiates and supervises all Jobs ● Maintains the catalog (SQL database) ● Typically one Director except in very large shops ● Does file backup, restore and verification requested by Director ● Installed on each machine as a service (daemon) ● Communicates over network with Director and Storage daemon ● Needs access to all files to be backed up (root, SYSTEM) ● Typically multiple File daemons per Director; one for each machine ● Reads and writes data to the physical medium ● Disk, Tape, CD/DVD, USB, ... ● Accepts orders and authorization from the Director ● Accepts and returns data to/from File daemons (FD) ● Sends file storage location to Director -> Catalog ● Typically one per Director but with multiple devices
  • 8. The Five Bacula Components ● Allows user or administrator to control Bacula ● Communicates with Director via network ● Start jobs, review Job output, query/modify catalog ● Consoles available ○ TTY (bconsole) ○ bat a Qt 4 (GUI) – most comprehensive ○ wxWidgets (GUI) – Linux, Unix, Win32 ○ Gnome (GUI) – deprecated ○ Several web interfaces (bweb is most comprehensive) ● Restricted consoles permit users to restore their own files ● Only component not written by Bacula team ● SQL database (MySQL, PostgreSQL, or SQLite) - unique ● Tracks Jobs run, Volumes used, File locations, ... ● Permits rapid restores ● Allows inquiry of when and where files were backed up ● Old data automatically pruned by Director ● Supports multiple databases for scaling
  • 9. Features ● A central server and catalog with distributed backup ● All components communicate via the network. ● Internal scheduler for automatic and simultaneous job execution with priorities. ● Interactive restore with many options, for example: ○ current backup (most common) ○ prior backup of time and date ○ list of files/directories to restore ○ restore by JobId ● Simple administration with consoles (command line, GUI, and web) ● Labeled Volumes, to prevent accidental overwriting ● Support for ANSI / IBM labels ● Machine independent Volume data format - extensible ● Support for Unicode on Win32; UTF-8 on Unix ● Rescue CDROM for “bare metal” recovery (very complicated)
  • 10. Bacula - Hardware Features ● Backups can span multiple volumes ● Multiple backups (jobs, clients, OSes) per volume ● Supports most tape drives with configurable Device resources ● Support for multiple drive autochangers (libraries) ● Supports tape barcode readers ● Extensive Pool and Volume library management ● Rapid restoration of individual files (one user reported 4 to 6 ● hours with tar and 3 to 4 minutes with Bacula!).
  • 11. Bacula - Security Feaures ● Daemon authorization with CRAM--MD5 ● Director and Storage daemon can be run non--root ● MD5, SHA1, ... signatures for each file ● CRC checksum for each Volume block ● Restricted consoles and tray-monitors ● Communications (TLS) encryption ● Data (PKI) encryption ● Tripwire like intrusion detection (Verify)
  • 12. Bacula - Jobs who, what, where, when Jobs are the basic unifying structure Name – unique name (who) Type – what to do: backup, Backup, Migrate, Admin, Restore Level – level of detail of type: Full, Differential, Incremental FileSet – what to files to backup Client – where to get the files (machine name) Storage – where to put the files (which hardware) Pool – which set of Volumes (tapes, disk) to use Schedule – when to do it
  • 13. Bacula - Director Configuration File Director { Name = bacula-dir Query File = “/usr/local/etc/query.sql” Working Directory = “/var/bacula” PID Directory = “/var/run” Maximum Concurrent Jobs = 20 Password = “secret” Messages = Standard }
  • 14. Bacula - Director Configuration File Job { # who, what, where, when Name = “Music” Type = Backup Client = bcli FileSet = “Full Set” Storage = File Schedule = “Weekly” Pool = Standard Messages = Standard Write Bootstrap = “/var/bacula/bcli.bsr” }
  • 15. Bacula - Director Configuration File Client { Name = bcli Address = 10.0.0.1 Catalog = MyCatalog Password = “secret--bcli” File Retention = 30 days Job Retention = 6 months AutoPrune = yes Maximum Concurrent Jobs = 20 }
  • 16. Bacula Configuration - Fileset ● Include/Exclude files and/or directories ● Regex or wildcard for file/directory name selection ● Compression using similar selection criteria ● Which filesystem types to backup ● Backup OS Access Control List data (permissions) ● Sparse file handling ● Signature (MD5, SHA1, ...)
  • 17. Bacula Configuration - Fileset FileSet { Name = “Full Set” Include { Options { signature=SHA1; regex = ".*.bak$"; exclude = yes } File = / File = /usr File = /var } Exclude { File = /proc; File = /tmp; File = /sys; File = /.journal } }
  • 18. Bacula Configuration - Schedule Schedule { Name = “Weekly” Run = Level=Full 1st sun at 2:05 Run = Level=Differential 2nd--5th sun at 2:05 Run = Level=Incremental mon--sat at 2:05 } Total directives per resource: Director=27 Client=21 Storage=21 Job=60 Schedule=3, Device=52, ...
  • 19. Bacula Configuration - Storage Device { Name = File Archive Device = /var/bacula/backups Device Type = File # Directory, DVD, FIFO, Tape Media Type = File Label Media = yes Random Access = yes ... }
  • 20. Bacula Configuration - Storage AutoChanger { Name = LTO-Changer Device = Drive-0, Drive-1 Changer Device = /dev/sg0 ... } Device { Name = Drive-0 Archive Device = /dev/nst0 Device Type = Tape # DVD, File, FIFO Media Type = LTO-2 Autochanger = yes ... }
  • 21. Real Installation ● 53TB, 150,000,000 files, 90 clients, Linux ● 40TB, 40,000,000 files, 30 clients, Solaris ● LTO-3 libraries with several drives ● Large libraries with 100's of tape slots ● Libraries and drives connected with FC SAN ● 20GB, 200,000 files, 1 client, Linux disk and tape
  • 22. Project Development Project development Site : http://www.bacula.org/ Development style: ○ SourceForge project ○ Developer's guide with code style guidelines ○ Developer SVN access. Currently 16 developers may commit ○ Patches and commits reviewed by K. Sibbald ○ Code tested using a regression test suite ○ Email list for developers (bacula-devel) License: ○ GPL 2 copyright assigned to FSFE. ○ Freedom Task Force (FTF)
  • 23. Resources For users and system administrators Manual: http://www.bacula.org/en/rel-manual/index.html OS and Hardware compatibility lists (in manual) Bugs reports: http://bugs.bacula.org/ Email support list: bacula-users@lists.sourceforge.net For developers Docs: http://www.bacula.org/en/developers/index.html Email list: bacula-devel@lists.sourceforge.net, bacula-commits@lists.sourceforge.net SVN at Source Forge
  • 24. Credits Thanks Dan Langille who created the original presentation Karl Cunningham who updated it This presentation draws heavily on their work A .pdf copy of this presentation can be found at: http://www.bacula.org -> Presentations -> ... Many Thanks! samba@netstudent.polito.it