This document discusses smart backup architectures for big data in open source environments. It describes a real-world implementation at a medical research facility that has experienced unpredictable data growth. Their implementation uses a SEP sesam server for file, database and bare metal backups to a clustered storage solution with replication. It discusses ongoing projects like expanding capacity with deduplication and new storage hardware.

1. Smart Backup Architectures for
• Textmasterformate
Big Data in complex, durch Klicken
Open Source based IT Environments
bearbeiten
Zweite Ebene
Dritte Ebene
Vierte Ebene
Fünfte Ebene
Hubert Schweinesbein
hs@sep.de

2. Hot IT Topics
Forrester Research Inc.
The Top 10 Strategic
Technology Trends
•
•
•
•
•
•
Mobile device battles
Mobile applications and HTML5
The personal cloud
The Internet of Things
Hybrid IT and cloud computing
Strategic big data
Session title
IT Projects 2013
Virtualization
Master Data Management
Enterprise Security
Integration of Standard and
Individual Software
• Data Quality Management
•
•
•
•
Cap Gemini

3. Big Data
Cloud Computing
Cost
driven by OSS
Session title

4. SEP sesam
B A CKU P
RESTORE
RECOVERY
Competencies

5. Big Data
Session title

6. SEP & Big Data
SMART Architecture
Multiple Stream
Multilocation Backup
Deduplication
Session title

7. Cloud
Computing
Session title

8. SEP & Cloud
It's about Agility - Flexibility
Hybrid Backup
Widest DB & OS support
Dedup & Replication
Session title

10. Cost
Session title

11. SEP & Costs
Unlimited Usage
Reduce your invest
COO instead COG
One subscribtion – use alle
SEP backup modules
Session title

12. The Real World
• Founded 1998 - Spin-off from the Institute of Clinical Chemistry
at the University Hospital Grosshadern of the LudwigMaximilians University
• Specialized in genetic and immunological diagnostics
• Health Care - very cost sensitive
• Open Source is a key strategy of their IT
• Use of Standard Hardware instead of
expensive dedicated Storage solutions
• Special Linux Distribution - Scientific Linux
www.scientificlinux.org
• Different databases – huge amount of Data

13. Requirements
• Sophisticated backup strategy with different medias, retention
times, remove of backup media to external locations, single
servers with 5TB of data
• Integrated Bare System Recovery for all Servers
– Linux and Windows
• Variety of Linux Distributions - “old” Linux Distributions (RH 7.1)
• Each backup has to be available 2 times – at least
• Backup to Disk and Tape
• Wide range of Databases – mySQL, MS SQL, Sybase,
PostgreSQL
• Upredictable data growth – 100 GB to 500 GB per month

14. Data Growth
16.000
14.000
12.000
10.000
8.000
6.000
4.000
2.000
0
00010010000000000000000000000010000000000000000000000000000001111011001010001011010
6. 3. 5. 0. 6. 2. 7. 6. 1. 6. 3. 1. 6. 2. 5. 8. 3. 7. 5. 2. 6. 4. 3. 8. 3. 9. 7. 4. 2. 6. 3. 1. 5. 4. 7. 5. 2. 6. 6. 3. 1. 5. 3. 7. 4. 2. 6. 4. 1. 5. 5. 2. 7. 4. 2. 6. 3. 1. 5. 3. 7. 1. 0. 4. 2. 9. 4. 1. 8. 6. 0. 8. 2. 9. 9. 6. 1. 8. 3. 0. 7. 2. 9.
00000000011100000000011100000000011100000000011100000000011100000000011100000000011
1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1.
00000000000000000000000000000000000011111111111111111111111111111111111111111111111
77777777777788888888888899999999999900000000000011111111111122222222222233333333333
Jan 2007
Nov 2013

15. Actual Implementation
• Cluster FS Storage Cluster with Replication
– 50TB of Backup Data ==> 100 TB soon
• SEP sesam Server on Linux
• File, Database and Bare System Recovery Backup
of Linux and Windows Servers to Cluster FS (Storage Cluster)
• Automated replication of the backup data via Cluster FS
• Migration of dedicated backups to tape
• Automated restore possible from all Nodes and from tape

16. Ongoing Projects
• Enlarge the storage capacity
• Deduplication of Backup Data by SEP Si3T Technology
• Conflict of interest - performance vs. invest for storage
• New Storage HW – Standard Server with 130 TB net capacity
• Slow disks slow down the backup - „smart“ backup tasks
speeds up to 2,5 TB / hour

17. Red Hat Storage & SEP Sesam
Session title

18. Free technical Workshop
Free technical Workshop
• SEP sesam
& Red Hat Storage
• 1 Day @ Dupaco Leusden
• 18th of March 2014
• www.dupaco.de
Session title

19. Backup issues
88% Capability related
challanges
84% Complexity
87% Cost
Veeam,Annual Data Protection Report 2013
Session title

20. Backup is not important
All backup is done to ensure a fast and
reliable restore!
The restore and disaster recovery
requirements define the backup
strategy – not the other way around!

21. SEP sesam can do it

22. •
Q&A
Textmasterformate durch Klicken
bearbeiten
Zweite Ebene
Dritte Ebene
Vierte Ebene
Fünfte Ebene
Hubert Schweinesbein
hs@sep.de