SlideShare ist ein Scribd-Unternehmen logo
1 von 29
Reliability Analysis of An
Energy-Aware RAID System
Shu Yin
Xiao Qin
Auburn University
Presentation Outline
• Motivation;
• Related Work;
• MREED Model;
• Experimental Result;
• Conclusion/Future Work.
2
Mobile Multimedia
Data-Intensive Applications
3
Motivation
Bio- Informatics
3D Graphic Weather Forecast
Cluster System
4
Cluster in Data Center
Problem: Energy Dissipation
EPA Report to Congress on Server and Data Center Energy Efficiency, 2007
5
Problem: Energy Dissipation (cont.)
• Using 2010 Historical Trends Scenario
– Server and Data Centers Consume 120 Billion
kWh per year;
– Assume average commercial end user is
charged 9.46 kWh;
– Disk systems can account for 27% of the
computing energy cost of data centers.
6
• Software- directed Power Management
• Dynamic Power Management
• Redundancy Technique
• Multi- speed Setting
Existing Energy Conservation Techniques
7
Contradictory of Energy Efficiency and
Reliability
8
Example: Disk spin up and down
MREED Model
9
R= RBaseValue
[1]*τ+α*R(f)[2]
[1] E. Pinheiro, W.-D. Weber, and L.A. Barroso. Failure trends in a large disk drive population. Proc.
USENIX Conf. File and Storage Tech., February2007.
[2] IDEMA Standards. Specification of hard disk drive reliability.
R(f)=1.51e-6f2 – 1.09e-5f + 1.39e-2
Baseline Failure Rate Derived from Disk Utilization
Temperature Factor
Coefficient to RBaseValue, α=1 in our research
MREED Model
(Temperature Factor τ[3])
10
Temperature
(˚C)
Acceleration
Factor
De-rating
Factor
Adjusted MTBF
25 1.000 1.00 232.140
26 1.0507 0.95 220.553
30 1.2763 0.78 181.069
34 1.5425 0.65 150.891
38 1.8552 0.54 125.356
42 2.2208 0.45 104.463
46 2.6465 0.38 8.123
[3] G. Cole, “Estimating Drive Reliability in Desktop Computers and Consumer Electronics Systems”
Seagate Personal Storage Group, 2000
MREED Model
(MATHEMATICAL RELIABILITY MODELS FOR ENERGY-EFFICIENT RAID SYSTEMS)
11
MREED Model
(MATHEMATICAL RELIABILITY MODELS FOR ENERGY-EFFICIENT RAID SYSTEMS)
12
Energy-Conservation RAID Technique
Weibull Distribution
Analysis
Access Pattern
Frequency
Temperature
Annual Failure
Rate
System Reliability
System Level Reliability
Weibull Analysis
13
• A Leading Method for Fitting Life Date
• Advantages:
• Accurate
• Small Samples
• Widely Used
MREED Model
(Energy Conservation Techniques- PARAID)
Power-Aware RAID (PARAID)[4] System Structure
[4] Charles Weddle, Mathew Oldhan, Jin Qian, An-I Andy Wang. PARAID- A Gear-Shifting Power-Aware RAID.
USENIX FAST 2007.
14
Soft
state
RAID
Gears
Model Validation
15
•Techniques
• Run the Systems for A Couple of Decades
• The Event Validity Validation Techniques[5]
[5] R.G. Sargent, “Verification and Validation of Simulation Models”, in Proceedings of the 37th conference on
Winter Simulation, ser. WSC’05 Winter Simulation Conference, 2005.
Model Validation
16
•Challenges
• Unable to Monitor PARAID Running for Years
• Sample Size is Small from A Validation
Perspective (e.g. 100 Disks for Five Years)
Model Validation
(DiskSim[6] Simulation)
17
[6] S.W.S John, S. Bucy, Jiri Schindler and G.R. Ganger, “The DiskSim Simulation Environment Version 4.0
Reference Manual”, 2008
Input Trace
(File Level)
File to Block Mapper
Simulate File
(Block Access)
DiskSim
(Block Level)
File to Block Level Converter Outline
Model Validation
(DiskSim Simulation)
18
Diagram of the Storage System Corresponding to the DiskSim RAID-0
Driver 0
Bus 0
CTLR 2
BUS 2
Driver 2
CTLR 3
BUS 3
Driver 3
CTLR 4
BUS 4
Driver 4
CTLR 1
BUS 1
Driver 1
CTLR 0
BUS 0
Driver 0
Model Validation
(Result)
19
Utilization Comparison Between MREED and DiskSim Simulator
Model Validation
(Result)
20
Gear Shifting Comparison Between MREED and DiskSim Simulator
Reliability Evaluation
(Experimental Setup)
21
Disk Type Seagate ST3146855FC
Capacity 146 GB
Cache Size Sata 16MB
Buffer to Host Transfer Rate 4Gb/s (Max)
Total Number of Disks 5
File Size 100 MB
Number of Files 1000
Synthetic Trace Poisson Distribution
Time Period 24 Hours
Interval Time (Time Phase) 1 Hour
Power On Hour Per Year 8760 Hours
Reliability Evaluation
(Disk Utilization Comparison)
22
Disks Utilization Comparison Between PARAID-0 and RAID-0 at A Low Access Rate
(20 Times Per Hour)
23
Disks Utilization Comparison Between PARAID-0 and RAID-0 at A High Access Rate
(80 Times Per Hour)
Reliability Evaluation
(Disk Utilization Comparison)
24
AFR Comparison Between PARAID-0 and RAID-0 at A Low Access Rate
(20 Times Per Hour)
Reliability Evaluation
(AFR Comparison)
25
AFR Comparison Between PARAID-0 and RAID-0 at A High Access Rate
(80 Per Hour)
Reliability Evaluation
(AFR Comparison)
AFR
Future Work
• Extend the MREED Model Power-Aware RAID-5;
– Data Stripping
• Investigate Trade-off Between Reliability & Energy-
Efficiency ;
• Evaluate and Compare an array of energy-saving
techniques with respect to specific application
domains;
26
Conclusion
• A Reliability Model (MREED) for Power-Ware RAID;
• Weibull Distribution Analysis to MREED;
• Validation of MREED;
• Impacts of the Gear-shifting on Reliability of PARAID.
27
Questions

Weitere ähnliche Inhalte

Andere mochten auch

An Active and Hybrid Storage System for Data-intensive Applications
An Active and Hybrid Storage System for Data-intensive ApplicationsAn Active and Hybrid Storage System for Data-intensive Applications
An Active and Hybrid Storage System for Data-intensive ApplicationsXiao Qin
 
How to do research?
How to do research?How to do research?
How to do research?Xiao Qin
 
OS/161 Overview
OS/161 OverviewOS/161 Overview
OS/161 OverviewXiao Qin
 
Nas'12 overview
Nas'12 overviewNas'12 overview
Nas'12 overviewXiao Qin
 
IPCCC 2012 Conference Program Overview
IPCCC 2012 Conference Program OverviewIPCCC 2012 Conference Program Overview
IPCCC 2012 Conference Program OverviewXiao Qin
 
Project 2 how to modify OS/161
Project 2 how to modify OS/161Project 2 how to modify OS/161
Project 2 how to modify OS/161Xiao Qin
 
Project 2 - how to compile os161?
Project 2 - how to compile os161?Project 2 - how to compile os161?
Project 2 - how to compile os161?Xiao Qin
 
COMP2710 Software Construction: header files
COMP2710 Software Construction: header filesCOMP2710 Software Construction: header files
COMP2710 Software Construction: header filesXiao Qin
 
Energy Efficient Data Storage Systems
Energy Efficient Data Storage SystemsEnergy Efficient Data Storage Systems
Energy Efficient Data Storage SystemsXiao Qin
 
Why Major in Computer Science and Software Engineering at Auburn University?
Why Major in Computer Science and Software Engineering at Auburn University?Why Major in Computer Science and Software Engineering at Auburn University?
Why Major in Computer Science and Software Engineering at Auburn University?Xiao Qin
 
Common grammar mistakes
Common grammar mistakesCommon grammar mistakes
Common grammar mistakesXiao Qin
 
Thermal modeling and management of cluster storage systems xunfei jiang 2014
Thermal modeling and management of cluster storage systems xunfei jiang 2014Thermal modeling and management of cluster storage systems xunfei jiang 2014
Thermal modeling and management of cluster storage systems xunfei jiang 2014Xiao Qin
 
Project 2 How to modify os161: A Manual
Project 2 How to modify os161: A ManualProject 2 How to modify os161: A Manual
Project 2 How to modify os161: A ManualXiao Qin
 
Surviving a group project
Surviving a group projectSurviving a group project
Surviving a group projectXiao Qin
 
Project 2 how to install and compile os161
Project 2 how to install and compile os161Project 2 how to install and compile os161
Project 2 how to install and compile os161Xiao Qin
 
COMP2710: Software Construction - Linked list exercises
COMP2710: Software Construction - Linked list exercisesCOMP2710: Software Construction - Linked list exercises
COMP2710: Software Construction - Linked list exercisesXiao Qin
 
How to add system calls to OS/161
How to add system calls to OS/161How to add system calls to OS/161
How to add system calls to OS/161Xiao Qin
 
Data center specific thermal and energy saving techniques
Data center specific thermal and energy saving techniquesData center specific thermal and energy saving techniques
Data center specific thermal and energy saving techniquesXiao Qin
 
Understanding what our customer wants-slideshare
Understanding what our customer wants-slideshareUnderstanding what our customer wants-slideshare
Understanding what our customer wants-slideshareXiao Qin
 
Performance Evaluation of Traditional Caching Policies on a Large System with...
Performance Evaluation of Traditional Caching Policies on a Large System with...Performance Evaluation of Traditional Caching Policies on a Large System with...
Performance Evaluation of Traditional Caching Policies on a Large System with...Xiao Qin
 

Andere mochten auch (20)

An Active and Hybrid Storage System for Data-intensive Applications
An Active and Hybrid Storage System for Data-intensive ApplicationsAn Active and Hybrid Storage System for Data-intensive Applications
An Active and Hybrid Storage System for Data-intensive Applications
 
How to do research?
How to do research?How to do research?
How to do research?
 
OS/161 Overview
OS/161 OverviewOS/161 Overview
OS/161 Overview
 
Nas'12 overview
Nas'12 overviewNas'12 overview
Nas'12 overview
 
IPCCC 2012 Conference Program Overview
IPCCC 2012 Conference Program OverviewIPCCC 2012 Conference Program Overview
IPCCC 2012 Conference Program Overview
 
Project 2 how to modify OS/161
Project 2 how to modify OS/161Project 2 how to modify OS/161
Project 2 how to modify OS/161
 
Project 2 - how to compile os161?
Project 2 - how to compile os161?Project 2 - how to compile os161?
Project 2 - how to compile os161?
 
COMP2710 Software Construction: header files
COMP2710 Software Construction: header filesCOMP2710 Software Construction: header files
COMP2710 Software Construction: header files
 
Energy Efficient Data Storage Systems
Energy Efficient Data Storage SystemsEnergy Efficient Data Storage Systems
Energy Efficient Data Storage Systems
 
Why Major in Computer Science and Software Engineering at Auburn University?
Why Major in Computer Science and Software Engineering at Auburn University?Why Major in Computer Science and Software Engineering at Auburn University?
Why Major in Computer Science and Software Engineering at Auburn University?
 
Common grammar mistakes
Common grammar mistakesCommon grammar mistakes
Common grammar mistakes
 
Thermal modeling and management of cluster storage systems xunfei jiang 2014
Thermal modeling and management of cluster storage systems xunfei jiang 2014Thermal modeling and management of cluster storage systems xunfei jiang 2014
Thermal modeling and management of cluster storage systems xunfei jiang 2014
 
Project 2 How to modify os161: A Manual
Project 2 How to modify os161: A ManualProject 2 How to modify os161: A Manual
Project 2 How to modify os161: A Manual
 
Surviving a group project
Surviving a group projectSurviving a group project
Surviving a group project
 
Project 2 how to install and compile os161
Project 2 how to install and compile os161Project 2 how to install and compile os161
Project 2 how to install and compile os161
 
COMP2710: Software Construction - Linked list exercises
COMP2710: Software Construction - Linked list exercisesCOMP2710: Software Construction - Linked list exercises
COMP2710: Software Construction - Linked list exercises
 
How to add system calls to OS/161
How to add system calls to OS/161How to add system calls to OS/161
How to add system calls to OS/161
 
Data center specific thermal and energy saving techniques
Data center specific thermal and energy saving techniquesData center specific thermal and energy saving techniques
Data center specific thermal and energy saving techniques
 
Understanding what our customer wants-slideshare
Understanding what our customer wants-slideshareUnderstanding what our customer wants-slideshare
Understanding what our customer wants-slideshare
 
Performance Evaluation of Traditional Caching Policies on a Large System with...
Performance Evaluation of Traditional Caching Policies on a Large System with...Performance Evaluation of Traditional Caching Policies on a Large System with...
Performance Evaluation of Traditional Caching Policies on a Large System with...
 

Ähnlich wie Reliability Analysis of Energy-Aware RAID Systems Using MREED Model

TeraGrid Communication and Computation
TeraGrid Communication and ComputationTeraGrid Communication and Computation
TeraGrid Communication and ComputationTal Lavian Ph.D.
 
The Cloud & Its Impact on IT
The Cloud & Its Impact on ITThe Cloud & Its Impact on IT
The Cloud & Its Impact on ITAnand Haridass
 
Runtime Methods to Improve Energy Efficiency in HPC Applications
Runtime Methods to Improve Energy Efficiency in HPC ApplicationsRuntime Methods to Improve Energy Efficiency in HPC Applications
Runtime Methods to Improve Energy Efficiency in HPC ApplicationsFacultad de Informática UCM
 
Simulating Heterogeneous Resources in CloudLightning
Simulating Heterogeneous Resources in CloudLightningSimulating Heterogeneous Resources in CloudLightning
Simulating Heterogeneous Resources in CloudLightningCloudLightning
 
3. ami big data hadoop on ucs seminar may 2013
3. ami big data hadoop on ucs seminar may 20133. ami big data hadoop on ucs seminar may 2013
3. ami big data hadoop on ucs seminar may 2013Taldor Group
 
Advanced equal logic customer presentation
Advanced equal logic customer presentationAdvanced equal logic customer presentation
Advanced equal logic customer presentationallardb
 
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facilityinside-BigData.com
 
Dependable Systems - Structure-Based Dependabiilty Modeling (6/16)
Dependable Systems - Structure-Based Dependabiilty Modeling (6/16)Dependable Systems - Structure-Based Dependabiilty Modeling (6/16)
Dependable Systems - Structure-Based Dependabiilty Modeling (6/16)Peter Tröger
 
Net App D2 D Backupwith Snap Vaultand Ossv Customer Strategic Presentation201...
Net App D2 D Backupwith Snap Vaultand Ossv Customer Strategic Presentation201...Net App D2 D Backupwith Snap Vaultand Ossv Customer Strategic Presentation201...
Net App D2 D Backupwith Snap Vaultand Ossv Customer Strategic Presentation201...Michael Hudak
 
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open CloudCoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open CloudAta Turk
 
Ibm pure data system for analytics n200x
Ibm pure data system for analytics n200xIbm pure data system for analytics n200x
Ibm pure data system for analytics n200xIBM Sverige
 
Michael Gschwind, Chip Multiprocessing and the Cell Broadband Engine
Michael Gschwind, Chip Multiprocessing and the Cell Broadband EngineMichael Gschwind, Chip Multiprocessing and the Cell Broadband Engine
Michael Gschwind, Chip Multiprocessing and the Cell Broadband EngineMichael Gschwind
 
E voting Initiative in India
E voting Initiative in IndiaE voting Initiative in India
E voting Initiative in IndiaAditya Pachori
 
Future Trends in IT Storage
Future Trends in IT StorageFuture Trends in IT Storage
Future Trends in IT StorageTony Pearson
 
Big Data LDN 2016: Kick Start your Big Data project with Hyperconverged Infra...
Big Data LDN 2016: Kick Start your Big Data project with Hyperconverged Infra...Big Data LDN 2016: Kick Start your Big Data project with Hyperconverged Infra...
Big Data LDN 2016: Kick Start your Big Data project with Hyperconverged Infra...Matt Stubbs
 

Ähnlich wie Reliability Analysis of Energy-Aware RAID Systems Using MREED Model (20)

TeraGrid Communication and Computation
TeraGrid Communication and ComputationTeraGrid Communication and Computation
TeraGrid Communication and Computation
 
The Cloud & Its Impact on IT
The Cloud & Its Impact on ITThe Cloud & Its Impact on IT
The Cloud & Its Impact on IT
 
Runtime Methods to Improve Energy Efficiency in HPC Applications
Runtime Methods to Improve Energy Efficiency in HPC ApplicationsRuntime Methods to Improve Energy Efficiency in HPC Applications
Runtime Methods to Improve Energy Efficiency in HPC Applications
 
rerngvit_phd_seminar
rerngvit_phd_seminarrerngvit_phd_seminar
rerngvit_phd_seminar
 
Simulating Heterogeneous Resources in CloudLightning
Simulating Heterogeneous Resources in CloudLightningSimulating Heterogeneous Resources in CloudLightning
Simulating Heterogeneous Resources in CloudLightning
 
3. ami big data hadoop on ucs seminar may 2013
3. ami big data hadoop on ucs seminar may 20133. ami big data hadoop on ucs seminar may 2013
3. ami big data hadoop on ucs seminar may 2013
 
Advanced equal logic customer presentation
Advanced equal logic customer presentationAdvanced equal logic customer presentation
Advanced equal logic customer presentation
 
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility
 
Dependable Systems - Structure-Based Dependabiilty Modeling (6/16)
Dependable Systems - Structure-Based Dependabiilty Modeling (6/16)Dependable Systems - Structure-Based Dependabiilty Modeling (6/16)
Dependable Systems - Structure-Based Dependabiilty Modeling (6/16)
 
IAC 2020
IAC 2020IAC 2020
IAC 2020
 
RATIONALIST
RATIONALISTRATIONALIST
RATIONALIST
 
Net App D2 D Backupwith Snap Vaultand Ossv Customer Strategic Presentation201...
Net App D2 D Backupwith Snap Vaultand Ossv Customer Strategic Presentation201...Net App D2 D Backupwith Snap Vaultand Ossv Customer Strategic Presentation201...
Net App D2 D Backupwith Snap Vaultand Ossv Customer Strategic Presentation201...
 
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open CloudCoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
 
The state of SQL-on-Hadoop in the Cloud
The state of SQL-on-Hadoop in the CloudThe state of SQL-on-Hadoop in the Cloud
The state of SQL-on-Hadoop in the Cloud
 
Ibm pure data system for analytics n200x
Ibm pure data system for analytics n200xIbm pure data system for analytics n200x
Ibm pure data system for analytics n200x
 
Michael Gschwind, Chip Multiprocessing and the Cell Broadband Engine
Michael Gschwind, Chip Multiprocessing and the Cell Broadband EngineMichael Gschwind, Chip Multiprocessing and the Cell Broadband Engine
Michael Gschwind, Chip Multiprocessing and the Cell Broadband Engine
 
E voting Initiative in India
E voting Initiative in IndiaE voting Initiative in India
E voting Initiative in India
 
slides
slidesslides
slides
 
Future Trends in IT Storage
Future Trends in IT StorageFuture Trends in IT Storage
Future Trends in IT Storage
 
Big Data LDN 2016: Kick Start your Big Data project with Hyperconverged Infra...
Big Data LDN 2016: Kick Start your Big Data project with Hyperconverged Infra...Big Data LDN 2016: Kick Start your Big Data project with Hyperconverged Infra...
Big Data LDN 2016: Kick Start your Big Data project with Hyperconverged Infra...
 

Mehr von Xiao Qin

How to apply for internship positions?
How to apply for internship positions?How to apply for internship positions?
How to apply for internship positions?Xiao Qin
 
How to write research papers? Version 5.0
How to write research papers? Version 5.0How to write research papers? Version 5.0
How to write research papers? Version 5.0Xiao Qin
 
Making a competitive nsf career proposal: Part 2 Worksheet
Making a competitive nsf career proposal: Part 2 WorksheetMaking a competitive nsf career proposal: Part 2 Worksheet
Making a competitive nsf career proposal: Part 2 WorksheetXiao Qin
 
Making a competitive nsf career proposal: Part 1 Tips
Making a competitive nsf career proposal: Part 1 TipsMaking a competitive nsf career proposal: Part 1 Tips
Making a competitive nsf career proposal: Part 1 TipsXiao Qin
 
Auburn csse faculty orientation
Auburn csse faculty orientationAuburn csse faculty orientation
Auburn csse faculty orientationXiao Qin
 
Auburn CSSE graduate student orientation
Auburn CSSE graduate student orientationAuburn CSSE graduate student orientation
Auburn CSSE graduate student orientationXiao Qin
 
CSSE Graduate Programs Committee: Progress Report
CSSE Graduate Programs Committee: Progress ReportCSSE Graduate Programs Committee: Progress Report
CSSE Graduate Programs Committee: Progress ReportXiao Qin
 
P#1 stream of praise
P#1 stream of praiseP#1 stream of praise
P#1 stream of praiseXiao Qin
 
HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...
HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...
HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...Xiao Qin
 
Reliability Modeling and Analysis of Energy-Efficient Storage Systems
Reliability Modeling and Analysis of Energy-Efficient Storage SystemsReliability Modeling and Analysis of Energy-Efficient Storage Systems
Reliability Modeling and Analysis of Energy-Efficient Storage SystemsXiao Qin
 

Mehr von Xiao Qin (10)

How to apply for internship positions?
How to apply for internship positions?How to apply for internship positions?
How to apply for internship positions?
 
How to write research papers? Version 5.0
How to write research papers? Version 5.0How to write research papers? Version 5.0
How to write research papers? Version 5.0
 
Making a competitive nsf career proposal: Part 2 Worksheet
Making a competitive nsf career proposal: Part 2 WorksheetMaking a competitive nsf career proposal: Part 2 Worksheet
Making a competitive nsf career proposal: Part 2 Worksheet
 
Making a competitive nsf career proposal: Part 1 Tips
Making a competitive nsf career proposal: Part 1 TipsMaking a competitive nsf career proposal: Part 1 Tips
Making a competitive nsf career proposal: Part 1 Tips
 
Auburn csse faculty orientation
Auburn csse faculty orientationAuburn csse faculty orientation
Auburn csse faculty orientation
 
Auburn CSSE graduate student orientation
Auburn CSSE graduate student orientationAuburn CSSE graduate student orientation
Auburn CSSE graduate student orientation
 
CSSE Graduate Programs Committee: Progress Report
CSSE Graduate Programs Committee: Progress ReportCSSE Graduate Programs Committee: Progress Report
CSSE Graduate Programs Committee: Progress Report
 
P#1 stream of praise
P#1 stream of praiseP#1 stream of praise
P#1 stream of praise
 
HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...
HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...
HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...
 
Reliability Modeling and Analysis of Energy-Efficient Storage Systems
Reliability Modeling and Analysis of Energy-Efficient Storage SystemsReliability Modeling and Analysis of Energy-Efficient Storage Systems
Reliability Modeling and Analysis of Energy-Efficient Storage Systems
 

Kürzlich hochgeladen

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DaySri Ambati
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 

Kürzlich hochgeladen (20)

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 

Reliability Analysis of Energy-Aware RAID Systems Using MREED Model

  • 1. Reliability Analysis of An Energy-Aware RAID System Shu Yin Xiao Qin Auburn University
  • 2. Presentation Outline • Motivation; • Related Work; • MREED Model; • Experimental Result; • Conclusion/Future Work. 2
  • 3. Mobile Multimedia Data-Intensive Applications 3 Motivation Bio- Informatics 3D Graphic Weather Forecast
  • 5. Problem: Energy Dissipation EPA Report to Congress on Server and Data Center Energy Efficiency, 2007 5
  • 6. Problem: Energy Dissipation (cont.) • Using 2010 Historical Trends Scenario – Server and Data Centers Consume 120 Billion kWh per year; – Assume average commercial end user is charged 9.46 kWh; – Disk systems can account for 27% of the computing energy cost of data centers. 6
  • 7. • Software- directed Power Management • Dynamic Power Management • Redundancy Technique • Multi- speed Setting Existing Energy Conservation Techniques 7
  • 8. Contradictory of Energy Efficiency and Reliability 8 Example: Disk spin up and down
  • 9. MREED Model 9 R= RBaseValue [1]*τ+α*R(f)[2] [1] E. Pinheiro, W.-D. Weber, and L.A. Barroso. Failure trends in a large disk drive population. Proc. USENIX Conf. File and Storage Tech., February2007. [2] IDEMA Standards. Specification of hard disk drive reliability. R(f)=1.51e-6f2 – 1.09e-5f + 1.39e-2 Baseline Failure Rate Derived from Disk Utilization Temperature Factor Coefficient to RBaseValue, α=1 in our research
  • 10. MREED Model (Temperature Factor τ[3]) 10 Temperature (˚C) Acceleration Factor De-rating Factor Adjusted MTBF 25 1.000 1.00 232.140 26 1.0507 0.95 220.553 30 1.2763 0.78 181.069 34 1.5425 0.65 150.891 38 1.8552 0.54 125.356 42 2.2208 0.45 104.463 46 2.6465 0.38 8.123 [3] G. Cole, “Estimating Drive Reliability in Desktop Computers and Consumer Electronics Systems” Seagate Personal Storage Group, 2000
  • 11. MREED Model (MATHEMATICAL RELIABILITY MODELS FOR ENERGY-EFFICIENT RAID SYSTEMS) 11
  • 12. MREED Model (MATHEMATICAL RELIABILITY MODELS FOR ENERGY-EFFICIENT RAID SYSTEMS) 12 Energy-Conservation RAID Technique Weibull Distribution Analysis Access Pattern Frequency Temperature Annual Failure Rate System Reliability System Level Reliability
  • 13. Weibull Analysis 13 • A Leading Method for Fitting Life Date • Advantages: • Accurate • Small Samples • Widely Used
  • 14. MREED Model (Energy Conservation Techniques- PARAID) Power-Aware RAID (PARAID)[4] System Structure [4] Charles Weddle, Mathew Oldhan, Jin Qian, An-I Andy Wang. PARAID- A Gear-Shifting Power-Aware RAID. USENIX FAST 2007. 14 Soft state RAID Gears
  • 15. Model Validation 15 •Techniques • Run the Systems for A Couple of Decades • The Event Validity Validation Techniques[5] [5] R.G. Sargent, “Verification and Validation of Simulation Models”, in Proceedings of the 37th conference on Winter Simulation, ser. WSC’05 Winter Simulation Conference, 2005.
  • 16. Model Validation 16 •Challenges • Unable to Monitor PARAID Running for Years • Sample Size is Small from A Validation Perspective (e.g. 100 Disks for Five Years)
  • 17. Model Validation (DiskSim[6] Simulation) 17 [6] S.W.S John, S. Bucy, Jiri Schindler and G.R. Ganger, “The DiskSim Simulation Environment Version 4.0 Reference Manual”, 2008 Input Trace (File Level) File to Block Mapper Simulate File (Block Access) DiskSim (Block Level) File to Block Level Converter Outline
  • 18. Model Validation (DiskSim Simulation) 18 Diagram of the Storage System Corresponding to the DiskSim RAID-0 Driver 0 Bus 0 CTLR 2 BUS 2 Driver 2 CTLR 3 BUS 3 Driver 3 CTLR 4 BUS 4 Driver 4 CTLR 1 BUS 1 Driver 1 CTLR 0 BUS 0 Driver 0
  • 19. Model Validation (Result) 19 Utilization Comparison Between MREED and DiskSim Simulator
  • 20. Model Validation (Result) 20 Gear Shifting Comparison Between MREED and DiskSim Simulator
  • 21. Reliability Evaluation (Experimental Setup) 21 Disk Type Seagate ST3146855FC Capacity 146 GB Cache Size Sata 16MB Buffer to Host Transfer Rate 4Gb/s (Max) Total Number of Disks 5 File Size 100 MB Number of Files 1000 Synthetic Trace Poisson Distribution Time Period 24 Hours Interval Time (Time Phase) 1 Hour Power On Hour Per Year 8760 Hours
  • 22. Reliability Evaluation (Disk Utilization Comparison) 22 Disks Utilization Comparison Between PARAID-0 and RAID-0 at A Low Access Rate (20 Times Per Hour)
  • 23. 23 Disks Utilization Comparison Between PARAID-0 and RAID-0 at A High Access Rate (80 Times Per Hour) Reliability Evaluation (Disk Utilization Comparison)
  • 24. 24 AFR Comparison Between PARAID-0 and RAID-0 at A Low Access Rate (20 Times Per Hour) Reliability Evaluation (AFR Comparison)
  • 25. 25 AFR Comparison Between PARAID-0 and RAID-0 at A High Access Rate (80 Per Hour) Reliability Evaluation (AFR Comparison) AFR
  • 26. Future Work • Extend the MREED Model Power-Aware RAID-5; – Data Stripping • Investigate Trade-off Between Reliability & Energy- Efficiency ; • Evaluate and Compare an array of energy-saving techniques with respect to specific application domains; 26
  • 27. Conclusion • A Reliability Model (MREED) for Power-Ware RAID; • Weibull Distribution Analysis to MREED; • Validation of MREED; • Impacts of the Gear-shifting on Reliability of PARAID. 27
  • 28.