The document provides an agenda and notes from a data center vendor spotlight presentation. The presentation discusses current trends in data centers including increased power density, efficiency initiatives, and availability challenges. It also reviews the vendor's solutions for high efficiency UPS systems, high availability configurations, and distribution voltage trends. Static switches are highlighted as improving system MTBF. Both transformer-based and transformer-less UPS designs have appropriate applications depending on priorities.

1. Friday January 27th, 2012
Comcast Boot Road Data Center

2. Agenda
• 8:30-9:00 Breakfast and networking
• 9:00-9:15 Welcome
» Logistics
» Introductions
» Topics for Discussion
• 9:15-10:30 Session One:
– New Year, New objectives and priorities…
– Vendor Spotlight:
» Peter Panfil, Emerson Network Power VP Global Power Sales
• Current trends and future challenges
• 10:30-10:40 Break
• 10:40-11:30 Data Center Tour
• 11:30-12:00 Session Two:
– User Spotlight: Donna Manley – Post mortem procedures
• 12:00-1:00 Lunch

3. 2012 Goals
• Expansion of data centers
• Audit with RFID
• Bussway

4. Vendor Spotlight:
Peter A. Panfil
VP Global Power Sales
Emerson Network Power
The State of the Data Center:
Current trends and future
challenges

5. AC Power Technology
DVL DCUG
Jan 2012

6. Agenda
 Top data center challenges
 Distributed (1+N) and central (N+1) static switch
 Transformer based and transformer free UPS
 Static switches improve MTBF in distribution
 Distribution voltage trends and considerations
COMPANY CONFIDENTIAL Page 6

7. Top Data Center Challenges
External
Virtualization, forces
Cloud changing the
business
climate Infrastructure
IT Outsourcing Consolidation
Management
Heat Density
Efficiency &
Regulation Facility
Compliance
Green Availability
initiatives Challenges
Energy Efficiency
Higher Increasing
Density Demand Power Density
Reduced
Business & Budget Source: Data Center Users’ Group
technology Survey
forces pressing
on the data
center
COMPANY CONFIDENTIAL Page 7

8. Top Data Center Manager Concerns
Rank Spring 2005 Fall 2007 Spring 2008 Spring 2009 Fall 2009 Spring 2010 Spring 2011
Monitoring
Heat Density Heat Density Heat Density Heat Density Availability Infrastructure Availability
1
78% 64% 56% 55% 56% Mgt 53%
51%
Monitoring Monitoring
Power Power Power Energy
Infrastructure Heat Density Infrastructure
2 Density Density Density Efficiency
Mgt 49% Mgt
64% 55% 50% 47%
49% 52%
Monitoring
Energy
Availability Availability Infrastructure Heat Density Availability Heat Density
3 Efficiency
57% 45% Mgt 46% 47% 47%
39%
46%
Monitoring
Space Energy Energy Energy
Availability Infrastructure Availability
4 Constraints Efficiency Efficiency Efficiency
33% Mgt 41%
32% 40% 44% 44%
43%
Change Space Energy Power Power Power Power
5 Management Constraints Efficiency Density Density Density Density
28% 29% 40% 35% 25% 36% 29%
Monitoring Monitoring
Space Space Space Space Space
Infrastructure Infrastructure
6 Constraints Constraints Constraints Constraints Constraints
Mgt Mgt
26% 29% 25% 21% 18%
18% 27%
Monitoring / Infrastructure Management properly
balances the needs of efficiency and availability
Data Center Users’ Group Survey COMPANY CONFIDENTIAL Page 8

9. Liebert AC Power
Trends and Strategies
Trend Liebert Solution
 Liebert APM
High-Efficiency
 Liebert NX
Products
 Liebert NXL
Energy
 Softscale
Efficiency
Features Improving  Intelligent Eco Modes
Efficiency  TP1 (Energy Star) Rated Distribution Transformers
 Distribution Voltages (240/139 and 415/240V)
Services  Data Center Power & Cooling Assessments
 2 Stage (Segmented) Distribution
 400A Panel Boards w/ 100% Rated Mains
Increased Increasing Power
 Busway Solutions
Density Requirements
 MPX – up to 60A Rack PDU
 575V NXL
Partnerships &  Universal Switchgear Program
System Marketing Materials  Large Systems Design Guide
Focus  Development of 1+N for Large Systems
High Availability
Topologies  Modular Systems with Internal Redundancy
Existing Products  Flywheel Systems
Renewable  Alternative Energy Storage
Energy  Solar – ENPC: Solar Controller, EP: Solar
New Products
Inverter; DOE Funded Smart Grid Research
 Wind – ENPC: Wind Converter
COMPANY CONFIDENTIAL Page 9

10. High Availability Configurations
50% UPS 1 UPS 2 UPS 3 UPS 4 50% UPS 1 UPS 2 UPS 3 UPS 4
Utilization Utilization
STS STS STS STS STS STS STS STS
PDU PDU PDU PDU PDU PDU PDU PDU
Interleaved Dual Bus
Dual Corded Dual Bus Does not require complex switchgear
Requires custom switchgear for power tie STS does the power tie
Maximum Loading N/2 Maximum Loading N/2
For 4x1000 kVA=2000 kVA Max Load For 4x1000 kVA=2000 kVA Max Load
66% UPS 1 UPS 2 UPS 3 75% UPS 1 UPS 2 UPS 3 Reserve
Utilization Utilization
STS STS STS STS STS STS STS STS STS
PDU PDU PDU PDU PDU PDU PDU PDU PDU
Ring Dual Bus (Distributed Reserve) Reserve/Catcher Dual Bus
Does not require complex switchgear Does not require complex switchgear
STS does the power tie STS does the power tie
Maximum Loading (N-1)/N Maximum Loading N-R
For 4x1000 kVA=3000 kVA Max Load For 4x1000 kVA=3000 kVA Max Load
COMPANY CONFIDENTIAL Page 10

11. Options for parallel redundant UPS
UPS UPS UPS
Core Core UPS UPS UPS
Core
Core Core Core STS
SS SS SS
Paralleling Cabinet System Control Cabinet
IT Load IT Load
Distributed Bypass (1+N) Central Bypass (N+1)
Distributed static switches Centralized static transfer switch
Individual modules manage load transfers System-level control, fault tolerant
Cannot parallel different sized UPS Size of STS determines total capacity
COMPANY CONFIDENTIAL Page 11

12. N+1 vs 1+N
 For a system of 4x750kVA
– 1+N will cost $1.2M , max aic 100kaic
– N+1 will cost $1.4M , max aic 200kaic
– If specifications allow both the 1+N will always be cheaper
 When operating on inverter both have identical performance
– N+1 has better fault transfer to bypass due to one 3000/4000amp breaker
– 1+N has more sag due to parallel SS/inductors/1200a CB during fault transfer.
– Since MTBF of NXL module is 200,000 hours the 4 module system will transfer to
bypass every 50,000 hr or 6 years if capacity and statistically never if redundant
 1+N since it is composed of SMS can easily be split and sent to different
locations
– Requires two upstream feeder breakers or single input kit versus one for N+1
 NEC70E requires both to have downstream ROB to be able to service
one module while system is energized
COMPANY CONFIDENTIAL Page 12

13. Transformer Based UPS System
Single Module, Topology Three-Line
AC
Output
FBO MBB
BIB
Bypass can be connected to EG
MIB
separate utility source
Input
12P isolated
Isolation
3P
A BFB
AC
CB1
FBO
E
Trap
Disconnect
CB2
N N
MBJ
EG
or Neutral-Gnd
12P non isolated Output GEC
Management;
Battery and To Batteries
Isolation Low Common
DC Bus
Mode Noise;
Isolation Positive
DC bus
+ + + Separately
Derived
Source
+ + +
Output -AC
Negative
DC bus
COMPANY CONFIDENTIAL Page 13

14. Transformer Less UPS System
Single Module, Topology Three-Line
Some topologies require the Less Eff High
bypass to be connected to Rectifier DC Bus
the same utility source
No Output
Isolation
No Input
Additional DC Neutral Mgt /
Isolation
Converter Control Required
COMPANY CONFIDENTIAL Page 14

15. Application Philosophy
Transformer Based & Transformer Free UPS
 There are appropriate applications for both transformer
based and transformer free UPS
– Many customers have multiple applications with different priorities
 Transformer based enterprise UPS’s offer the highest
availability
– Galvanic isolation is provided for DC fault protection
– Output isolation protects the critical load and simplifies fault
management
– Use ultra-reliable, efficient SCR-based rectifiers and simple lower
voltage inverters
– Can feed rectifier and bypass from dual Separately Derived Sources
– Inherently compatible with High Resistance Grounded systems
 Transformer-free UPS’s offer low TCO with high
availability
– Double conversion efficiency up to 96%
– Uniformly Low input harmonics with consistent high power factor.
– Power distribution provides complete solution for transformer free UPS
COMPANY CONFIDENTIAL Page 15

16. Transformer Based –vs-
Transformer Free Design
Characteristic Transformer Free Transformer Based
AC-AC Double Conversion Efficiency 96% Range 94% Range
Eco Mode Efficiency Up to 99% Up to 99%
Ground Fault Protection Coordination External or Incremental Inherent
Arc Flash Mitigation External or Incremental Inherent
> 480 volt ratings for high power Additional External No Additional External
density Xformers Required Xformers Needed
Reduction in Common mode noise No Yes
and EMI
Rectifier Resiliency IGBT vs. SCR Lower Higher
High Resistance Ground No Yes
Compatibility
COMPANY CONFIDENTIAL Page 16

17. System MTBF
Without Static Switches
Module Demonstrated MTBF Block Diagram
Tier 3-4 UPS Power configuration into a Dual Input IT Load
MTBF UPS Out = UPS 1 = UPS2
Primary AC Input MTBF = S10 UPS MTBF out = > 1.6M hr MTBF Field Observed
Bypass AC Input =
100 Hr MTBF
Bypass AC Input PDU MTBF > 9 M hr
UPS 1 Field-Observed
Primary AC Input SMS MTBF > 1.7 M hr PDU
IT each AC Input MTBF =
Simplified - Components in series
= 1/((1/MTBF UPS) + (1/MTBF PDU)) IT Load
MTBF = 1.4 M hr
Primary AC Input PDU
UPS 2
Bypass AC Input SMS
COMPANY CONFIDENTIAL Page 17

18. System MTBF
Improvement With Static Switches
Module Demonstrated MTBF Block Diagram
Tier 3-4 UPS Power configuration with STS 2 into a Dual Input IT Load
MTBF UPS Out = UPS 1 = UPS2
Primary AC Input MTBF = S10 UPS MTBF out = > 1.6M hr MTBF Field Observed
Bypass AC Input =
100 Hr MTBF
Bypass AC Input STS MTBF > 7.2 M hr PDU MTBF > 9 M hr
UPS 1 MTBF > 1.7 M hr Field-Observed
Primary AC Input SMS STS2 PDU
enter
UPS MTBF = 1.7
Combined MTBF of two STS 2 Field-Observed MTBF:
Paralleled UPS outputs Field-observed STS MTFB output
= MTBF1+MTBF2+((MTBF1*MTBF2)/(MTTR)) ≈ 7.2 M hr MTBF IT Load
MTBF = 113,441 M hr IT each AC Input MTBF =
Simplified - Components in series
where Mean Time to Repair [MTTR] = 24 hrs = 1/((1/Para UPS Out) + 1/MTBF STS) + (1/MTBF PDU))
where UPS repair is less than 8 hrs enter MTBF = 4.0 M hr
Primary AC Input STS2 PDU
UPS 2
Bypass AC Input SMS
COMPANY CONFIDENTIAL Page 18

19. Traditional Dual Bus, 2N
Precision
Engine Cooling
Generators
Generator Feed to
Service Surge Input
Paralleling
Feed Suppression
Switchgear
Switchgear UPS
UPS A
Primary
Alternate
STS2
STS2
LBS
PDU: RDC/ RDC/
Alternate
Racks PDU:
Primary
PPC/FPC FDC FDC PPC/FPC
Multiple Rows
UPS B
Dual Bus = twice as many power cables
COMPANY CONFIDENTIAL Page 19

20. Distribution Voltages
600VAC •UPS 600V •PDU 208/120V •Rack
480VAC •UPS 480V •PDU 208/120V •Rack
Today
415VAC •UPS 415/240V •RDC 415/240V •Rack
480VAC •UPS 480/277V •RDC 480/277V •Rack
600VAC •UPS 600V •PDU 415V •Rack
Emerging
480VAC •UPS 415/240V •RDC 415/240V •Rack
Efficiency improvement ???
COMPANY CONFIDENTIAL Page 20

21. Isolation Transformers At The PDU
PROS
 Single point ground, separately derived source with
safety ground closer to the load reduces susceptibility to
lightning and other transients
 Only requires a 3 wire system to the PDU input
 Provide impedance which reduces available fault currents
~ and Arc Flash potential at distribution points
CONS
 Size – PDU’s with transformers can be larger
 Transformation losses …However…today’s TP-1
transformers are typically 98.5% + efficient
 Higher weight and cost
COMPANY CONFIDENTIAL Page 21

22. PDU Transformer Efficiency
99.00
$$$
98.50
% EFFICIENCY
98.00 300 kVA K20
300 kVA STD
97.50
300 kVA K20 TP1
97.00 300 kVA STD TP1
96.50
96.00
15% 25% 35% 50% 65% 75% 100%
% LOAD
COMPANY CONFIDENTIAL Page 22

23. A Fresh Look at the 400-415v System
 Modern Power supplies are wide ranging 208v to 240v test
– Higher voltage equates to higher efficiency – about 0.3% gain
 Line to neutral connection – 230/400 or 240/415v
– Can be transformer free saving energy-1-3% gain, plus cooling savings
– Fault current HAS been a major concern if transformer free
• 480 or 600v to 240/415 v with Auto (efficiency) or Iso. (aic and N-G)
• Historically, vendors supplied pieces and parts, but not an end-to-
end solution for 400-415V in North America.
– Neutral fault path and neutral noise are concerns with transformer free
– No Rack PRU balancing issue
 Line to Line connection – 120/208 and 127/240v
– New copper TP-1 Transformers have 1.5% losses
– Fault current is controlled by the transformer
• Panels, breakers, power cords, rack PDU and servers rated for fault
current (aic) are readily available
– Neutral fault path and neutral noise are from server to isolation
transformer only
COMPANY CONFIDENTIAL Page 23

24. Short Circuit Considerations (Historical)
Panelboards
 208/120 & 240/139 Volt Panels
Rated at 250V
– Type NQ
– Available to 22kAIC
 480/277 & 415/240 Requires
Panels Rated to 600V
– Type NF
– Series rated with main CB at
• 35,65 and 100kaic
– Physically larger
– More costly (10-25%)
Are your Rack PDUs and
servers rated for this high AIC?
COMPANY CONFIDENTIAL Page 24

25. Fault Current
Arc Flash Considerations
 Arc flash?
– Bolted vs. arcing faults
– Significant incident energy released during the arcing event and is
considered the “arc flash hazard”
 NFPA 70E-2004 “A flash hazard analysis be done in order to protect
personnel from the possibility of being injured by an arc flash”
 Determination of required PPE - Personal Protective Equipment
 Calculation of incidence of energy
– Ampere rating of over current protective device
– Operating time of the device
– Available fault current is key!!!
COMPANY CONFIDENTIAL Page 25

26. Solving the 415V AIC Issue
Problem
3250 kVA 3250 kVA • AC Distribution panels
34.5 kV – 34.5 kV – • Lighting panels
480/277 415/240
Z >= 5.32% X Z >= 5.32% X • Exposed buss (arch flash)
Isc ~ 73,480A Isc ~ 84,989A • AIC of UL approved “touch
safe”
• Rack PDUs
UPS UPS • AIC may exceed safe design
SYSTEM SYSTEM
Solutions
• Introduce impedance such as
inductor or transformer
•Disadvantage efficiency
•Advantage grounding and
fault management (tx)
• I-Line Panels offer higher AIC
300 kVA
480V – (100k) and safer design
208/120V
PDU PDU • Higher AIC capable RPDU’s
Z >= 4%
X X
Isc ~ 17,576 A Isc ~ 56,144 A
RACK RACK
Isc < 5kA Isc ~ 10-12kA
208 Volt 415 Volt
Distribution Distribution
COMPANY CONFIDENTIAL Page 26

27. Distribution Voltage Considerations
UPS System Voltage and Capacity
5000 Amp System UPS System Voltage
415V 480V 600V
Max. Bus Capacity 3590 kVA 4152 kVA 5190 kVA
 Maximize your investment in breakers and gear with
higher UPS System voltages
 The higher the chosen voltage - the greater the potential
capacity – 15% to 25%
COMPANY CONFIDENTIAL Page 27

28. Distribution Voltage Pros & Cons
PROS CONS
 Most commonly accepted application  2-3% transformation energy loss
480 – 208/120  Reduced aic – fault curent  208V requires 2 pole breaker
 Uses standard 240V panelboard & breakers  Reduces the number of poles
600 – 208/120  N-G bond at PDU
 N-G bond at PDU( iso)  0.5 to 1.3%% transformer energy loss
480 – 400/230  Higher energy efficiency  Can’t power 120V equipment
 Higher energy density  More circuits due to1-pole
600 – 400/230  Higher UPS capacity - kVA  N-G bond (auto) at service entrance
 Reduced AIC – fault current
 No transformation energy losses  Can’t power 120V or 240V equipment
480 – 480  No neutral required (unless 277V loads)  Requires 480V panelboard & breakers
 Few servers at 480V & 277V
480 – 480/277  Higher AIC – fault current at load
 No transformation energy losses  N-G bond at bypass transformer
 240V load requires 1 pole breaker  Requires 480V panelboard& breakers
480 – 415/240  More useable pole spaces  Requires UPS Maint Bypass Xfmr
 Higher energy efficiency  Higher AIC – fault current at load
 No transformation energy losses  Can’t power 120V equipment
 Reduced cooling load  Requires 480V panelboard& breakers
 240V load requires 1 pole breaker  Needs different approach to fault
415 – 415/240  More useable pole spaces current management
 Higher energy efficiency  N-G bond at service entrance
 Save cost and weight of transformers in  Increase cost of full neutral and higher
PDUs ampacity – lower system kVA
COMPANY CONFIDENTIAL Page 28

29. 29
COMPANY CONFIDENTIAL Page 29 29

30. Liebert STS2, S610, NXb, PPC, FPC,
NXL Reliability Summary May 2011
Product Operating Hours Mod. MTBF Sys. MTBF
(Cur # Units) Oct 00 – Mar 11 Code 14 Code 15
Transfer To Bypass Unfiltered Filtered
Critical Bus Failure
STS 2 (4,082) 121,462,656 Hrs. 886,589 Hrs. 8,675,904 Hrs.
S610 (6,642) 419,488,584 Hrs. 47,838 Hrs. 1,712,198 Hrs.
NXb (2,843) 105,092,280 Hrs. 202,490 Hrs. 2,563,226 Hrs.
PPC (10,474) 878,674,536 Hrs. 2,670,743 Hrs. 10,217,146 Hrs.
FPC (1,951) 41,363,976 Hrs. 10,340,994 Hrs. 13,787,992 Hrs.
NXL (612) 5,581,704 Hrs. 206,730 Hrs. 1,395,426 Hrs.*
APM (113) 384,432 Hrs. 384,432 Hrs. 384,432 Hrs.
* Updated Nov 2011 COMPANY CONFIDENTIAL Page 30 30

31. Power Business Segments
Primary Motivation
Critical TCO
Infrastructure Availability Capital/Operational Savings
Capital/Operational Savings
Availability
Core Enterprise Scale-Out
Customer
Traditionalist Opportunist Experimentalist
Type
Operates on the edge of
Firmly adheres to long-held, Ventures outside of industry
Customer acceptable operating
proven industry standards to standards and best-practices
Behavior & recommendations taking
maximize infrastructure with the goal to significantly
Motivation calculated risks to balance
availability reduce financial costs
financial costs and availability
Primary Transformer Based Transformer Based Transformer Free Battery on Server
Technology UPS UPS in Eco-Mode UPS in Eco-Mode Model
Transformer Free UPS
• Providing mission critical • Providing less critical • Customers still expect
computing to customers computing to internal or application high availability
• Required uptime based on external customers • Basic services are provided
Customer
government regulations • Need to meet customer SLAs for limited fees with no
Attributes
• Extremely high cost of for uptime with limited guarantees
application downtime penalties • High compute volume
• Balancing cost of downtime demands lowest computing
with OPEX costs possible
COMPANY CONFIDENTIAL Page 31

32. High Availability Configurations
50% UPS 1 UPS 2 UPS 3 UPS 4 50% UPS 1 UPS 2 UPS 3 UPS 4
Utilization Utilization
STS STS STS STS STS STS STS STS
PDU PDU PDU PDU PDU PDU PDU PDU
Interleaved Dual Bus
Dual Corded Dual Bus Does not require complex switchgear
Requires custom switchgear for power tie STS does the power tie
Maximum Loading N/2 Maximum Loading N/2
For 4x1000 kVA=2000 kVA Max Load For 4x1000 kVA=2000 kVA Max Load
66% UPS 1 UPS 2 UPS 3 75% UPS 1 UPS 2 UPS 3 Reserve
Utilization Utilization
STS STS STS STS STS STS STS STS STS
PDU PDU PDU PDU PDU PDU PDU PDU PDU
Ring Dual Bus (Distributed Reserve) Reserve/Catcher Dual Bus
Does not require complex switchgear Does not require complex switchgear
STS does the power tie STS does the power tie
Maximum Loading (N-1)/N Maximum Loading N-R
For 4x1000 kVA=3000 kVA Max Load For 4x1000 kVA=3000 kVA Max Load
COMPANY CONFIDENTIAL Page 32

33. Break:
See you in 15!

34. User Spotlight: Donna
Manley
Post mortem procedures

35. Managing a Full Data Center
Power Down
Donna M. Manley, MBA
IT Senior Director, Computer Operations
University of Pennsylvania

36. July 3-4, 2009
36

37. July 3-4, 2009
37

38. January 2010 (Morning)
38

39. January 2010 (Noon)
39

40. 40

41. Before you get started….
• Agree upon scope
• Documentation
• Validate infrastructure and architecture
• Asset identification and application dependencies
• Understand what pre-work can be completed
• DR site and Vital Records storage providers on standby
• What’s the weather forecast?
Take the opportunity to do stuff you wouldn’t normally be able to
without an outage!
41

42. 42

43. 43

44. 44

45. Logistics….
• Coordination with Public Safety
• Coordination with Facilities
• Command Center
• Know who will be there and when
• Vendor Expectations
• Accommodations, food, and beverage
45

46. 46

47. 47

48. Managing the Outage…
• Communication (Bridges, Web, Email)
• Playbook
• Change Freeze
• Action Items to be remediated prior
• Test plan
• Points of Contact - Data Center/Facilities/Vendors
• Who gives the “GO”
48

49. 49

50. 50

51. 51

52. Post Outage…
• Communication (Bridges, Web, Email)
• Execute Test Plan
• Lessons Learned
• Process and procedural modifications
• Automation opportunities
• Sleep!
Lots of great information was compiled for this event – keep it
current!
52

53. Thank you for allowing me to
share my thoughts with you
today!
Donna M. Manley, MBA
IT Sr. Director, Computer Operations
ITIL V3 Foundations Certified
University of Pennsylvania
manleydm@isc.upenn.edu
53

54. Survey
– Was this forum beneficial?
– Was this the proper number of end users or
should the forum grow? If grow, please give a
number you feel would be appropriate.
– How often should this forum meet? When?
– What topics would you be interested in
discussing at the next meeting?
– What other venues for this event would you like
to see?

55. Thank you for
attending!