This presentation will provide insight through a case study review. Data center operational efficiently presents many challenges; Downtime is costly and disruptive and space is at a premium. Proven and New Modular technologies can significantly improve time
and space efficiency.
Webcast: Reduce Costs, Improve Agility with Convergenomics
Saving Energy With Smart Cabling
1. Saving Energy With 'Smart' Cabling
Mike Cooper, RCDD
Systems Application Engineer, Netconnect Data Center Solutions
mike.cooper@tycoelectronics.com
October 31, 2007
2. Saving Energy With 'Smart' Cabling
What is “smart” cabling?
• High bandwidth cabling?
• High density cabling?
• Intelligent cabling?
• Well designed cabling?
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 2 / October 31, 2007
3. Impact of Power Density
• Power Density is increasing on average 15-20% per year within the
data Center
– Individual server power density
– IT Technology refresh activity
– Server footprint
• Methods of measuring efficiency within the DC are outdated
– Watts/sq meter are no longer useful in deciding server
deployment strategies
• Key to success is balancing infrastructure investments with IT goals
model
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 3 / October 31, 2007
4. Power- Where is it Going?
Reducing Data Center power consumption is a multi-faceted challenge. All
areas need to be addressed to maximize data center compute capacity and
minimize power costs.
Netw ork Equip,
12%
Server, 25% Cooling, 50%
Pw r Loss, 10%
Lighting, 3%
Sources: EYP Mission Critical Facilities, Cisco IT, Network World, Customer Interviews, APC
NOTE: Industry rule of thumb is that approx 25% of Data Center Power goes to
networking equipment and typically includes cooling and power requirements.
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 4 / October 31, 2007
5. Application Cabling Power Measurements
How much power use is direct from the network?
• Power consumption due to Ethernet links
• Power measurement of
– LAN switch
– 1000 Base-T NIC
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 5 / October 31, 2007
6. Application Cabling Power Measurements
• Power use measurement
– 24-port LAN switch
– No. of Active configured links
# ports 10 Mb/sec 100 Mb/sec 1000 Mb/sec
0 69.1 W 69.1 W 69.1 W
2 70.2 70.1 72.9
4 71.1 70.0 76.7
6 71.6 71.1 80.2
8 71.9 71.9 83.7
10 and 100 Mb/sec At 1000 Mb/sec it is about
are about the same 1.8 W added per active link
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 6 / October 31, 2007
7. Application Cabling Power Measurements
• Power use measurements
Idle Link (no activity)
Rate Current Voltage Power
(Mb/s) (mA) (V) (W) Measured at PCI bus (DC)
1000 770 5.08 3.91
Active Link (file transfer)
100 224 5.11 1.14
10 130 5.11 .664
Rate Current Voltage Power
(Mb/s) (mA) (V) (W)
Difference between 1000 and
10 Mb/sec is about 3.2 W 1000 768 5.08 3.90
100 224 5.11 1.14
No significant difference between
10 124 5.11 .633
idle and active link
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 7 / October 31, 2007
8. Current application benefits
• Density, modularity & performance
on equipment and in infrastructure
• MRJ21™ provides Hi-D Green GbE
Euro
– Connector: 1/3 -1/4 RJ45 cassette
MPO
– Cable: 30% smaller, 20% lighter MRJ21™
• 1 cable vs. wrapped 6-cable bundle 1.14”x.74”
– Eco-Friendly 6 GbE ports
– All components permanent link tested,
documented and serialized
– Pwr: 7-15% less than RJ45 in 2x ports
– 10G Shielded Version in process
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 8 / October 31, 2007
9. Network Vendors with Hi-Density GbE Equipment
• Alcatel • Shanghai Electronics
– OmniSwitch • Stratex Networks
– Lucent • Tellabs / Vivace
Foundry BigIron RX-4,8, & 16
– TiMetra • UT Starcom 48 GbE ports/card
• Barco Xenia
• EIT
• EntriSphere
• Foundry Networks
Alcatel OmniSwitch
• Force10 Networks NI48 card
• Fujitsu
• IBM IBM eServer
BladeCenter Copper Pass-
• Motorola Force10 E1200 thru module
90 GbE ports/card 15 GbE ports
• NMS Communications
• Proworks Note: The vendors listed and shown have publicly launched MRJ21
equipment into the marketplace. Vendors not listed should be
contacted directly for program status updates.
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 9 / October 31, 2007
10. 10G Base-T Application Cabling Power
• 10GB-T PHY optimized for 100m UTP Cabling
– 15-20W (in 90nm) (1000B-T: 500mW)
– Problem for High Density Line Cards, PCI Cards, MBs
– 2.5us latency (1000B-T: 250ns)
– Too high for some High Performance Applications, Fibre Channel,
InfiniBand
– Power Hungry AFE (Analog Front End)
– 50% of Power is in AFE
• Not likely to improve much over time
– Large percentage of the power is in the AFE
– Power reductions in smaller process geometries are questionable
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 10 / October 31, 2007
11. 10G Base-T Application Cabling Power
• Summary of power measurements
15
Power use (W)
10
5
0
10 100 1000 10000
10G Base-T is a power concern speed (Mb/sec)
Link
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 11 / October 31, 2007
g00.xls
12. 10G Base-T Application Shielded Cabling
Power
• Power Dissipation • Short Reach
– 3W Typical, 4W Worst Case – 30m on STP/FTP Cable (field
• Latency configurable)
– Less than 500ns – 2 Connector, 3 Links Segments
– Goal of 250ns – Goal of 45m
• Low Cost • Auto Negotiation Compatible
– Significant SNR Margin – RJ-45 Connector
(1000B-T: 10dB) – Backwards Compatible with 100B-T /
– Demonstrable Design of 1M Gates 1000B-T over UTP
(2x 1000B-T)
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 12 / October 31, 2007
13. Characteristics of Data Center Cabling
• 90% of Links are in Server Rooms Less Than 1,524 m^2 (5,000’)
(100% <= 30m)
• 5% of Links are in S. Rooms Between 1,524 m^2 and 6,096 m^2 (5,000’~20,000’)
(80% <= 30m)
• 5% of Links are in Server Rooms Greater Than 6,096 m^2 (20,000’)
(55% <= 30m)
• => 97% Coverage with 30m
• => 99% Coverage with 45m
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 13 / October 31, 2007
14. 10G Base-T Application Shielded Cabling
Power
• Networking power consumption is a significant portion of energy use
in data Centers.
• Other elements within the data Center can modulate power
to required performance
• Installing shielded cabling can allow the reduction of Network power
requirements for 10G Base-T by up to 75%
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 14 / October 31, 2007
15. Energy Efficient Ethernet
• Past / current practice
– Design for maximum performance and ensure maximum power
condition can be powered / cooled.
• Future practice needs
– Design for normal usage, ensuring maximum energy efficiency at
that operating point
– Lower energy use at lower utilization
– Design for minimum energy usage over operational lifetime
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 15 / October 31, 2007
16. Energy Efficient Ethernet
• 1 Gb/s
– Most NIC’s and most energy to be saved
– Substantial benefits for homes and offices
– Battery life benefit for notebooks
• 10 Gb/s (copper)
– Reduces power burden in data centers
– Reduces cooling burden in data centers
– May increase switch/router port capacity
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 16 / October 31, 2007
17. Energy Efficient Ethernet
• Imagine:
• Some means of changing PHY speed for major copper PHY’s:
– Change between 1000BASE-T & 100BASE-TX based on actual
utilization.
– Change between 10GBASE-T & 1000BASE-T based on actual
utilization.
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 17 / October 31, 2007
18. Energy Efficient Ethernet
• Potential estimated energy savings:
• Commercial (Office)
– PCs, switches, printers, etc.
– 1.47 to 2.21 TWh/year
– $283 to $522 million/year
• Data Centers
– Servers, storage, switches, routers, etc.
– 0.53 to 1.05 TWh/year
– $106 to $211 million/year
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 18 / October 31, 2007
19. Next Generation Ethernet Networks
• In the Data Center 10 GbE has
Server
penetrated into the access layer Farms
much faster than in the traditional
network environment A B
Edge
• Adoption of 10GbE on the server
infrastructure will drive the need for
Core
100GbE uplinks from the access to
the core of the data centers.
Storage/Tape Farms
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 19 / October 31, 2007
20. Next Generation Ethernet Networks
Fiber Copper
~2W Power Consumption ~8-15W
Cooling Requirements
Transceiver Size
$ Data Center Area $$$$
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 20 / October 31, 2007
21. Next Generation Ethernet Networks
•New high density MPO transceivers
•For40 Gb/s, commercially available
today
•12 channels running at BER <10-12,
link length 316m using OM3 fibre
•Utilizing 12 core ribbon fibre cable
•12 channels, 9.9-11.0 Gb/s/channel
tester designed and built.
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 21 / October 31, 2007
22. Next Generation Ethernet Networks
• Fibre Optic Transceiver Power estimates
– High Bandwidth
– Low Power
# Channels # Transceivers per Total Gb/s per board Total W per board
board
10 3 300 12*
6 24 2,400 60*
8 - 12 12 1,200 30*
4 - 10 12 1,200 30*
* Based on Existing 850nm lasers
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 22 / October 31, 2007
23. Saving Energy With 'Smart' Cabling
What is “smart” cabling?
• Cabling Technology that allows the support of new technologies at
low power consumption.
• Cabling that is forward compatible with data center technology
trends.
• Cabling that utilises new connector technologies that will be
compatible with the next generation interconnects.
• Cabling solutions that provide a positive impact in the power vs.
bandwidth battle.
Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 23 / October 31, 2007