1. StorEdge 9900 Series
Speakers Name
Title

2. Dialing-in the Right-Sized Storage!
The SE 9900 Combination
Rated by importance to customer's application SLA (low-medium-high)
✔ Data Availability
VERY HIGH
✔IO Performance
HIGH
✔Service Costs (Installation and Management)
LOW
✔Data Scalability
VERY HIGH
✔Data Protection
VERY HIGH
✔Implementation Price
MEDIUM
✔Flexibility of Server Support
VERY HIGH Sun Confidential: Internal Only 2

3. Sun StorEdge 9990 System
The Ultimate Storage Platform
● For the high end data center
● Unparalleled performance,
availability, scalability,
manageability, connectivity
● Application-oriented storage
– Massive consolidation
– High volume OLTP
– Business intelligence, large scale
– Regulatory compliance
– Data and information lifecycle
management
– Service provider business models
– E-mail archiving
Sun Confidential: Internal Only 3

4. Sun StorEdge 9990 System
Performance, Capacity, Scalability, Connectivity
● 81 GB per second aggregate system bandwidth
(68 GB per second data and 13 GB per second control)
● Performance scales with capacity
● 336 TB internal capacity (300 GB drives)
● 1152 drive slots
● 256 GB data cache
● 12 GB shared memory
● Up to 192 direct connections (FC)
● 2 Gbps FC backend loops
● Multi-platform connectivity
– FC/FICON/ESCON/NAS
● 73 GB 15K, 146 GB 10K and 15K, 300 GB 10K
dual-ported FC drives
Sun Confidential: Internal Only 4

5. StorEdge 9985 System
The Ultimate Entry System for the Data Center
 Scaled Down Version of the SE 9990
 Excellent Performance for its Class
● 12 GB/Sec Aggregate System Bandwidth
● Scalability
● From 1 to 72TB (per Subsystem)
● Does not grow into an SE9990
● Centralized Storage Management
● Common Platform for Multi-Vendor Support
● Virtualize and manage up to 16PB
● Active Workload Analysis & Tuning
● Flexible Connectivity Options
● FC, ESCON, FICON, NAS
Sun Confidential: Internal Only 5

6. SE9990
Architecture
Sun Confidential: Internal Only 6

7. SE 9990 Architecture
Sun Confidential: Internal Only 7

8. Sun StorEdge 9990 System
Architecture — Third Generation Supercomputer
Crossbar Switch
●Supercomputer Crossbar Switch
81 GB per second
– 4 switches with a parallel switch fabric
– 64 paths on both processor and cache sides
– 128 concurrent
cache operations
– Non-blocking
Sun Confidential: Internal Only 8

9. SE 9900 Family Adapter Design
● Each Adapter actually consists of
two PCBs
●Even though they are one adapter,
Two PCBs are actually placed
in two different HW clusters
●Sixteen slots in two HW clusters
● A pair of PCBs are symmetrical which
Means “active/active and load balanced.”
Adapter 1 Adapter 1 prime
C1 C2
Adapter 2 Adapter82ports
BED = prime
Sun Confidential: Internal Only 9

10. Sun StorEdge 9990 System
Architecture — I/O
● Total of 16 slots accommodate
– Front-end directors (FEDs — AKA channel host adapters, or CHAs)
– Back-end directors (BEDs — AKA array control processors, or ACPs)
– Each FED or BED occupies two slots
– Of the 16 slots, 4 are reserved for FEDs
● Up to 6 FEDs, with 16 or 32 FC ports, up to a max of 192 FC ports
● Up to 96 ESCON and 48 FICON ports are supported
● Up to 4 BEDs, each supporting sixteen 2 Gbps FC-AL
connections to drives
– Each BED supports up to 256 drives. End result is 64
FCAL loops
Sun Confidential: Internal Only 10

11. SE 9900 FamilyFED
●Each FED has two PCB,
each PCB has 8 MPs for a
total of 16 MPs per FED
●Each MP has flash memory
associated with it, where
microcode is stored.
● 32 port adapter = 2 port
per MP
● 16 port adapter = 1 port
per MP
PCB = Printed Circuit Board
MP = Microprocessor
Sun Confidential: Internal Only 11

12. 4 Gbit Front End Director
● 255 MB/sec: GA October 2005
● 355 MB/sec: Future (Estimated May 2006)
● Expected configuration (subject to change)
● 32 and 16 port versions
● Each port operates at 4 Gbit/sec
Sun Confidential: Internal Only 12

13. Non-Disruptive Upgrade of
Microcode –
MP 1
●Path control is transferred
to MP partner
●Data path is kept online
while flash memory updated
●Dialogue asks if to
MP 2 continue if data path
saturation exceeds 50%
MP = Microprocessor w/Flash Memory; 16 MPs/FED
@ 400MHz; Mps are dedicated
Sun Confidential: Internal Only 13

14. Sun StorEdge 9990 System
Server Support/LDEVS/Virtual Ports/Sparing
● 625 server support example, assuming 10 switches
– Each switch supports 144 ports = 1440 ports
– 1440 ports divided by two for redundancy = 720 ports pairs
– 720 port pairs less 95 port pairs (for back-end storage connectivity) =
625 ports to support servers
– Example only, actual implementation will vary according to
workload
● 16,384 logical devices Sparing
● 24,576 virtual ports
Drives Spares
Sun StorEdge 9990 100 (Entry) 5 – 256 1–4
Sun StorEdge 9990 600 (Enhanced) 97 – 512 1–8
Sun StorEdge 9990 1100 (Ultra) 129 – 1152 1 – 16
Note: These are pricing reference configurations, not separate and distinct models
Sun Confidential: Internal Only 14

15. SE 9900 NAS Blade Feature
● Fits in the same slot of the FED
● Eight 1Gbps Ethernet ports per blade
● Up to 4 blades per SE 9990, for a total of 32 Ethernet ports
● Blades are active-active failure
● Supports CIFS and NFS
● Works with ShadowImage and Truecopy, and other storage
mgmt software
● Snapshot capability, Supports Active Directory and OpenLDAP
● Symantec anti-virus agent; purchase anti-virus server
seperately
● File Shared/blade: 256 for both CIFS and NFS
Sun Confidential: Internal Only 15

16. Battery Backup/Data Destage
Sun Confidential: Internal Only 16

17. SE 9990 Warranty
Warranty
Warranty Period 3yrs
4hr response on-site support
Service Level Telephone Support 24 3 years
X7
Install Service Included in
Yes
Purchase Price
Sun Confidential: Internal Only 17

18. SE9985
Architecture
Sun Confidential: Internal Only 18

19. Phase 2 Architecture Completed
Additional Capacity, Cache and Mainframe Support
Primary Secondary
Rack Rack
Optional Disk Chassis
Initial Disk 12U
Chassis Required
SVP
12U
Optional Disk Chassis
Logic/Power Supply Box 12U
1U
• Cache/Shared Memory Package: 2
slots
• Mix Adapter - Includes 16-port FED
and 8-port BED: 2 slots 15U
• Optional Package (i.e. Fibre 12U
Channel, NAS): 2 slots
• Power supply
• Battery
Primary/Secondary racks are identical components.
Sun Confidential: Internal Only rack space = 42U (1U = 1.75-inches)
Total available 19

20. Physical Rack
Sun Confidential: Internal Only 20

21. Third Generation Crossbar Switch
● Non-blocking supercomputer switch architecture for
outstanding performance and scalability
● 32 concurrent cache operations (not including shared
memory)
● 12 GB/sec aggregate MIX PK CHA2 MIX PK CHA3
system bandwidth
● Larger cache, improved
algorithms, faster Hi-Star
processors
CSW0 CSW1
● Ability to aggregate CACHE (SM) CACHE (SM)
controllers, capacity
Sun Confidential: Internal Only 21

22. Feature Overview
Min/Max ports 16/48 FC, 16 FICON, 16 ESCON 8 NAS
Minimum HDD 4 Data + 1 Spare
Maximim HDD 240 HDD
Drive Types 73 GB 15K, 146 GB 10K & 15K, 300 GB 10K
Max External Capacity 16PB
Min/Max Data Cache 4GB/64 GB
Min/Max Shared Memory 2GB/6GB
Rack 19” Industry Standard Rack
ShadowImage Open System and Mainframe Support
TrueCopy Sync/Async Open System and Mainframe Support
Universal Replicator Yes
Copy on Write Snapshot Yes
Data Retention Utility Yes
Business Continuity Manager Yes
HiCommand Device Manager Yes
Volume Migration Yes
Virtual Partition Manager Yes
Server Priority Manager Yes
Universal Volume Manager Yes
FlashCopy V2 Yes
Sun Confidential: Internal Only 22

23. SE 9985 Architecture
Key Differences Options Slot
● 6 slots instead of 16
● Integration of functions
MIX PK CHA2 MIX PK CHA3
● Mixed PK = Mixed FED/BED Combo
Adapter Hi-Star
● Data Cache/Shared Memory/Cache
Switch are now on the same board. CSW0 CSW1
● One Service Processor CACHE (SM) CACHE (SM)
Integrated data cache,
share memory, switch
PCB
Sun Confidential: Internal Only 23

24. SE 9985 I/0
● Six slots in two HW clusters
- Slots 1A & 2F = Mixed adapter
MIX PK CHA2 MIX PK CHA3
- Slots 1C & 2D – Cache/Shared/
Switch
Hi-Star
- Slot 1B & 2E “Options Slot” for
FED, NAS, FICON, ESCON CSW0 CSW1
CACHE (SM) CACHE (SM)
● Mixed Adapter
FED = 8 ports FED = 8 ports
C1 C2
BED = 4 ports BED = 4 ports
BED = 8 ports
● A pair of boards deployed into two HW clusters
- Total of 16 FED and 8 BED ports
Sun Confidential: Internal Only 24

25. SE 9985 I/0 -Board Summary
●FED = 16 or 32 ports MIX PK CHA2 MIX PK CHA3
●Mixed Adapter = 16 FED/8 BED
●NAS Blade = 8 Gigabit Ethernet Hi-Star
●FICON = 16 ports
●ESCON 16 Ports
CSW0 CSW1
CACHE (SM) CACHE (SM)
Sun Confidential: Internal Only 25

26. Power
● Single Phase 30 AMP and 50 AMP available
Worldwide
● 60 Hz: 200V, 208V, 230 V at 30 Amps
● 50 Hz: 200V, 220V, 240 V at 50 Amps
Sun Confidential: Internal Only 26

27. Minimum/ Maximums/RAID/Spares
● MIN/MAX
● 4 GB to 64 GB Data Cache
● 2 GB to 6 GB Shared Memory
● 3D +1 P to 240 HDD
● FC Ports 16-48
● RAID
● RAID5 (3D + 1P)
● RAID5 (7D + 1P) – w/o 100 % data availability guarantee
● RAID1 (2D + 2D)
● RAID6 (6D + 2P)
● Global Spares: MAX = 16 27
Sun Confidential: Internal Only

28. Battery Backup
● If power failure is less than 20 milliseconds, full
operation is maintained (e.g. Disks keep spinning)
● If longer than 20 milliseconds, the operation ceases
and battery maintains data in data cache and
shared memory up to 36 hours.
● Manual de-stage of data to disk required
Sun Confidential: Internal Only 28

29. SE 9985 Warranty
Warranty Period 3yrs
4hr response on-site support
Service Level Telephone Support 24 1st year
X7
Return to factory 2nd year
Return to factory 3rd year
Install Service Included in
Yes
Purchase Price
http://www.sun.com/service/warranty/network.html#diskstorage
Note: Warranty may change March-end 2006, so check this URL
Sun Confidential: Internal Only 29

30. Comparison
Within SE 9900
Family
Sun Confidential: Internal Only 30

31. Visual Comparison
SE 9985 SE 9990
Sun Confidential: Internal Only 31

32. SE 9985 and SE 9990
● Similarities ● Differences
● Similar architecture ● Mixed Adapter
● Same microcode ● # of SVPs
● Runs same software ● Enclosure
● Virtualization ● Power/Batteries
● Partitioning ● Internal Layout
● Replication ● Expandability
● Management, ect
● Same upgrade parts
● HDD, FED
Sun Confidential: Internal Only 32

33. Schedules
● “Phase 2” Completed February 2006
● HDD capacity increased to 240 HDDs with 2nd rack
● Data Cache increased to 64 GB
● Mainframe Support; ESCON/FICON
Sun Confidential: Internal Only 33

34. SE 9985/SE 9990 Comparison
Feature SE 9985 SE 9990
Packaging 19"Rack Multi-Cabinet
Architecture Crossbar Crossbar
Aggregate internal bandwidth 12GB/s 81GB/s
Maximum Raw Capacity (Internal) 72 TB 332 TB
Internal and External 16 PB 32 PB
Max # of HDDS 240 1152
Max # of LUNs 8192 16384
Max data cache 64 GB 256GB
Partitions 8 32
Mirrored cache boards Yes Yes
Max shared memory 6GB 12GB
FC Connectivity Performance 2Gb/s or 4 Gb/s 2Gb/sor 4 Gb/s
Max theoretical host support 6144 24576
Fibre Channel Connectivity 48 192
Multi-protocol support FC/NAS/FICON/ESCON FC/NAS/FICON/ESCON
73 GB 15K, 146GB 10K, 146 15K 73 GB 15K, 146GB 10K,146 GB
HDD Support
300 GB 10K* 300 GB 10K
RAID RAID 1,10,5, 6 RAID 1,10,5, 6
* RAID 6 and RAID 5 (7D+1P) are available with 300 GB at this time on the SE 9990
* RAID 5 (7D + 1P) is available on the SE 9985 but the 100% data availb guarantee is not provided
ility
Sun Confidential: Internal Only 34

35. Summary Comparison: SE 9985 vs
others
Feature SE 9985 SE 99970 SE 9980 SE9990
Aggregate internal
12GB/s 150% greater 25% less 85% less
bandwidth
Maximum Raw Capacity
72 TB 380% greater 48% less 79% less
(Internal)
Max # of HDDS 240 180% less 8 76% less 79% less
Max # of LUNs 8192 50% less 50% less 50% less
Max data cache 64 GB Equal 50 % less 75.00%
Max theoretical host
6144 6144 8192 24576
support
48 Equal 25% less 75% less
Fibre Channel Connectivity
FC/NAS/FICON/ FC/NAS/FICON/ FC/NAS/FICON/ FC/NAS/FICON/
Multi-protocol support ESCON ESCON ESCON ESCON
73 GB 15K, 73 GB 15K,
146GB 10K and No 300 GB, no No 300 GB, no 146GB 10K and
HDD Support
15K, 300 GB 146 GB 15K 146 GB 15K 15K, 300 GB
10K 10K
Sun Confidential: Internal Only 35

36. SE 9985/SE 9970/80 Comparison
Feature SE 9985 SE 99970 SE 9980
Packaging 19"Rack Multiple cabinets Multiple cabinet
Architecture Crossbar Crossbar Crossbar
Aggregate internal bandwidth 12GB/s 7.9GB/s 15.9GB/s
Maximum Raw Capacity (Internal) 72 TB 18.5 TB 149.5 TB
Internal and External 16 PB N/A N/A
Max # of HDDS 120 128 1024
Max # of LUNs 8192 16384 16384
Max data cache 32 (64 later) 64 GB 128 GB
Mirrored cache boards Yes Yes Yes
Max shared memory 6GB 6GB 6GB
FC Connectivity Performance 2Gb/s 1Gb/s 1Gb/s
Max theoretical host support 6144 6144 8192
Fibre Channel Connectivity 48 48 64
Multi-protocol support FC/NAS FC/NAS/ESCON/FICON FC/NAS/ESCON/FICON
73 GB 15K, 146GB 10K, 73 GB 10K, 73 GB 15K, 73 GB 10K, 73 GB
HDD Support
300 GB 10K 146GB 10K 15K, 146GB 10K
RAID RAID 1,10,5, 6 RAID 1,10,5 RAID 1,10,5
Sun Confidential: Internal Only 36

37. SE 9985 Architecture
Key Differences Options Slot
● 6 slots instead of 16
● Integration of functions
MIX PK CHA2 MIX PK CHA3
● Mixed PK = Mixed FED/BED Combo
Adapter Hi-Star
● Data Cache/Shared Memory/Cache
Switch are now on the same board. CSW0 CSW1
● One Service Processor CACHE (SM) CACHE (SM)
Integrated data cache,
share memory, switch
PCB
Sun Confidential: Internal Only 37

38. SE 9990 Architecture
Switches, data cache, shared memory, BED on seperate
PCBs
Sun Confidential: Internal Only 38

39. Four Key
Software
Packages
Sun Confidential: Internal Only 39

40. Example:Universal Volume Manager
● Customer Topology
● SE 9900 and EMC and HP EVA
● Use Universal Volume Manager (UVM) to virtualize
EMC, EVA, SE 3511
● Use ShadowImage or Volume Migrator to copy or
migrate data to virtualized external storage.
● Use HDS storage management software to
administer all storage
● Investments are protected
● Consistent management and tools
Sun Confidential: Internal Only 40

41. Storage Virtualization
Implementation — Universal Volume Manager
HOST
ELUN — LUN that is
HBA Port mapped to a LUN in an
external storage device
Target Port ELUN
Host View
Devices LUN LUN LUN LUN LUN LUN LUN
StorEdge 9990
VDEV Controller
VDEV
LDEV LDEV
Internal LDEV
LDEV
Devices LDEV
LDEV
LDEV
External Port
Mapped Mapped
Target Port
StorEdge 9990 array
External Storage
Array
HDD LUN LUN
Group
Sun Confidential: Internal Only 41

42. Virtual Partitioning Manager
● Purpose
● Dedicate/isolate specific resources to an
application or customer
● Disk, Data Cache, I/O
● Data cache allocated in 4GB increments
● Facilitates dedicating resources to several
applications or internal/external customers in a SE
9985 or SE 9990.
● This is consolidation in context of this software package.
● While flexible enough to change resource over
time, in practice, partitions are not expected to be
changed frequently.
Sun Confidential: Internal Only 42

43. VSPM’s – Basic Concepts
Storage Logical
Partitioning
… A B C D …
Assigned Port Port
Cache Logical
Assigned
Cache … Partitioning
xGB Cache
Partition Partitioned Memory
Cache
Assigned PG …
Parity Group
Cache Logical Partition (CLPR)
• Assign specific cache capacity and assign one or …
more parity groups to use that dedicated cache Parity Group
Storage Logical Partition (SLPR)
• Assign one or more Target Ports to use Physical Configuration
the Cache Logical Partitions
• Administrators and User level authority
maintained in Access Control Lists
Sun Confidential: Internal Only 43

44. Access Control – Four Levels
User Types SLPR0 SLPR1~31
User , Configuration Copy operation User, Configuration management Copy operation
management
SLPR/CLPR management
management
Super SA OK OK OK OK OK OK
General SA No OK OK No OK OK
Super PSA No No No OK (OK)*1 No*3
General PSA No No No No (OK)*2 No*3
SA:Storage Administrator *1: Depend on the specification by Storage Admin
*2: Depend on the specification by Partition Storage Admin
PSA:Partition Storage Administrator *3: Supported at 3rd GA
Super PSA Super PSA Super SA
/General PSA /General PSA /General SA
SLPR1 SLPR2
CLPR CLPR2 CLPR0
SI/
Volume Migration
Sun Confidential: Internal Only 44

45. Universal Replicator (UR)
● Conceptually: TrueCopy plus more capability:
● Disk Journaling
● In case of WAN-link failure, data is written to disk,
and copy suspension and recovery is avoided
● Need to plan for space to accommodate expected
outtage. Threshholds are settable
● Remote site polls primary site SE 9990/85to pull
data off the production site, decreasing cycles
consumed on at production site.
● UR is asynch; combine with TrueCopy Synch for
data currency
● Use only with SE 9985 and SE 9990.
Sun Confidential: Internal Only 45

46. Universal Replicator (UR)
-Universal Replictor is more stable than TrueCopy Asynch (TCA) in addressing link
issues. 26% of issue are link related:HDS/TRC analysis 04Q/2004
- Engineering tests suggest UR help manage expensive, limited, and unreliable links
- TCA could not maintain Remote Copy due to 45 seconds Link down
- UR could provide reliable Remote Copy during 5 minutes Link down
TCA starts host I/O throttle Universal Replicator maintains Remote Copy
to reduce input to cache over cache 30% during link down until JNL full
Response time(ms) Link down Link up
5 minutes
UR guarantees data consistency
during Link down
TC Async TCA Suspend
(Cannot maintain remote copy after Suspend
After Suspend, TCA receives host I/O)
45 sec UR Time
Sun Confidential: Internal Only 46

47. Example: Universal Replicator
● Before
● WAN-link fails; transactions overflow cache
● Suspend copy and initiate re-synch operations
● After (e.g with Universal Replicator)
● WAN-link fails and transactions are written to disk
● WAN-link is restored, copy operation resumes, no copy
suspend, no re-synch operation
● Pull technology polls central to transmit data according
to bandwidth capacity
● Customer can by smaller pipe
● Benefits: Lower WAN costs and reduced
operational disruptions
Sun Confidential: Internal Only 47

48. Tiered Storage Manager Details
● “Volume Migrator” is the underlying engine
● Search capability enables collection of application data to be
grouped and migrated
● Example:
Condition is: RAIDLevel IS RAID5 AND DriveType IS FC-AL AND ArrayGroup IS NOT 2-1
● Groups of volumes can be migrated at the same time
(migration groups)
● A group of volumes can serve as migration targets
(storage tiers)
Sun Confidential: Internal Only 48

49. Example Tiered Storage Manager
● Customer topology
● SE9900 with SE3511 and EMC
● Use Tiered Storage Manager (TSM) to select
several volumes and migrate them to specific
target volumes
● Result: automated movement of data according to
its value
● Reduced DLM costs
Sun Confidential: Internal Only 49

50. Continuity
Example
Sun Confidential: Internal Only 50

51. ShadowImage In-System Replication
Up to 9 Full Duplicate Copies of Any Data Volume
Secondary
Volume
Secondary
Volume
Secondary Secondary
Volume
Non-stop Volume
Production Secondary
Primary Secondary
Volume Volume
Volume
Secondary
Secondary
Volume
Volume
Secondary
Volume
9 Copies Total Open Systems
Sun Confidential: Internal Only 51

52. SE 9900 ShadowImage Operations
● R/W operations continue during creation of S-Vol.
● R/W operations buffered in data cache
● Pair status monitored to ensure completion of copy
operations
● Meta data about changed/new data kept in differential
bitmap in shared memory to support resynch operations
● R/W operations may also be performed on S-Vols. S-
Vols need not be fully populated before other copy
software begin operations on S-Vol. Writes can be held
in cache while other copy operations are executed
against the S-Vol.
● TrueCopy Remote Replication and Universal Replicator
use SI P-vol. Sun Confidential: Internal Only 52

53. Copy On Write
● Copies Changes only
● Create Primary Volume (P-Vol) from the Production DB.
● Create a Secondary Volume (S-Vol) from the P-Vol.
● This is a Copy on Write Snapshot Pair
● The S-Vol is carved out of a pool of allocated physical
storage called a “Pool-Vol”
● Pool-Vol can dynamically grow; thresholds settable
● Cannot snap off of a snap (e.g. No S-Vol to S-Vol)
● A snap can be taken off of a P-Vol
● TrueCopy (TC) and SI can operate off of a P-Vol.
● Use for write oriented applications: 60% W, 40% R is
rough limit.
Sun Confidential: Internal Only 53

54. Sun Confidential: Internal Only 54

55. TrueCopy to Remote DR site.
● S-Vol copied by TC to Remote DR site may be
re-mounted as a P-Vol.
● COW Snaps can be taken off this P-Vol
● Tape would use use a SI S-Vol created from P-Vol
in order to avoid write contention.
● Updates to remote DR site occur realtime,
assuming cache write through
Sun Confidential: Internal Only 55

56. SnapBack Operations
● Snapback
● Can now snapback to any version
● Do not have to delete later versions
Sun Confidential: Internal Only 56

57. Summary
● The SE 9985 and SE 9990 represent the highest
levels of:
● Availability
● Managability
● Scalability
● Connectivity
● Performance
Sun Confidential: Internal Only 57

58. Thank You
Name of Speaker
Title