In this presentation was used in the MSDN WebCast and we cover some details about the hardware offerings to run SQL Server DataWarehouse, some detail about HP Hardware is shown.
Best Regards,
Ing. Eduardo Castro Martinez
http://ecastrom.blogspot.com
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
HP Microsoft SQL Server Data Management Solutions
1. Ing. Eduardo Castro, PhD
ecastro@grupoasesor.net
http://ecastrom.blogspot.com
http://comunidadwindows.org
http://tiny.cc/comwindows
2.
3. Lower and High costs in deploying and maintaining disparate
streamline application solutions
CAPEX and
OPEX Protect your investment and lower TCO
Reduce Managing silos and layers of technology
complexity Deploying and implementing multiple solutions
Enable Need for dynamic solutions that self provision
Scalable
applications Highly scalable application across all workloads ensuring
business continuity
Align IT Dynamic IT solutions that respond to changing business
Business requirements
Needs Provide business intelligence and decision making capability
4. #1 technology provider and #1 software provider deliver next
generation datacenter and application platform
Integrated roadmap for converged application platforms, comprehensive
virtualization solutions, and integrated management offerings
Optimized performance, reliability, availability, and push button
simplicity for the industry’s top business applications
Automatically provision, manage, and continuously self-tuned across
datacenter and cloud environments
10X increased investment on more than 32,000 HP/Microsoft Frontline
partners, plus HP/Microsoft Global expertise, and comprehensive
services
Leverage existing data center investment with joint solutions that
are architected for today and future cloud environments
5.
6.
7. Take 1 big SAN
Add a little Server
Add a bigger Server
Add more networking
8. DISK DISK
FC A
SQL SERVER
CPU CORES
A
WINDOWS
FC SWITCH
SERVER
HBA B LUN
CACHE
CACHE
A STORAGE A
B CONTROLLER B DISK DISK
FC A
HBA B
B
LUN
CPU Feed Rate SQL Server HBA Port Rate Switch Port Rate SP Port Rate LUN Read Rate Disk Feed Rate
Read Ahead Rate
9. Supporting BI Data Storage Presentation Layer
Systems Systems Systems
Integration Analysis Services
Services ETL Cubes
Presentation Data
Presentation Data
Web Analytic
Data Path
Tools
Reporting
Services
SharePoint
Services
Dedicated Microsoft Office
SAN, Storage SharePoint
Data Warehouse PerformancePoin
Array Data Staging, t
Excel Services
Bulk Loading
Data Warehouse Scope
(dashed)
10. Fast Track Data Parallel Data
Enterprise BDW Appliance
Warehouse RA Warehouse
Appliance for high
Reference
Scalable and reliable Scalable and reliable end MPP Data
architectures offering
SMP platform for data platform for data Warehousing
best price
warehousing on any warehousing on any delivering highest
performance for data
hardware hardware scalability and
warehousing
performance
Ideal for data marts or
Ideal for data marts or
Ideal for large data small to mid-sized Ideal for high scale
small to mid-sized
marts or mid-sized data warehouses with or high performance
enterprise data
EDWs scan-centric data marts and EDWs
warehouses (EDWs)
workloads
Reference DW Appliance
Integrated Appliance
Architectures (Fully integrated
Software only (Software and
(Software and Software and
Hardware)
Hardware) Hardware)
Scale-Out DW with
Scale-Up DW Scale-Up DW Scale-Up DW
MPP
10s of terabytes <5 terabytes 5–80 terabytes 10s - 100s of TB
Software Assurance; Software Assurance;
3-Year Support Plus Mission Critical
Premier Mission Premier Mission
24 Advantage Program
Critical Support Critical Support
11. Effort to Build Very High Very Low Modera Modera Modera Modera Very Low
te te te te
Capacity Variable 5 TB 14 TB 20 TB 40 TB 40 TB 500 TB
Concurrency Variable Light Light Medium Mediu High Very High
m
Query Variable Medium Mediu Medium Mediu High Very High
Complexity m m
12.
13. Complete Optimized Agile
• Hardware + Software + • Specifically for small to • Deploy in hours/days, not in
Services medium data warehouse months
• Pre-tuned, pre workload • Easy to use through built-in
configured, pre-installed. • Designed for dedicated tools to load and
Turn on and go! performance, energy manage your data warehouse
• Single point of contact for efficiency, and value by HP • Designed for up to 5TB data
support and Microsoft’s best warehouses
engineers • Fast Track 3.0
• Security and reliability built compliant, license path to
in Fast-Track
14. Small/Departmen Spoke in EDW Hub and
tal Data Spoke Architecture
Warehouse
15.
16. What’s in the Box: optimized
software
Appliance Quick Deployment Wizard
• Name the appliance
• Join a domain
• Specify appliance administrators
DDL and Data Load Wizard
• Create staging and production
databases
• Load data
• Check data fragmentation
24. Software:
• SQL Server 2008 R2
Enterprise
• Windows Server 2008 R2
Configuration guidelines:
• Physical table structures
• Indexes
• Compression
• SQL Server settings
• Windows Server settings
• Loading
Hardware:
• Tight specifications for
servers, storage
and networking
• ‘Per core’ building block
25.
26.
27.
28.
29.
30.
31. − Tier-1 Enterprise Data Warehouse Appliance
Offering
− High scalability from tens to hundreds of terabytes
− High performance through the MPP system
− Flexibility and Choice
− Choice of deployment options through distributed
architecture
− Most Comprehensive Solution
− Complete data warehouse solution spanning
desktop, enterprise data warehouse, and data marts
34. CONTROL NODE
Client connections always go through the
SQL
control node
Contains no persistent user data
SQL
SQL Parallel Data Warehouse advantages:
SQL
oProcesses SQL requests
SQL
oPrepares execution plan
oOrchestrates distributed execution
SQL
Local SQL Server processes final query
SQL
plan and aggregates results
Provided by DataDirect
SQL
oOpen database connectivity
SQL
(ODBC), object linking and embedding
database (OLE DB), Java Database
SQL
Connectivity (JDBC), and ActiveX®
Data Objects (ADO.net) client drivers
SQL
oWire protocol (SeQuel link)
oDrivers are available for 32 bits and
64 bits
35. LANDING ZONE
SQL
SQL
Provides high-capacity storage for data files
SQL
from ETL processes
SQL
Is available as a sandbox for other
SQL
applications and scripts that run on the
internal networkSQL
Provides SQL Server Integration Services
SQL
SQL
SQL
Landin Compu
Data
Source g Zone te
Loader
SQL
Files Nodes
SQL
DWLoader or
SQL Server
Integration
Services
36. BACKUP NODE
SQL
SQL
Provides Integrated Backup Solution
SQL
Integrates with SQL party backup option
3rd
Orderable in different sizes
SQL
SQL
SQL
SQL
SQL
SQL
SQL
37. SQL
SQL
• Data Rack Servers 10
active + 1 passive SQL
SQL
• HP ProLiant DL360 G7
compute nodes SQL
SQL
• InfiniBand, FC and
Ethernet
switching, 42U rack SQL
SQL
• Expansion Grow from
1–4 data SQL
racks, storage
options, test/dev
system SQL
• Storage 10x HP SQL
StorageWorks MSA
P2000 G3
• Consists of COMPUTE
NODES and STORAGE
NODES
38. COMPUTE NODE
• Data Rack Servers 10
active + 1 passive SQL
• HP ProLiant DL360 G7
compute nodes
• InfiniBand, FC and
Ethernet
switching, 42U rack
Each MPP node is a highly tuned symmetric
• Expansion Grow from multi-processing (SMP) node with standard
1–4 data interfaces
racks, storage
options, test/dev Provides dedicated
system
hardware, database, and storage
• Storage 10x HP Runs SQL Server
StorageWorks MSA
P2000 G3 Spare Node provides failover in case of
node failure
Drives are configured as RAID 1
43. Parallel database Supports user groups
copy technology with very different
enables rapid data service-level
movement and agreements (SLAs):
consistency between • Performance
EDW and data marts • Capacity
• Loading
• Concurrency
Create SQL Server 2008 R2, Fast Track Data Warehouse,
and SQL Server Analysis Services Data Marts
A distributed architecture gives you the flexibility to add or change diverse
workloads
or user groups while maintaining data consistency across the enterprise
44.
45. Contact your HP/Microsoft Sales Account
Manager or Frontline Partner to learn more
New Business Value services for
Next generation application
platform
Performance and scalability
optimization for SQL Server and
Exchange Server
HP P4000 Virtual SAN Appliance
tune for Hyper-V
Microsoft Core Infrastructure
Virtualization
Client and Virtualization Services
Data Management Solutions
around OLTP, DW, BI
Implement Hyper-V, Exchange and SQL Server
Upgrades or Migration of
Integrate Insight Control for MS System Center Messaging and Unified
Fast Track and Data Warehouse solutions Communications solutions
SQL Server upgrade and consolidation Private Cloud for Microsoft
Exchange Server upgrade
and migration
The HP Business Data Warehouse offers a solution for the customers discussed on the previous slide. It’s a solution that is:Complete – the appliance comes with all the hardware and software you need, pre-configured for a data warehouse workload based on expertise from HP and Microsoft, and includes support services from a single source.Optimized – Experts from Microsoft and HP have designed and tuned the appliance specifically for data warehouse workloads, so you can be sure it will meet your data warehouse requirements with efficient power utilization and built in security and reliability features.Agile – Because the BDW is a single hardware appliance, you can just plug it in, switch it on, and within a very short period you’ll have a working data warehouse. The easy to use wizards included in the appliance make it easy to configure and load, enabling your business to start taking advantage of your data warehouse sooner than with a “self-build” solution. And while the BDW is optimized for relatively low data volumes and concurrency, if your business grows significantly you can transfer your BDW software licenses to a Fast Track solution.
There are two key scenarios for using the HP Business Data Warehouse appliance:A small business or departmental data warehouse for a small group of concurrent users who need to store and analyse up to 5 TB of data.A spoke in an Enterprise Data Warehouse “hub and spoke” architecture, where the BDW is used to deliver a subset of the corporate data warehouse to a specific set of users.
The hardware for the BDW is provided by HP, and consist of a server (which can be provided in a 4U rack-mount unit configuration or as a standalone “pedestal” server), and storage hardware. The specific hardware components and configuration have been carefully chosen to provide the optimal solution for a 5TB data warehouse with light concurrency requirements.
To help you get started, the appliance includes two HP wizard applications – one to complete the initial deployment of the appliance and integrate it into your Windows domain infrastructure, and another to help you create your data warehouse schema and load data to the data warehouse.
The appliance is a complete solution with hardware, software, and service that is needed in a mission critical data warehouse. The database is highly scalable and can handle workloads of hundreds of terabytes while maintaining performance. The EDW appliance also works with your existing data warehouses and data marts so you do not have to rip and replace your current investments. Also, you can use familiar tools such as Microsoft Excel to analyze the data in your data warehouse.
Customers will purchase at least two racks for a complete EDW Appliance system. [Click]The control rack will have control nodes, management nodes, the landing zone, and backup nodes. The data rack will have servers that are compute nodes and storage nodes. Each of these racks and node types will be discussed in more detail.
Customers will purchase at least two racks for a complete EDW Appliance system. [Click]The control rack will have control nodes, management nodes, the landing zone, and backup nodes. The data rack will have servers that are compute nodes and storage nodes. Each of these racks and node types will be discussed in more detail.
Customers will purchase at least two racks for a complete EDW Appliance system. [Click]The control rack will have control nodes, management nodes, the landing zone, and backup nodes. The data rack will have servers that are compute nodes and storage nodes. Each of these racks and node types will be discussed in more detail.
Customers will purchase at least two racks for a complete EDW Appliance system. [Click]The control rack will have control nodes, management nodes, the landing zone, and backup nodes. The data rack will have servers that are compute nodes and storage nodes. Each of these racks and node types will be discussed in more detail.
Customers will purchase at least two racks for a complete EDW Appliance system. [Click]The control rack will have control nodes, management nodes, the landing zone, and backup nodes. The data rack will have servers that are compute nodes and storage nodes. Each of these racks and node types will be discussed in more detail.
Customers will purchase at least two racks for a complete EDW Appliance system. [Click]The control rack will have control nodes, management nodes, the landing zone, and backup nodes. The data rack will have servers that are compute nodes and storage nodes. Each of these racks and node types will be discussed in more detail.
Customers will purchase at least two racks for a complete EDW Appliance system. [Click]The control rack will have control nodes, management nodes, the landing zone, and backup nodes. The data rack will have servers that are compute nodes and storage nodes. Each of these racks and node types will be discussed in more detail.
The Administrative Console is an Internet Information Services (IIS) web application for SQL Server Parallel Data Warehouse that displays the appliance’s state information. Users connect to the Administrative Console through Microsoft Internet Explorer.
The Configuration Manager is an appliance administration tool that SQL Server Parallel Data Warehouse system administrators use to perform appliance-level operations and to change appliance-level settings. For example, use the Configuration Manager to reset passwords, set the time zone, change IP addresses, configure SSL certificates, enable remote access through the firewall, start or stop the appliance, and set Instant File Initialization.
A distributed data warehouse solution, such as that supported by SQL Server Parallel Data Warehouse, comprises a centralized EDW and a set of loosely coupled data marts. For many years, this has been the preferred approach for enterprise-wide data warehousing, and numerous studies since 2003 confirm that hub and spoke is the most popular data warehouse architecture among DW professionals. Traditionally, implementing a hub and spoke architecture has been challenging due to practical limitations of the database engine and network resources.[Click to display types of spoke]With SQL Server Parallel Data Warehouse, you can create a diverse range of types of spoke, from SQL Server Parallel Data Warehouse MPP appliances for user groups that have extreme scalability requirements, Fast Track data warehouse implementations, SQL Server 2008 Enterprise data warehouses, and even SQL Server 2008 Analysis Services OLAP databases.[Click to display parallel database copy point]However, the SQL Server Parallel Data Warehouse parallel database copy technology enables rapid data integration between spokes and the SQL Server Parallel Data Warehouse hub, making it easier to build hub and spoke solutions that integrate your diverse data marts and the enterprise data warehouse.[Click to display multiple-user SLA point]The SQL Server Parallel Data Warehouse hub and spoke architecture enables you to support user groups with very different SLAs; supports hot, warm, and cold data; supports different requirements for loading data loading, and more.