Weitere ähnliche Inhalte Ähnlich wie Nrb Mainframe Day z Data and AI - Leif Pedersen (20) Kürzlich hochgeladen (20) Nrb Mainframe Day z Data and AI - Leif Pedersen1. IBM Z / DOC ID / Month XX, 2019 / © 2019 IBM Corporation
IBM Data and AI
Leif Pedersen
Technical Leader,
IBM Data and AI, Europe
Email: Leif.Pedersen@dk.ibm.com
2. Elevate your hybrid cloud with IBM z15
Service Level
Excellence
Industry’s highest level of
business uptime to meet SLA
and regulatory compliance
Data Protection
& Privacy
Industry-first solution to
protect sensitive data
across your multicloud
Mission Critical
Cloud
Integrate seamlessly into
hybrid multicloud,
blockchain and AI
Standardized & Flexible for the Cloud Data Center
Modular, scalable and proven cloud-ready infrastructure
IBM z15 & Z Software/ September 2019 / © 2019 IBM Corporation
3. November 28, 2018
IBM Z is an increasingly desirable target
Today’s technologies have eliminated “mainframe isolation”
Internet
Cloud
Social
Mobile
Big Data
Cognitive
blockchain
Mainframes are increasingly
closer to the Internet and
mobile platforms and this has
made them more vulnerable
to outside threats.
4. Purpose built for mission-critical applications
Processor
• Up to 190 client configurable cores
• 14% Single Thread Performance Improvement
• 25% maximum system capacity growth over z14
• New on-chip acceleration of compression for
faster processing (including batch) and more
efficient storage of data
• More investments in pause-less garbage collection,
30+ new instructions co-designed and exploited by
Java, and vector enhancements for analytics
applications
Memory
• 40 TB Max Per System - RAIM Memory design
To the Data
• Significant scalability improvements – up to 20% more
I/O channels and 50% more logical Coupling Facility
connections over z14
• Faster SSL/TLS handshake performance on z15 with
Crypto Express7S compared to z14 with Crypto
Express6S
IBM z15 & Z Software/ September 2019 / © 2019 IBM Corporation
IBM z15
Machine Type: 8561
Model T01
15.6 miles of wires, 9.2B
transistors and 26.2B
wiring connections
CPC
Drawer
Customer
PUs
Max
Memory
5 190 40 TB
4 145 32 TB
3 108 24 TB
2 71 16 TB
1 34 8 TB
Feature Based Sizing
5. Z15 & Garbage Collection
IBM z15 & Z Software/ September 2019 / © 2019 IBM Corporation
First introduced with z14
Enhanced with z15
– Further minimization of stop-the
world pause times
– Software based fall-back for
older hardware environments
6. IBM Data Privacy Passports – a data centric audit & protection (DCAP) solution
IBM Z
with pervasive
encryption
CurrentState
Three components:
• Trusted Data Object (TDO)
- Key-Encrypted data element plus
metadata (all req instructions on how to
process the TDO, incl. data lifespan)
• Trust Authority
- where policy governing protection &
usage of data is maintained
- serves as main key store
• Passport Controller
– data broker working w/ Trust Authority
to transform raw data into TDOs by
obtaining policy infos & keays
(encrypting using AES 256-bit)
- Gets clear data from source DBMS &
enforces data protection policies at
receiving end (at field level)
• Initial release supports:
- Db2 for z/OS, Db2 LUW, DVM and
Postgres accessed via JDBC
3rd
Parties
Public
Cloud
Private
Cloud
Desired State
Current State: Protected data within Z
Z pervasive encryption
Protect any structured data throughout
its desired Lifecycle:
- Data lifespan expressed in policy
destroying keys at specific date,
rendering the data inert
- Can be extended any time before expiry
7. IBM Z Multi Factor Authentication
>>> very large authentication factor choices for all Z applications <<<
7
8. IBM Z / 2019 / © 2019 IBM Corporation
IBM Z /March 2019 / © 2019 IBM Corporation
• new z/OS V2.4 feature allowing delelopers to
• build , deploy & manage UNMODIFIED Linux on z Docker applications on Z
w/out requiring a separately provisioned and managed Linux server (apps will look
like Docker apps to the developer, not z/OS apps
• Allows to maintain operational control while workload inherits the z/OS QoS
benefits (HA, DR, scalability, workload management, security) and is zIIP eligible
IBM z/OS Container Extensions (zCX)
Integrate Linux application into z/OS
Modernize z/OS workloads by providing flexibility for
development and operations on Z.
Maintain operational control and extend z/OS
Qualities of Service to Linux software.
Make use of existing IT investments by employing Linux
within the Z platform.
IBM z15 & Z Software/ September 2019 / © 2019 IBM Corporation
9. Db2 Temporal & IDAA in-Database Transformation
• Exploit Db2 system temporal and archive transparency to keep history
• Load external data and combine it with operational or historical archived data for analytics.
• For semi-static data, save combined results in accelerator-only tables (AOTs)
• Transformation logic needs to be
expressed in SQL
• Exploits IDAA processing strength
• For easy consumability, SQL complexity
can be defined in VIEWs
• Performance supports complex
transformation on original copy in Db2
or IDAA
IBM Z / © 2019 IBM Corporation
10. ü accelerate mainframe modernization initiatives involving Big Data
ü gain real-time business insights across z/OS and enterprise data
ü eliminate coding of complex z/OS apps via built-in APIs and interfaces
• ensures data is secure and in-place with real-time data virtualization
• supports Hybrid architectures (on-premises, Cloud, Hadoop and MF)
• broad API support via SQL, NoSQL, SOAP, and REST via z/OS Connect EE
• z/OS resident optimization for improved performance and TCO
• abstraction layer for improved productivity and business agility
The industry’s only Z-resident data
virtualization solution!
IBM Data Virtualization Manager for z/OS allows users and
applications read/write access to z/OS and enterprise data sources in
real-time, providing comprehensive information easily accessible by
any application. Creates virtual integrated views of data for any user or
application regardless of platform or location.
Take action now!
IBM Data Virtualization Manager for z/OS
IBM Z / © 2019 IBM Corporation
11. Transaction
al Data
Source
Transaction
al Data
Source
Event Store
Operational
Data Store
Subje
ct
…
…
…
Data Warehouse
Subje
ct
Subje
ct
…
Discovery Zone
(modeled and
unmodeled)
Enterprise
Application
(Point of
Sale)
Enterprise
Application
(Inventory)
Enterprise
Application
(Support)
Feeds
External
Sources
(Public,
Weather)
JDBC, ODBC, OLE DB, CLI,
Virtual or materialized
HDM Source
Client Sources / Applications
QueryFederation
Enterpri$$$$
$$se
Analytic
Application
1
1
2
3
4
5
QueryFederation
Governed Data Lake
DISCOVERYZONE
GUIDEDANALYTICZONE
DEEPDATAZONE
OPERATIONALDATAZONE
Physical instantiation is
guided by architectural
criteria (ex. security, $$SLA) and
customer preferences (ex. skills,
existing infrastructure)
IBM Z / © 2019 IBM Corporation
Hybrid Data Management Reference Architecture -
Data Topology
13. DATA
ANALYTICS ENGINE
Spark Cluster
Db2 Analytics Accelerator z/OS Distributed Platform
Spark Cluster
Spark Cluster
Spark
Anaconda
Optimized Data
Access Layer
MACHINE LEARNING PLATFORM
MACHINE LEARNING SOLUTIONS
IBM Z Operations
Analytics (IZOA)
ML based Anti-Fraud
Solutions
Db2 AI for z/OS
(Db2ZAI)
Watson ML for z/OS
Db2 Analytics Accelerator z/OS Distributed Platform
HTAP
Data Virtualization Manager (DVM)
Merchants
Transactions
Merchants
Transactions
Client Data
User Behavior
News
Twitter
Data Warehouse Engine
Open Data Analytics for z/OS
Loader
IBM Z Analytics Focus: Data Gravity
IBM Cloud Pak for Data
14. IBM Open Data Analytics for z/OS - Architecture
14
Applications
• OLTP
• OLAP
• CICS
• IMS
• WAS
• . . .
Customer, IBM,
or partner
provided
Analysis
routines
DB2 / zOS IMS VSAM SMF
Apache Spark Core
Dataframe RDD Dataframe RDD
Spark
SQL
Spark
Stream
MLIB Graphx
Java Python
Anaconda
. . . . . .
Cython Seaborn
Scipy Matplotlib
Numpy Scikit-learn
Pandas Dask
DB2
Analytics
Accelerator
Twitter
HDFS
DB2 /
LUW
Oracle
JSON
XML
Tera
. . .
External data
sources
Jupyter Kernel
Gateway
z/OS
Optimized Data Layer
The
Ecosystem
UIs and IDEs,
Data visualization
16. Trademarks
IBM z15 & Z Software/ September 2019 / © 2019 IBM Corporation
Notes:
Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they
may have achieved. Actual performance, cost, savings or other results in other operating environments may vary.
IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply.”
All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual
environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.
This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice.
Consult your local IBM business contact for information on the product or services available in your area.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products about this publication
and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products.
Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.
Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.
The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be
incorporated into any contract.
This information provides only general descriptions of the types and portions of workloads that are eligible for execution on Specialty Engines (e.g, zIIPs, zAAPs, and IFLs) ("SEs"). IBM authorizes customers to use
IBM SE only to execute the processing of Eligible Workloads of specific Programs expressly authorized by IBM as specified in the “Authorized Use Table for IBM Machines” provided at
www.ibm.com/systems/support/machine_warranties/machine_code/aut.html (“AUT”). No other workload processing is authorized for execution on an SE. IBM offers SE at a lower price than General
Processors/Central Processors because customers are authorized to use SEs only to process certain types and/or amounts of workloads as specified by IBM in the AUT.
* Registered trademarks of IBM Corporation
The following are trademarks of the International Business Machines Corporation in the United States and/or other countries.
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.
IT Infrastructure Library is a Registered Trade Mark of AXELOS Limited.
ITIL is a Registered Trade Mark of AXELOS Limited.
Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its
subsidiaries in the United States and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.
Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.
UNIX is a registered trademark of The Open Group in the United States and other countries.
VMware, the VMware logo, VMware Cloud Foundation, VMware Cloud Foundation Service, VMware vCenter Server, and VMware vSphere are registered trademarks or trademarks of VMware, Inc. or its subsidiaries
in the United States and/or other jurisdictions.
Other product and service names might be trademarks of IBM or other companies.
CICS*
Cloud Paks
Db2*
IBM*
ibm.com*
IBM Z
IMS
LinuxONE
Power*
Power Systems
z/OS*