Perth APAC Groundbreakers tour - The Autonomous Database

Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Connor McDonald

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
3

4

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
Stuff
youtube bit.ly/youtube-connor
blog bit.ly/blog-connor
twitter bit.ly/twitter-connor
400+ posts mainly on database & development
250 technical videos, new uploads every week
rants and raves on tech and the world :-)

Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
etc...
facebook bit.ly/facebook-connor
linkedin bit.ly/linkedin-connor
instagram bit.ly/instagram-connor
slideshare bit.ly/slideshare-connor

https://asktom.oracle.com

8https://asktom.oracle.com/officehours

150 hours of free access (so far)
9

18c - The Autonomous Database
Connor McDonald
Developer Advocate

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 11
18c - The Autonomous Database

"18c - the autonomous database"
12

"Whoa....hold on!"
13

12c, 13, 14, 15, 16, 17, 18c
14
?
10g, 11g,

18c = 12.2.0.2
15
MOS 2285040.1

1 2 18 19 20

No “FIRST” and “SECOND” releases anymore!

Fewer One-Off Patches!

3 Number Format
Year.Update.Revision

18.1.0
target - quarterly

18c
Oracle Database
18.1.0
Production
18.2.0
First Update
18.2.1
First Revision

Version number reflects patch level!

A Release Update or Revision is only a patch,
not a database upgrade!

Patch: Oracle 18.2.1 ⇢ Oracle 18.6.0
opatch
Upgrade: Oracle 18.2.1 ⇢ Oracle 19.1.0
dbupgrade and DBUA

"revision" versus "update"
25

18.1.0
18.2.0
First
Update
18.1.1
First
Revision
security,
regression,
no functionality changes
no optimizer changes
security,
regression,
functional changes
optimizer changes

"18c - the autonomous database"
27

autonomous is a cloud offering
28

Autonomous
Database
= + +

so what is the big deal ?
30

trip down memory lane #1
31

who remembers these numbers ?
32

121
249
505
33

ORA-1631: max # extents 505 reached in table SCOTT.EMP
121 = 2k block size
249 = 4k block size

who thinks about extents anymore?
35

7.3 = unlimited extents
36
semi-automatic
uet$, fet$

8.1 = locally managed tablespaces
37
fully automatic
bitmap extents

38

create table SALES (
...
...
...
)
freelists 4
freelist groups 1

ASSM
40

automatic segment space management
41

automation =
42
"we know the implementation, and
it is being performed by the software
based on our rules"

automation ... towards autonomy
43

44

who remembers these parameters ?
45

ROLLBACK_SEGMENTS = (r0,r1,r2,r3,r4,r5,r6)
TRANSACTIONS_PER_ROLLBACK_SEGMENT = 20
CLEANUP_ROLLBACK_ENTRIES = 10
SYSTEM non-SYSTEM

who thinks about undo anymore?
47

9.0 = automatic undo
48
undo_tablespace =

but it's more than automation

SQL> select count(*) from dba_rollback_segs;
COUNT(*)
----------
????

segment count growth / reduction ...

... decided by the database

autonomy =
53
"we do not know the implementation,
we do not set the rules,
decisions by the software"

Oracle has been doing this for a while :-)

Oracle Database 10g and below
• Automatic Storage Management (ASM)
• Automatic Memory Management
• Automatic DB Diagnostic Monitor (ADDM)
• Automatic Workload Repository (AWR)
• Automatic Undo tablespaces
• Automatic Segment Space Management
• Automatic Statistics Gathering
• Automatic Standby Management (Broker)
• Automatic Query Rewrite
Oracle Database 11g, 12c
• Automatic SQL Tuning
• Automatic Workload Replay
• Automatic Capture of SQL Monitor
• Automatic Data Optimization
• Automatic Storage Indexes
• Automatic Columnar Cache
• Automatic Diagnostic Framework
• Automatic Refresh of Database Cloning
• Autonomous Health Framework

well ... sort of

databases ... are hard
transactional,
instantaneous response
standard reports,
fast response
end of day/week/month batch,
longer but capped window
ad hoc query,
arbitrary criteria/duration

all at the same time
transactional,
instantaneous response
standard reports,
fast response
end of day/week/month batch,
longer but capped window
ad hoc query,
arbitrary criteria/duration

so we started with "easy" :-)

data warehousing
usage commonality
flexible response times

Oracle Autonomous Database
Enterprise
OLTP
Data
Warehousing
Q1 2018 CY 2018
Data
Warehousing

autonomous objectives

1) easy
storage
quotas
indexing
partitioning
parallelism
compression
availability
etc
etc
load data
run queries

2) fast or faster
Exadata infrastructure
Enterprise edition

3) elastic

3) truly elastic
scale CPU & storage up, no outage
scale CPU down to save $

4) fully managed
backup / recovery
patching
upgrades
HA (99.95)

Oracle Exadata Cloud Service
Oracle Database Cloud Service
Express Cloud Service
Data Warehouse Services
(EDWs, DW, departmental marts and sandboxes)
Autonomous Data Warehouse Cloud
Service Console
Built-in Access Tools
SQL Worksheet Oracle ML
Service Management
DW Database
SQL Developer
Developer Tools
Data Integration
Services
Oracle Data Integration
Cloud Service
3rd Party DI on
Oracle Cloud Compute
3rd Party DI
on-premises

walkthrough

"5 easy steps"

creating your database
73
name
region
CPUs
storage

you're done!
74
admin user password

"demo"
75

connecting to your database
85

emphasis on security
86
SSL only
wallet

single download
87
service console

"demo"
88

SQL Developer
95
native support

Location of the zip file
Wallet password
Database service name

other tools
97
standard connectivty

C:temp>unzip -l credential.zip
Archive: credential.zip
Length Date Time Name
--------- ---------- ----- ----
0 04/06/2018 08:37
7045 04/06/2018 08:22 cwallet.sso
0 04/06/2018 08:37 cwallet.sso.lck
7000 04/06/2018 08:22 ewallet.p12
0 04/06/2018 08:37 ewallet.p12.lck
3182 04/06/2018 08:22 keystore.jks
132 11/06/2018 11:04 sqlnet.ora
334 04/06/2018 08:22 tnsnames.ora
3797 04/06/2018 08:22 truststore.jks
--------- -------
21490 9 files

sqlnet.ora
WALLET_LOCATION = (SOURCE = (METHOD = file)
(METHOD_DATA = (DIRECTORY="...")))
SSL_SERVER_DN_MATCH=yes
tnsnames.ora
DW = (description=
(address=(protocol=tcps)(port=1522)(host=...))
(connect_data=(service_name=...))
(security=(ssl_server_cert_dn="CN=..."))
)

database services
100
predefined

No of concurrent queries Max idle time CPU shares
HIGH 3 5 mins 4
MEDIUM 20 5 mins 2
LOW 32 1 hour 1
MY_DBNAME_
MY_DBNAME_
MY_DBNAME_

users for your database
103

SQL> create user MY_DATA identified by MY_PASSWORD;
SQL> grant DWROLE to MY_DATA;
You're done!

other users as per normal
105

loading your database
107

ADW
Object
Storage
SQL*Net

DBMS_CLOUD
109
focus on "1) easy"

external tables are .... "fun"
110

CREATE TABLE emp_ext (
EMPNO NUMBER(4),
ENAME VARCHAR2(10),
JOB VARCHAR2(9),
MGR NUMBER(4),
HIREDATE DATE,
SAL NUMBER(7,2),
COMM NUMBER(7,2),
DEPTNO NUMBER(2)
)
ORGANIZATION EXTERNAL
(
TYPE ORACLE_LOADER
DEFAULT DIRECTORY NFS_DIR
ACCESS PARAMETERS
...
( RECORDS DELIMITED BY NEWLINE
DNFS_ENABLE
DNFS_READBUFFERS 10
FIELDS TERMINATED BY ','
MISSING FIELD VALUES ARE NULL
(
empno,
ename,
job,
mgr,
hiredate CHAR(21) DATE_FORMAT MASK "DD-MON-YYYY HH24:MI:SS",
sal,
comm,
deptno
) ) LOCATION ('EMP.dat')
)
PARALLEL 1
REJECT LIMIT UNLIMITED;
SQL> select * from emp_ext;
ORA-12801: error signaled in parallel query server P002
ORA-29913: error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
ORA-06512: at "SYS.ORACLE_LOADER", line 19

loading from object store
112

1) credentials
113

begin
dbms_cloud.create_credential(
credential_name => 'OBJ_STORE_CRED',
username => 'connor',
password => 'password'
);
end;
/

2) load/transform to table
115

begin
dbms_cloud.copy_data(
table_name=>'CHANNELS',
credential_name=>'OBJ_STORE_CRED',
file_uri_list=>
'https://objectstorage..../DEMO_DATA/chan_v3.dat',
format=>
json_object('ignoremissingcolumns' value 'true',
'removequotes' value 'true')
);
end;

3) do the usual :-)
117

SQL> select table_name,
2 status,
3 rows_loaded,
4 logfile_table,
5 badfile_table
6 from user_load_operations;
TABLE_NAME STATUS ROWS_LOADED LOGFILE_TABLE BADFILE_TABLE
------------ ------- ------------ ------------- ---------------
CHANNELS FAILED COPY$1_LOG COPY$1_BAD
CHANNELS COMPLETED 5 COPY$2_LOG COPY$2_BAD

data pump option
119

begin
dbms_cloud.create_credential(
credential_name => 'OBJ_STORE_CRED',
username => 'connor',
password => 'password'
);
end;
/
impdp sh/sh@salesdb_low
directory=data_pump_dir
credential=OBJ_STORE_CRED
dumpfile=https://objectstorage.../dump/sh.dmp

querying your database
122

SQL> select *
2 from MY_TABLE
3 ...
"Well...duh"

but you can do more
124

ADWC
Object
Storage
SQL*Net

query before you load
126

external table on object store
127
"Whoa there!"

begin
dbms_cloud.create_external_table(
table_name =>'CHANNELS_EXT',
credential_name =>'OBJ_STORE_CRED',
file_uri_list => 'https://...chan_v3.dat',
format =>
json_object('ignoremissingcolumns' value 'true',
'removequotes' value 'true'),
column_list => 'CHANNEL_ID NUMBER,
CHANNEL_DESC VARCHAR2(20),
CHANNEL_CLASS VARCHAR2(20),
CHANNEL_CLASS_ID NUMBER,
CHANNEL_TOTAL VARCHAR2(13),
CHANNEL_TOTAL_ID NUMBER'
);
end;
select count(*) from channels_ext;

recap
129
creation/connection
users
loaded
queried

We're done !!!
130

"Fast, unlimited data access is the
crack cocaine for data scientists"
- James Morle
131

"3) elasticity"
132

CPU increase ... anytime, no outage
133

"Yeah...I know what that means"

You can scale to zero
142
service console
REST API

143
load yesterday's data
cpu = 2

144
unleash the dogs :-)
cpu = 8

all other times = zero CPU cost
145

"4) fully managed"
146

OS access
148
nope

SYSDBA access
149
nope

patching
150
automated
online* (AppCont)
gold image

encryption
151
mandatory

init.ora
152
all automatic
NLS etc

tablespaces
153
nope

indexes
154
nope*

materialized views
155
nope

constraints
156
nope ... "yes"

compression
157
nope (HCC)

partitioning
158
nope*

sidebar: Maybe you're doing it wrong :-)
159

statistics
160
advanced direct mode
automatic or explicit

recall: 12c, direct load statistics
161

SQL> insert /*+ APPEND */ into MY_EMPTY_TABLE
2 select ...
10000 rows inserted.
SQL> select num_rows
2 from user_tables
3 where table_name = '...';
NUM_ROWS
----------
10000
SQL> insert /*+ APPEND */ into ...
10000 rows inserted.
SQL> select num_rows
2 from user_tables
NUM_ROWS
----------
20000

histograms too!
163

SQL> select column_name,
2 low_value,
3 high_value,
4 sample_size,
5 histogram
6 from user_tab_col_statistics
COLUMN_NAME LOW_VALUE HIGH_VALUE SAMPLE_SIZE HISTOGRAM
------------ ---------- --------------- ----------- -----------
NUM0 C102 C302 20000 HYBRID
NUM1 C102 C111 20000 FREQUENCY
TXT1 58585831 58585839393939 20000 HYBRID

caching
165
result_cache
everything!

hints
166
can be enabled
ignored by default

backup / recovery
167
daily incremental
weekly full

backup / recovery
168
point-in-time nomination
(process is automatic)
60 days

graph, text, spatial
169
coming later

monitoring
170
real time SQL monitoring
service console
(and REST)

from "easy" to "not so easy"
175

Oracle Autonomous Database
Enterprise
OLTP
Data
Warehousing
Q1 2018 CY 2018
Data
Warehousing

just a normal database?
178

based on 19c
179
critical features

which brings us to ...
180

• Will my job go away?
• Will my job change?
• Will I lose control?

% of presentations that
have a pie graph
% of presentations that
need a pie graph

72%
http://www.computerworld.com/article/2486278/it-management/how-to-balance-maintenance-and-it-innovation.html

184
Value Scale
Cool stuff
Maintenance

think back to automatic undo ...
185

... did you lose your job ?
186
or just get more databases :-)

it is about business success
187

Data Modeling
Architecture,
Design

End-to-End Service
Level Management
Full stack availability

Data Security
Data classification,
Data life-cycle management

Application Tuning
SQL tuning,
Connection management

192
Value Scale
Cool stuff
Maintenance

wrap up

the appeal of "set and forget"
194

the appeal of bypassing this!
195
Request for Provisioning of Resources

2TB for 3500 compute hours
196
https://cloud.oracle.com/try-autonomous-database

Enjoy the day!
youtube bit.ly/youtube-connor
blog bit.ly/blog-connor
twitter bit.ly/twitter-connor

Perth APAC Groundbreakers tour - The Autonomous Database

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie Perth APAC Groundbreakers tour - The Autonomous Database

Ähnlich wie Perth APAC Groundbreakers tour - The Autonomous Database (20)

Mehr von Connor McDonald

Mehr von Connor McDonald (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Perth APAC Groundbreakers tour - The Autonomous Database

Hinweis der Redaktion