Cloud Native Application Development-build fast, low TCO, scalable & agile software on Oracle Cloud (DOAG2020)

Cloud Native
Application
Development
- build fast, cheap,
scalable and agile
software
on Oracle Cloud
Infrastructure
DOAG 2020| Oracle Cloud Native Application Development
DOAG 2020, November 2020
Lucas Jellema, CTO & Architect AMIS | Conclusion

Lucas Jellema
CTO for AMIS | Conclusion
Cloud Solution Architect
lucas.jellema@amis.nl | technology.amis.nl | @lucasjellema | lucas-jellema

A traditional application
WebApp
Database
(RDBMS?)JVM
Java EE
Operating System
Hardware
3rd party libraries
& frameworks
Monolith,
Microservice,
Module
Platform & Language
runtime features
(transaction
management, HTTP
request handling, state
management & in
memory caching, IAM,
…
Custom Code

IaaS
PaaS
Cloud Native Application
Event
Hub
Vault
Function
IAM
Container
Engine
Web
App
Function
Cache
Mail
Monitor
ScalingAlert &
Notify
• Managed
• Quick Provision &
Decommission
• Distributed
• Automated
• Pay per use/TCO
• Vendor takes runtime
responsibility
• Enterprise grade platform
accessible to startups
• Rapid Innovation
• Security & Availability
• Scale
Logging
Data
Integration

Characteristics of Cloud Native Applications
• Modern – born in the cloud (era)
• Emphasis on interaction (and decoupling) points:
• Between custom components: APIs, Events / message format
• From custom to PaaS Services: Service APIs, Formats and Protocols
• Less emphasis on [and insulation from?] implementation of PaaS (platform) services
• Key are industry standard APIs that are implemented by many different services
• Custom code in small, simple units
• No explicit Infrastructure (serverless, software defined) & managed Platform components
• Stateless and Dynamically Scalable (Elastic) – expand and contract
• Pay per Use
• Automation – no hands on ACC and Production (speed, repeatability, dynamic adjustment)
• Infrastructure/Platform as Code & Application CI/CD [pipelines]

Some (PaaS) Cloud Capabilities
for Cloud Native development
• Functions (serverless application code)
• API Gateway
• Events / Queued Messages
• Data Persistence
• Cache
• Security
• Network access
• Web Application Firewall (DDOS & more)
• Authentication & Authorization
• Credentials & Key Management, En|Decrypt
• Automation – CI/CD & DevOps Pipelines
• Monitoring
• Metrics, notification, logging
• Auditing
• Cost Control
API
Gateway
Function
Event Topic
Data
Persistence Cache
Monitoring
Security(WAF,Network,Authorization
CI/CD & DevOps Pipelines

Introducing Oracle Cloud Infrastructure

Oracle Cloud Gen2
• First generation is now called Classic Cloud
• Mainly On Premises software, running in
Oracle’s data centers – with some (small)
degree of operational management (mainly
provisioning and patching)
• Not Cloud Native
• Gen2
• (largely) Designed from the ground up for the
cloud
• Applying lessons learned – from classic cloud as
well as AWS and Azure
• Some focused acquisitions (Dyn, Corente,
Palerra, Wercker, DataScience.com)
DOAG 2020| Oracle Cloud Native Application
Development

Oracle Cloud
Infrastructure
• Generation 2 Cloud
• Main themes:
• Competitive Pricing
• Secure by Design
• Open
• Enterprise (Technology)
• Trials – 30 days, $300 credits
• An always-free tier
• With Autonomous Database and
Autonomous Data Warehouse
DOAG 2020| Oracle Cloud Native Application
Development

Oracle Cloud Infrastructure Regions – current and planned

Functions
API
Gate
way
Object
Storage
NoSQL
Database
Streaming
OCI Services for Cloud Native Application Development

Functions
API
Gate
way
Object
Storage
NoSQL
Database
Streaming
Digital
Assistant
Visual
Builder

OKE – Managed Kubernetes
Functions
API
Gate
way
Object
Storage
NoSQL
Database
Streaming
Container
Container
Compute
OCIR
Digital
Assistant
Visual
Builder

Functions
API
Gate
way
Object
Storage
NoSQL
Database
Streaming
Container
Container
Compute
OCIR
Digital
Assistant
Visual
Builder
Compartments
API/Service
Tagging
Search
Resource
Manager
Auditing
VaultCloud Guard
Identity & Access
Management
DDoS
Protection
WAF
Visual Builder
Studio
CI/CD &
DevOps

Functions
API
Gate
way
Object
Storage
NoSQL
Database
Streaming
Health
Check
Monitoring Alarms
Notifi-
cations
Container
Container
Logging
Compute
OCIR
Notifications
AlarmingTelemetry/
Monitoring
Healthcheck
Container
Container
Streaming
Object
Storage
API/Service
Search
Resource
Manager
Events
Digital
Assistant
Visual
Builder
Container Engine
For Kubernetes
Container
Registry
Functions
Auditing
Logging
API Gateway
Vault
DDoS
Protection
WAF
Cloud Guard CompartmentsTagging
Virtual
Machine
Vault
Identity & Access
Management
Visual Builder
Studio
CI/CD &
DevOps

Traditional Application:
Tweets to NoSQL, Streaming & Email
Streaming
NoSQL
Database
#doag2020

Demonstration of Cloud Native Application on OCI:
Streaming
NoSQL
Database
#doag2020

Cloud Native design
Tweets to NoSQL,
Streaming & Email
Healthcheck
Streaming
Events
Object
Storage
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Write JSON
document with
Tweets
Retrieve X
minutes worth
of tweets
Store JSON
file with all
tweets in time
period Trigger
function with
event
Create
Tweet
Records
in NoSQL
Send
Tweet
Report as
email
Invoke Tweet
Aggregator every
X minutes
Cloud Event
for new
JSON file
Publish
each
Tweet to
Stream
Expose
function to
external callers
Publish to
Notification
Topic
#doag2020
Get Twitter
credentials in
secure way
from vault
Custom code in multiple small
units that each build | test |
deploy | scale | fail
Asynchronous interactions
Managed Platform (and
underlying Infra) with built in
logging | monitoring | Ops
Configured through Infra as
Code
Auditing
Monitoring
Logging Container
Registry
Vault

Decoupling
Streaming
Events
Object
Storage
Notification
Topic
API
Gate
way
NoSQL
Database
Function
Function
#doag2020
• Encapsulation (of
implementation)
• Run time availability
independence
• Independent release /
reconfigure
• Independence of scaling
• Volume Load
Throttling/Absorption
• Security Boundary
• Failure isolation
Auditing
Monitoring
Logging Container
Registry
Vault

Platform Preparation – Infrastructure as Code
using Resource Manager & Terraform plan
Object
Storage
Object
Storage
Bucket
Compartments
Vault
Secure Vault
with Keys for
Twitter
credentials
Compartment
for Application
resources
Configuration
of Logging
Service for
Functions
Virtual Cloud
Network
Internet
Gateway
Route Table
Security
Lists
Virtual Cloud Network
with private and public
subnet and access from
and to public internet
API
Gate
way
Skeleton API
Gateway for
deploying API
routing rules to
Groups
Dynamic
Groups for API
Gateway and
for Functions
Streaming
Stream for
publishing
messages to
NoSQL Databas
Table for
persisting record
Resource
Manager
Auditing
Logging
Container
Registry

Serverless Function
& Object Storage
Object
Storage
Function
Write JSON
document with
Tweets
Store JSON
file with all
tweets in time
period
#doag2020
Vault
Get Twitter
credentials in
secure way
from vault
Retrieve X
minutes worth
of tweets
Container
Image Registry
Central Logging
Service
Function
Tweet
Summarizer
Auditing
Logging
Container
Registry

Introducing Serverless Functions
• The Container Native Serverless Framwork
• Project Fn is an open source FaaS platform
that you can run anywhere -- any cloud or
on-premise.
• It implements serverless Functions through
Docker containers
• Out of the box support for many runtimes
•
• also support for custom Docker
Container (white box)
• Project Fn is the foundation for Serverless
Functions on OCI

Fn Functions – request handling
Function
Implementation
(Node, Java, Go,
Python, custom
Docker, …)
FDK
Function as a Service framework
HTTP Request
With method, headers, query
parameters, url path, body
input – derived from body
ctx – raw HTTP request components

Function tweet-summarizer in application lab1

Function tweet-summarizer – source code in GitHub
Sources: bit.ly/cloud-native-latam2020

Configuration Settings for Function tweet-summarizer
result in environment variables accessible within the function
Vault

Application Design
Object
Storage
Function
Write JSON
document with
Tweets
Store JSON
file with all
tweets in time
period
#doag2020
Get Twitter
credentials in
secure way
from vault
Retrieve X
minutes worth
of tweets
Function
Tweet
Summarizer
Container
Image Registry
Central Logging
Service
Logging
Container
Registry
Vault

Functions vs Containers vs VMs
• Serverless
• No IaaS DevOpS
• Stepless Pay per use
• Free-Tier
• Auto-Scale
• Automatic Fail Over
• Integration with OCI
• Triggered by OCI
• Call OCI services
• Leverage OCI for
Audit, Log, Monitor
• Restricted, simple
programming model
• Short running
Functions Containers on OKE
• Serverless runtime
• Initial IaaS Setup
• Pay per VM,
scale per VM
• Auto-Scale by K8S
• Some auto Fail Over
• Little integration with OCI
• Kubernetes for Ops
• Flexible programming
model – any container goes
VMs
• Fully Servered
• DIY IaaS Op
• Pay per VM, scale per
VM, cheap at large scale
• Manual Scaling
• Manual Fail Over
• Little integration with OCI
• Flexible programming
model
Virtual
Machine
Functions Container Engine
For Kubernetes

Object Storage – Bucket for twitter reports

Serverless Function
& Object Storage
Object
Storage
Function
Tweet
Summarizer
Write JSON
document with
Tweets
Store JSON
file with all
tweets in time
period
#doag2020
Get Twitter
credentials in
secure way
from vault
Retrieve X
minutes worth
of tweets
Logging
Container
Registry
Vault

Function execution is triggered by
API Gateway
Notifications
Events
Healthcheck
Resource
Manager
Service
Connector
Alarming
Functions

Function execution is triggered by
API Gateway
Notifications
Events
Healthcheck
Resource
Manager
Service
Connector
Alarming
Functions
Ops automation
Application
App
Ops
Ops
Ops
Ops
Ops
Ops
App
App

Public and Managed
Access to Function Tweet Summarizer
Object
Storage
API
Gate
way
Function
Expose
function to
external callers
#doag2020
Function
Tweet
Summarizer
Container
Image Registry
Central Logging
Service
Logging
Container
Registry
Vault

API Gateway
• Handle HTTP calls:
• Authorize
• Route
• Map
• Transform
• Observer
• Monitor
• Audit
• Log
API
Gateway
Oracle Cloud Infrastructure
Any 3rd party
HTTP endpoint
Function
Stock
Any HTTP
Endpoint
on OCI
OIC
OKE
VM
…
Any
Service
Invoker
Expose private endpoints publicly
Stable (public) endpoints
Routing (verb & wildcard based)
Parameter and Header mapping
Request Policies
Rate limiting (per client & general)
CORS (for direct web client access)
Metrics Monitoring & Logging
Authentication & Validation
Transform headers & parameters
in requests & headers in responses
AuditingMonitoringLogging
API Gateway

API Gateway Configuration for public access to Function

Leverage OCI PaaS Services and Facilities from Functions
API Gateway
Notifications
Functions
Autonomous
Database
Streaming
Object
Storage
Vault
NoSQL
Database
Autonomous
JSON
Email Delivery
AuditingMonitoringLogging
synchronous
asynchronous

Trigger
Object
Storage
API
Gate
way
Function
#doag2020
Vault
Function
Tweet
Summarizer
Expose
function to
external callers

[how to] Trigger Email Notification
Object
Storage
API
Gate
way
Function
#doag2020
Vault
Function
Tweet
Summarizer
Expose
function to
external callers
Send
Tweet
Report as
email
?

Produce CloudEvent,
Publish Notification & Send Mail
Events
Object
Storage
Notifications
API
Gate
way
Function
#doag2020
Send
Tweet
Report as
email
Cloud Event for
new JSON file
on Object
Storage
Publish to
Notification
Topic
Vault

EVENTS and NOTIFICATIONS SERVICES

Web
Hook
Slack
Pager
Duty
Email
OCI
Resource
Cloud
Event
Notifi
catio
ns
Notification
Topic
EventRules
Functions
Streaming
Functi
ons
Strea
ming
Ev
ent Ev
ent
Ev
ent
Ev
ent
Events identified and turned to
Notification Events to be Published and Routed
Subscriptions
Cloud
Event
AlarmingFunctions

Configure Event Rule Notification triplet
OCI
Resour
ce
Cloud
Event
EventRules
Notifi
catio
ns
Notification
Topic

Send email upon Notification

Email Subscription is Pending until confirmed

When confirmed, the subscription is active

When the Tweet Summarizer is invoked…
Events
Object
Storage
Notification
API
Gate
way
Function
Oracle Groundbreakers Tour 2020 LATAM | Oracle Cloud Native Application Development
Vault

… the email informs of the new file
Events
Object
Storage
Notification
API
Gate
way
Function
Oracle Groundbreakers Tour 2020 LATAM | Oracle Cloud Native Application Development
Vault

Produce CloudEvent &
Publish Notification
Events
Object
Storage
Notifications
API
Gate
way
Function
Send
Tweet
Report as
email
Cloud Event
for new
JSON file
Publish to
Notification
Topic
#doag2020
Vault

Trigger Function &
Store NoSQL Records
Events
Object
Storage
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Create
Tweet
Records
in NoSQL
Trigger
function with
event
#doag2020
Vault
Retrieve
Tweet
Report

Introducing NoSQL Database Cloud Service
• Launched in February 2020 – a fully managed cloud service
• Based on Oracle NoSQL Database
• Which itself is based on Berkeley DB as storage engine
• Schemaless JSON and SQL enabled on relational data
• ACID, consistent, relational, structured, joins
• Partial JSON Updates
• Server-side updates to JSON documents
• Time-To-Live – auto-expire on records
• Built-in Data Redundancy
• Multi-region architecture
• read-anywhere/write-anywhere in “WAN” cluster
• REST APIs, OCI CLI and SDKs in Java, Python, Node and Go
• NoSQL Database Cloud Simulator for local development and testing
• Note: August 13th 2020 – launch of “Autonomous JSON Database

NoSQL Database Table TWEETS_TABLE

Tweet Records in TWEETS_TABLE

Trigger Function &
Store NoSQL Records
Events
Object
Storage
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Create
Tweet
Records
in NoSQLTrigger
function with
event
#doag2020
Vault
Retrieve
Tweet
Report

Stream records
Streaming
Events
Object
Storage
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Publish
each
Tweet to
Stream
#doag2020
Vault

OCI Streaming Service
• Kafka Like – Event Queue
• Support for partitions and consumer groups
• Events are Published and Consumed through
REST API calls
• Java SDK available
• No Push to Consumer!
• Consumer has to poll
Oracle Cloud Infrastructure
Listener
OCI
Streaming
Stream
Publisher
On prem
Listener
Listener
3rd Party
Cloud

Tweet Messages Published by Function
consumed from the Stream

Monitoring | Health Checks
• Verify through the eyes of an external client
if endpoints are available
and respond quick and well
• Periodic or Adhoc call to an endpoint
• HTTP(S) or Ping
• Specify Headers
• Specify Interval (check frequency)
• From selected Vantage Points
• 3rd party clouds, geographic locations around the world
• Health Check results can be inspected through the Monitor in the Console
• Use health checks for live function smoke tests
Functions
Healthcheck
API Gateway

[tricks for] Scheduling Functions
• OCI does not currently have a way to schedule jobs
• Health Checks are scheduled, periodic HTTP(S) requests
• Once every 30 | 60 seconds or 5 | 10 | 15 minutes
• Monitoring Alarms are evaluated and repeated on the
indicated specific interval
Functions
Healthcheck
API Gateway
Configuration
Parameters
CRON expression to run
once every hour | day |
Sunday | …
When triggered evaluate
CRON expression and
decide whether to run
CRON expression passed as
header or parameter in
healthcheck configuration
Notifications
Alarming
Monitoring
Define an Alarm that will be
triggered; set repeat interval at
desired function execution interval

Drawing OCI Solution Designs on draw.io
Download draw.io graphics from https://docs.cloud.oracle.com/en-
us/iaas/Content/General/Reference/graphicsfordiagrams.htm… , unzip and upload as library to draw.io

Summary
Healthcheck
StreamingEvents
Object
Storage
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Compartments
Email Delivery
#doag2020 Auditing
Monitoring
Logging Container
Registry
Vault
DDoS
Protection
WAF
Cloud Guard
Identity & Access
Management
Cloud Native:
Pay per use/TCO

Pay per use
Healthcheck
StreamingEvents
Object Storage
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Compartments
Email Delivery
Auditing
Monitoring
Logging Container Registry
Vault
Cloud Guard
Identity & Access
Management

Summary
Healthcheck
StreamingEvents
Object
Storage
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Compartments
Email Delivery
#doag2020 Auditing
Monitoring
Logging Container
Registry
Vault
DDoS
Protection
WAF
Cloud Guard
Identity & Access
Management
Cloud Native:
Platform Services
Managed => Serverless
Quick Provision & Decommission
Distributed
Automated
Pay per use/TCO
Vendor takes runtime responsibility
Enterprise grade platform for all
Security & Availability
Scale
Ops facilities (monitor, log, audit,
events, failover)
Rapid Innovation (new services, new
features, new pricing)

Thank you
for your attention
I hope
this was
useful
lucas.jellema@amis.nl | technology.amis.nl | @lucasjellema | lucas-jellema

Cloud Native Application Development-build fast, low TCO, scalable & agile software on Oracle Cloud (DOAG2020)

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie Cloud Native Application Development-build fast, low TCO, scalable & agile software on Oracle Cloud (DOAG2020)

Ähnlich wie Cloud Native Application Development-build fast, low TCO, scalable & agile software on Oracle Cloud (DOAG2020) (20)

Mehr von Lucas Jellema

Mehr von Lucas Jellema (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Cloud Native Application Development-build fast, low TCO, scalable & agile software on Oracle Cloud (DOAG2020)

Hinweis der Redaktion