With Oracle's announcement at the last Openworld at OBIEE will now be available in the Oracle Cloud as "Reporting as a Service", what does this new product promise, and what other options are there for running OBIEE in the cloud - either Oracle's, or from platform and infrastructure-as-a-service providers such as Amazon AWS, Rackspace and VMWare. In this session, we'll look at various approaches to running OBIEE in the cloud, look at licensing and product features, and see how supporting infrastructure such as data warehouse databases, ETL tools and identity management can also be deployed in the cloud to support OBIEE.
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Deploying OBIEE in the Cloud - Options and Deployment Scenarios (BIWA Summit 2014)
1. Deploying OBIEE in the Cloud:
Options and Deployment Scenarios
Mark Rittman, CTO, Rittman Mead
BIWA Summit 2014, San Francisco, Jan 2014
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
2. About the Speaker
• Mark Rittman, Co-Founder of Rittman Mead
• Oracle ACE Director, specialising in Oracle BI&DW
• 14 Years Experience with Oracle Technology
• Regular columnist for Oracle Magazine
• Author of two Oracle Press Oracle BI books
• Oracle Business Intelligence Developers Guide
• Oracle Exalytics Revealed
• Writer for Rittman Mead Blog :
http://www.rittmanmead.com/blog
• Email : mark.rittman@rittmanmead.com
• Twitter : @markrittman
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
3. About Rittman Mead
• Oracle BI and DW Gold partner
• Winner of five UKOUG Partner of the Year awards in 2013 - including BI
• World leading specialist partner for technical excellence,
solutions delivery and innovation in Oracle BI
• Approximately 80 consultants worldwide
• All expert in Oracle BI and DW
• Offices in US (Atlanta), Europe, Australia and India
• Skills in broad range of supporting Oracle tools:
‣OBIEE, OBIA
‣ODIEE
‣Essbase, Oracle OLAP
‣GoldenGate
‣Endeca
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
4. Deploying OBIEE in the Cloud
• Many OBIEE customers are considering deploying their BI
infrastructure in the “cloud”
• “Push” and “Pull” factors in-play
‣Perceived benefits in reducing amount of on-premise servers,
software installs, upfront-license costs
‣May also be prompted by migration of rest of IT infrastructure
to the cloud
‣To enable business agility - deploy the system now
• But there are lots of ways you can deploy OBIEE in the cloud
• This presentation will outline the main options and scenarios,
as of January 2014
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
5. Enabling Business Agility - Rapid Development in the Cloud
• Example cloud use of OBIEE - accelerating the BI development process
‣Combines agile development (“ExtremeBI”) with OBIEE deployed into Amazon AWS
‣Cloud element allows development to start now
‣Options for repatriating on-premise afterwards
• Based on Amazon AWS (EC2, S3) and Oracle BI
• More details at
http://www.rittmanmead.com/cloudbi/
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
6. Deploying OBIEE in the Cloud
Part 1 : Oracle’s (Proposed) OBIEE11g Cloud Offering
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
7. Oracle Cloud Business Intelligence
• As announced at Oracle Openworld 2013
• As of Jan’ 2014, in “preview” - web page only
• Expected (by me) in second half of 2014
• Part of the wider PaaS (platform-as-a-service)
offering including database, Java, documents etc
• Aimed at a very specific set of use-cases initially
‣Adding BI and analytics to cloud-based apps
‣Departmental sandbox-type analysis
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
8. Self-Service, Consumer-Style Experience
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
9. Initial Announced Functionality (Sep’ 2014)
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
10. Oracle Cloud Business Intelligence - How it Works
• Runs in Oracle’s public cloud environment - multi-tenant?
‣No upfront license cost
Oracle BI-as-a-Service
‣Pay monthly (?)
• Uses new thin-client RPD modelling tool
(thick-client BI Administration tool still supported?)
• Only reports against a single Oracle database
schema (Oracle Cloud Schema-as-a-Service)
• “Standard” OBIEE - but will possibly preview new
Admin access
functionality before on-premise versions
over HTTP
‣Proposed data-mashup feature
• Patched automatically by Oracle
‣Customer able to be max one version behind?
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Oracle Schema-as-a-service
Database (single source)
Cloud
On-Premise
11. Thin-Client Data Modeler (Subject to Change)
• Announced at Oracle Openworld 2013 - but could change as product evolves
• Cloud mandates a tool strategy that supports both Cloud and On-Premise development
‣Thin-Client Modeler to be delivered with BI Cloud Service v1
‣Web-based tool designed for the business user
• Masks complexity in creating a full model
using thick-client Admin Tool
• But does not initially support multi-source,
RPD federation etc
‣Future goal is to deliver thin-client tool with
comparable functionality to replace
the legacy Admin Tool
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
12. Deploying OBIEE in the Cloud
Part 2 : Deploying “Full” OBIEE into the Public Cloud
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
13. Deploying “Full” OBIEE into the Public Cloud
• Oracle’s Cloud Business Intelligence offering is consumer-style BI-as-a-service
• Simple provisioning, setup, maintenance - but with significant limitations (at present)
‣No ability to access non-Oracle cloud DB data
‣No ability to federate data sources
‣No access to Essbase, BI Publisher, Agents, Maps etc
• So why not deploy OBIEE yourself directly into the public cloud?
‣Amazon AWS
‣Rackspace etc
‣VMWare Hybrid Cloud
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
14. Cloud Definitions: Public vs. Private Cloud
• Public Cloud: Shared infrastructure provided over the internet, to the public as a service
‣Organizations rent compute resource on this shared platform
‣Key vendors include Amazon (AWS), Rackspace, Microsoft (Azure) - and Oracle
‣Base offering is Infrastructure-as-a-Service (Iaas) - compute, storage, network
‣Also typically offer Platform-as-a-Service (PaaS) - e.g. Amazon RDS, Hosted JEE
• Private Cloud: Provisioning and Efficiency Benefits of cloud, but on private infrastructure
‣Similar principles: shared resource that can be provisioned on-demand
‣But internal to organization: improved security, potentially better value
‣Key vendors: VMWare, OpenStack
‣But elasicitity of service limited by hardware within the private cloud
• Hybrid Cloud: Combination of public + private cloud
‣Majority of workload run on private cloud, but with “burst out” to public cloud
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
15. Key Cloud Vendors: Amazon AWS (+ Rackspace etc)
• Dominant vendor in public cloud infrastructure
‣Amazon EC2: Virtual servers in the cloud
‣Amazon S3: Storage in the cloud
• Usually the cheapest for compute/storage etc
• Some free options available
• Pay by the hour for various instance sizes
• Also offers IaaS and PaaS services such as
‣Amazon RDS (Oracle DB, mySQL etc)
‣Amazon Elastic MapReduce etc
• Other competitors include Rackspace, Google,
Microsoft
‣But AWS 5 x larger than next 14 competitors
(combined)
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
16. Typical Single-Node Amazon EC2 Deployment
• OBIEE + RCU Database install deployed on a single EC2 instance
‣Various instance size options available based on RAM, vCPU etc
‣OBIEE licensing: 1vCPU = 1 proc
(http://www.oracle.com/us/corporate/
pricing/cloud-licensing-070579.pdf)
• DW Database on Amazon RDS instance
OBIEE FMW Install
‣Managed Database instance (backups etc)
+ RCU Oracle SE1
(Amazon EC2)
‣BYOL: 1vCPU = 1 proc DB EE
• Run BI Administrator either on-premise, or
on another EC2 (Windows) instance
DW Database Install
(Amazon RDS)
Instance Examples:
!
m3.xlarge (4 vCPU, 15GB RAM) = $328/m
m2.2xlarge (4 vCPU, 34GB RAM) = $598/m
!
Oracle BI EE licensing: 1vCPU = 1 proc
Oracle DB SE1 licensing: >4vCPU = 1 proc
Amazon RDS Examples (BYOL):
!
XL DB Instance: 4vCPU, 15GB RAM = $467/m
Hi-Mem 4XL DB Instance: 8vCPU, 68GB RAM
= $1613/m
!
Oracle DB EE licensing: 1vCPU = 1 proc
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
17. Amazon EC2 HA Configuration #1: (Stretch) WLS Cluster
• Multiple EC2 instances organised into
a WLS cluster
‣Instances can be placed into
different EC2 availability
zones (stretch cluster)
OBIEE FMW Install
(FMW Node 1)
‣But watch latency…
• Uses Elastic Load Balancer
to route incoming requests
• Amazon RDS multi-availability
RCU Database Install
zones for automatic replication
(Amazon EC2)
to another availability zone
‣RCU DB cannot be on RDS
as no support for SYS
as SYSADMIN (req. for RCU)
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Amazon Elastic Load Balancer
WebLogic Domain
OBIEE FMW Install
(FMW Node 2)
OBIEE FMW Install
(FMW Node n)
DW Database Install
(Amazon RDS)
!
!
RDS Multi-Availability Zones
Oracle Data Guard
18. Amazon EC2 HA Configuration #2: Replicated Single-Nodes
• Multiple EC2 instances, but configured
as WLS single-node
‣Bi-directional webcat replication keeps
separate catalogs in-sync
OBIEE FMW Install
‣Could use EBS storage to
+ RCU Oracle SE1
(FMW Node 1)
create shared FMW_HOME
as per HA EDG topology
‣Potentially place each
instance in separate EC2
availability zone
• Each node has own RCU Oracle DB SE1 DB
• Single Amazon RDS Oracle DB EE
instance for DW database, using
multi-availability zones
Amazon Elastic Load Balancer
WebLogic Domain
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
WebLogic Domain
OBIEE FMW Install
+ RCU Oracle SE1
(FMW Node 2)
WebLogic Domain
OBIEE FMW Install
+ RCU Oracle SE1
(FMW Node n)
Bi-directional Webcat Replication
DW Database Install
(Amazon RDS)
E : info@rittmanmead.com
W : www.rittmanmead.com
!
!
RDS Multi-Availability Zones
Oracle Data Guard
19. Pros and Cons of Amazon EC2 for OBIEE
• Pros:
‣Cheapest mass-market cloud vendor: effectively sets base price
‣Extremely well-developed IaaS and PaaS offering - load
balancing, HA, monitoring, databases etc
‣Easy availability of skillets, well-known platform
• Cons:
‣Not “native” to OBIEE, Oracle - aimed more at general web apps
‣Some ambiguity around licensing - multi-availability zones etc
‣Not fully-tested AWS HA with OBIEE HA - could be some
incompatibilities etc around clustering, failover etc
‣RCU DB hard to host in RDS - versions, SYSDBA access etc
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
20. Key Cloud Vendors: Oracle
• Announced at Oracle Openworld 2013: Infrastructure-as-a-Service (IaaS) offerings
‣Complements the existing PaaS services; aimed more at Amazon AWS
• From later in 2014, ability to rent compute, storage, documents, network etc from
Oracle, similar to Amazon AWS
‣For now though, focus is on service - DBaaS, Java etc - and Apps (HCM etc)
Database
Services
Java Services
Developer
Services
Common Infrastructure Services
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Social Network
Document
Services
Reporting
Service
BPM Service
21. Future Oracle Cloud Deployment?
• OBIEE in the Cloud - initially “sandbox” single source, in future - more features/sources?
• Hyperion EPM apps - Planning, FR
• DBaaS - full database in the cloud,
supports ETL, OLAP etc?
• Storage / Documents
• Identity Management?
• Enterprise Manager?
• But - what will it cost vs. Amazon AWS?
‣How scriptable / extensible will it be?
‣Limitations on product functionality?
‣But Oracle can be creative on licensing
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
22. Deploying OBIEE in the Cloud
Part 3 : Multi-tenant OBIEE in the Cloud
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
23. Multi-Tenant OBIEE in the Cloud
• Typically used by application providers to provide tenanted access to OBIEE dashboards
• Goes beyond application roles to support SaaS deployments
• New multi-tenant-specific application roles
‣BIGlobalAdministrator - full systems administrator
‣BITenantAdministrator - catalog admin privileges
‣Tenant Users - linked to tenant ID through
FMW identity store (init blocks not supported)
• Still uses single RPD, catalog
• Restricted set of features
‣No FMW control for Tenant admins
‣No Essbase
‣No BI Administration tool for Tenant Admins
‣No Scorecards, RTD, BI Publisher, BI Mobile
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
24. Enabling Multi-Tenancy in OBIEE 11g
• Multi-tenancy isn’t enabled by default, needs to be enabled and configured
• Supported from OBIEE 11.1.1.7+
• Probably only really meant for Oracle’s own (cloud) use
• Provides three main capabilities vs.
home-grown multi-tenancy
‣Tenant-specific catalog permission admins
‣TenantGUIDs to prevent GUID clashes across tenants
‣Prompts, user lists etc scoped to just that tenant
• To enable multi-tenancy:
‣Follow the steps at http://docs.oracle.com/cd/
E28280_01/bi.1111/e10541/
configtenant.htm#BABCGBBC
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
25. Deploying OBIEE in the Cloud
Part 3 : Cloud Databases for OBIEE
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
26. Supporting Databases for OBIEE
• OBIEE 11g requires one or more RDBMSs for data sources, metadata etc
‣DW database (or DB sources) for reporting data
‣RCU database for supporting schemas
(BIPLATFORM, MDS etc)
• Likelihood is that Cloud OBIEE data sources will
be a mixture of on-premise, cloud (and app?)
• If OBIEE is deployed in the cloud, chances are
that it’s because its DW database is also there
BI Admin Tool
RPD Access
• But what are the options if you want to deploy
supporting databases into the cloud?
BI Administration
Tool
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
On-Premise
Data Sources
Cloud-based
data sources
Cloud
On-Premise
27. Amazon Relational Database Service
• Database PaaS offering from Amazon AWS, provides
a range of databases as a managed service
‣Oracle SE1/SE/EE, mySQL, MS SQL Server, Postgres
• Includes license (Oracle SE1/SE) or BYOL (Oracle EE)
• Managed service, provides backups etc
• Multi-availability zones for resilience/high-availability
‣Automatically replicates DB to other region
• Mostly “full” Oracle, but no SYS as SYSDBA access
‣So no use for the RCU database
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
28. Postgres on Amazon AWS
• Postgres is a mature RDBMS product, free core features, similar capability to Oracle 7/8
• Enterprise DB offer paid support and their own admin tools (Postgres Plus)
• Rather than license + install on-premise, can also be hosted on Amazon AWS
• Offered as an hourly-charged SaaS database,
includes support + tools
• Accessed by (unsupported) Postgres ODBC drivers
• Typically costs around the same price as Oracle SE1
‣$6.48/hour, or approx $56k for each server
(includes hosting though)
‣But need to factor in AWS storage + bandwidth costs
‣Likely annual costs : $120k/year
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
29. Left-Field Alternative: Amazon Redshift hosted on Amazon AWS
• Another database-as-a-service offering from Oracle AWS
• Based on ParAccel, cut-down version and native to Amazon Cloud
‣Column-store, analysis-optimised
• Can connect to OBIEE via PostgreSQL drivers,
but like Postgres Plus, not Oracle supported
• Similar cost to Postgres Plus on AWS, but includes
AWS storage and bandwidth costs
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
30. For the Future : Hadoop / Impala (Big Data Sources)
• New in OBIEE 11.1.1.7 : Hadoop Connectivity through Hive
• Hive is a query environment over Hadoop/MapReduce to support SQL-like queries
• Hive server accepts HiveQL queries via HiveODBC or HiveJDBC, automatically
creates MapReduce jobs against data previously loaded into the Hive HDFS tables
• Approach used by ODI and OBIEE to gain access to Hadoop data
• Allows Hadoop data to be accessed just like any other data source
• But … it’s quite slow, for ad-hoc BI queries
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
31. Addressing Hadoop / Hive Latency : Cloudera Impala
• Hive is slow - because it’s meant to be used for batch-mode queries
• Many companies / projects are trying to improve Hive - one of which is Cloudera
• Cloudera Impala is an open-source but
commercially-sponsored in-memory MPP platform
• Replaces Hive and MapReduce in the Hadoop stack
• Can we use this, instead of Hive, to access Hadoop?
• It will need to work with OBIEE
• Warning - it won’t be a supported data source (yet…)
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
32. How Impala Works
• A replacement for Hive, but uses Hive concepts and
data dictionary (metastore)
‣but not officially supported with OBIEE (yet)
• MPP (Massively Parallel Processing) query engine
that runs within Hadoop
‣Uses same file formats, security,
resource management as Hadoop
• Processes queries in-memory
• Accesses standard HDFS file data
• Option to use Apache AVRO, RCFile,
LZO or Parquet (column-store)
• Designed for interactive, real-time
SQL-like access to Hadoop
BI Server
Presentation Svr
Cloudera Impala
ODBC Driver
Impala
Impala
Hadoop
Hadoop
HDFS etc
Hadoop
HDFS etc
Impala
Hadoop
HDFS etc
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
Impala
E : info@rittmanmead.com
W : www.rittmanmead.com
HDFS etc
Impala
Hadoop
HDFS etc
Multi-Node
Hadoop Cluster
33. Deploying OBIEE in the Cloud
Part 5 : ETL in the Cloud
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
34. Why is ETL Important (& Why Would it Also Move to Cloud)?
• OBIEE needs a data source to report on, typically a data warehouse
• Initially these are on-premise, but over time they may migrate to the cloud
• Once all sources and targets are in the cloud
- where does the ETL live?
‣Doesn’t make sense for it to be the
only on-premise component
‣Can we also run this in the cloud?
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
35. ETL Tools Provided by Cloud Vendors
• Cloud infrastructure vendors (Amazon, Google, Oracle etc) typically provide tools to
import data into the cloud, and keep it refreshed
• These are good options if only this single target, and typically a single source
‣Usually free
‣Optimized for that platform
• But beyond that - you need an ETL tool
‣Complex transformations
‣Different metadata stores
‣Orchestrated loading
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
36. Cloud ETL Requirements (DIaaS)
• DIaaS (Data Integration as a service) should be a service
‣Self-provisioned, no software install or configuration
‣Charged by the day/hour
‣Multi-tenant
‣A range of DB and cloud application adapters
‣All thin-client, web-based
‣Easy scale-out, HA, compatibility with Amazon EC2 etc
• Could just do the same as on-premise ETL, but “cloud expectations
are different” - consumer, service, simple UI
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
37. Oracle’s Cloud Data Integration Offerings
• ODI 11g/12c could theoretically run in the cloud
• But its ELT approach means there’s no (usual) mid-tier ETL transform element
‣Agents typically are installed on sources and targets
‣Transformation happens on target
• SaaS application adapters typically
provided through Jdeveloper and SOA Suite
‣Functional, but not “consumer-simple”
• Forthcoming OBIA cloud adapters assume
on-premise install of OBIA/OBIEE,
with Oracle cloud apps as sources
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
38. Cloud ETL Alternative #1 : Informatica Cloud
• A version of Informatica PowerCenter that runs in the cloud (sort of)
‣Metadata and application layer components run in the cloud (as a multi-tenant app)
‣“Secure Agent” runtime runs on-premise
- cut-down version of PowerCenter
‣Data transformation etc therefore happens on-premise
• Some interaction between on-premise and cloud
‣PowerCenter mapplets can be copied to the cloud
• Obvious cloud option for Informatica customers
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
39. Cloud ETL Alternative #2 : SnapLogic Integration Cloud
• “Cloud native” data integration platform
• Focuses on “data paths” and application
integration, with data streamed point-to-point
• Transformations are done through “Snaplexes”
‣Java JVMs similar to ODI agents
‣Can run in-cloud or on-premise
‣Uses Amazon S3 storage for temp files etc
‣Elastic scale-out when running in cloud
• Weakness is the “last mile” of DW data
‣Lacks KMs and other templates for SCDs etc
‣Not as strong as an ELT tool for complex
database transformations
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
40. Conclusions
• There are lots of reasons customers are considering deploying OBIEE in the cloud
‣All their other applications are moving to the cloud
‣Reduce cost and complexity around infrastructure
‣Enable business agility with services available now
• Several options for cloud OBIEE deployment
‣Oracle’s upcoming Cloud Business Intelligence offering
‣Deploying “full” OBIEE into a public cloud
‣Access OBIEE as a service using multi-tenancy
• Need to also consider database, IDM, ETL elements
• And also licensing, security etc
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
41. Thank You for Attending!
• Thank you for attending this presentation, and more information can be found at http://
www.rittmanmead.com
• Contact us at info@rittmanmead.com or mark.rittman@rittmanmead.com
• Look out for our book, “Oracle Business Intelligence Developers Guide” out now!
• Follow-us on Twitter (@rittmanmead) or Facebook (facebook.com/rittmanmead)
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
42. Deploying OBIEE in the Cloud:
Options and Deployment Scenarios
Mark Rittman, CTO, Rittman Mead
BIWA Summit 2014, San Francisco, Jan 2014
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com