Scalling through Couchbase at Sky Deutschland (Couchbase Live France 2015)

Scaling through Couchbase at Sky Deutschland
Norbert Gergely | Information Technology | Sky Deutschland | Couchbase Live | Paris, 29 September 2015

2
Agenda
1 The online world of Sky Deutschland
2 NoSQL and Couchbase earning its rightful place
3 Current and future use cases
4 A story of migration
5 Conclusions. Q&A Session

3
It is not any more only about watching TV

4
Drilling down
Sky Go
• Sky exclusive channels (live events)
and online VoD service
• Free for Sky subscribers
• 151 million logins in 2014/2015
• Available to download content and
watch worldwide offline with Sky Go
Extra
Snap
• Online media library
• Offered as a Sky subscription
extension, but also available
without subscription
• Comprehensive license deals with
Hollywood Studios and exclusive
highlights from HBO, Disney
Sky Online
• The easy and flexible way to get Sky
• Sky channels (live events) offered,
VoD service
• Offered on monthly basis

5
OTT (Over-The-Top) platform brings mobility

6
Agenda

7
Need for scalability – Peak Management
• User Login is the critical service requiring scalability and performance.
• User Login inquires operations that should rapidly scale.
• Peaks are constantly high during the live broadcasts => session management.
Extraction of Operations happening on a usual Bundesliga afternoon
Ops per second

8
Need for fast requirement and product changes
Media/Entertainment is a rapidly changing environment
• High rate of changes as new platforms, services and products are required
• Newly added products / features => attracting more customers
• Products have to be easily configurable
• Business rules have to be implemented in a flexible way
These conditions require:
• Technologies that are easily developing the data structures
• Technologies that are easily scalable as new customers are attracted by new offers

9
Need for centralized caching and continuous availability
Centralized caching advantages:
• Lower capital and operating cost by reducing workloads on backend systems
• Legacy systems are usually difficult to scale horizontally => expensive vertical solutions
• Already highlighted Peak Management
• Performant operational boost on reading operations
• Easily be balanced and simple to mantain
• Reusage and linkage between cached data
Business needs continuous availability:
• Today‘s online business cannot conceive anything else as 24x365 availability
• Backend technology has to guarantee „no downtimes“
• On-Demand Scalling on Business needs

10
Why NOSQL?
NoSQL
Flexible
Schema
High
Availability
Performant
Read/Write
Scalability
Faster
Delivery
and Deploy

11
Why Couchbase?
Combined caching and
NoSQL DB Advantages
Easy scalable Easy approachable Large portfolio of services
(Training, Technical Advising)
Very good administration &
monitoring functions
Very good proven performance
(easy and fast CRUD)
Document and
Key-Value Store
Empowering many
connector/plugins
(Elastic, Kafka, Hadoop, Spark)

12
Agenda

13
Session Management (Current)
Session Management is a service constantly asking for scalability (peak management), business rules handling, constant
performance.
Session Data includes:
• Session related features: platform, product, registered device
• User related attributes
Session Data is requested by different services like:
• Login
• Logout
The usage of Couchbase:
• Centralized Caching system
©10FACE/Shutterstock

14
Cross-Device Features (Current)
Cross-Device Features enable the possibility of exchanging user interactive data accross multiple sessions and devices.
Currently avaiable for Sky Online.
Cross-Device Features today include:
• RWL – Recently Watched List: last 50 watched items
• Bookmarks: creation of favorite lists to follow-up
on different devices. Bookmarks contain information,
for example, about the customer progress status
on given asset
• Highly efficient read/write store
©Adobe

15
User Profile (Future)
User Profile Data include:
• KEY Management
• Customer Data Management: centralized customer data store
ingesting different type of customer attributes from different
systems and exposing variably these attributes
The number of services requesting customer data is endless.
Few examples:
• Authentication
• Autorisation
• Display of customer data on web portals
• Highly efficient read/write store
©MillesStudio/Shutterstock

16
Real-Time User Changes Depiction (Future)
Real time replication of different user profile / activity attributes:
• Important user-profile
• Session or cross-device data
The replication is required by different ingestion needs:
• Small data transformations
• Data syncronization
• Analytics
• DCP Stream based pluggable components

17
Architecture simplification

18
Architecture simplification

19
Agenda
Current and future use cases3

20
Not the migration
one expects!

21
A migration of mindset – data model governance
LEGACY Databases
• Best of Breed Methods pretty clearly established
• Exclusive powers in the hand of architects
• Data architecture clearly established before
development, and rarely overwritten
• Data schema is tracked through data modeling tools
NOSQL Databases
• A mostly try-out strategy (each NoSQL with new
kind of strategies)
• Data modeling responsibility split, more in the hand
of developer
• “Perpetuum mobile” of data architecture
• Rarely one can find a data modeling tool, but the
most important is to keep schema flexible

22
A migration of mindset – data model governance
http://blog.infoadvisors.com

23
A migration of mindset – no necessary denormalization
rwl::<product>::<customerId>
{
"assets" : [{
"assetId" : "109643",
"catalog" : "sg",
"insertDate" : "2013-08-04",
"type" : "Film"
}, {
"assetId" : "98654",
"catalog" : "sn",
"insertDate" : "2013-08-05",
"type" : "Episode"}]
}
asset::<assetId>
{
"title" : "Item title 1"
"category" : "Action"
"color" : "OOSF"
"isHD" : "true"
"fsk" : "16"
"imageUrl" : "http://www.skygo..."
"time" : "2014/03/10 14:10"
"type" : "Film"
"contentTargeting" : ""
"startDatePublish" : "2014/03/10 12:15:00"
"endDatePublish" : "2014/03/14 14:30:00"
"webPageDetailsURL" : "http://www.skygo..."
}
bookmark::<product>::<customerId>::<assetId>
{
"duration" : 117623672,
"bookmark" : "00:23:34",
"percentage" : 37
}

24
A migration of mindset – separate write and read stores
https://msdn.microsoft.com/en-us/library/jj591559.aspx

25
Agenda
Current and future use cases3

26
Final thoughts and takeaways
Couchbase (NOSQL) is a wonderful technology that guarantees a lot of goodies:
•High (easy) scalability
•Performance
•Flexibility
•Easy mantainability
But everything functions if conditions are met:
•Developer thinks like an architect and architect thinks like a developer
•One can bypass certain business constraints

Thank you!
Norbert Gergely | Information Technology | Sky Deutschland | norbert-csaba.gergely@sky.de

Scalling through Couchbase at Sky Deutschland (Couchbase Live France 2015)

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (19)

Ähnlich wie Scalling through Couchbase at Sky Deutschland (Couchbase Live France 2015)

Ähnlich wie Scalling through Couchbase at Sky Deutschland (Couchbase Live France 2015) (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Scalling through Couchbase at Sky Deutschland (Couchbase Live France 2015)