SlideShare ist ein Scribd-Unternehmen logo
1 von 17
DECADE Architecture Discussion

          Lijiang Chen
           2011/3/11
What are possible options?
   -- In one ISP point of view
Inside Data Center
Inside Data Center
• Pros
  – Easy coordinate, load balance, de-duplication….

• Cons
  – Far from end-host
  – Long latency?
  – Middle-mile bottleneck
  – what’s the distinguish from Data Center
    applications?
Distributed in Edge
Distributed in Edge
• Pros
  – Near end-host, law latency, load balance …


• Cons
  – Difficult data de-duplication between servers
    (how to efficiently utilize resources?)
Argument:
We should put DECADE in edge
Motivation Example


  Every Server will keep a
  copy for a period of time?!




                                8
Problem
• Coupled DECADE access with data storage
  – CDN’s cache mechanism based on utilization
  – DECADE’s “cache” has constraint
     • Need to guarantee a basic (or temporary) available
       time (1 hour, 1 day, 1 month?)


• Solution:
  – Decouple DECADE access and data management
Decoupled DECADE access and
             data management
                     Status Server
DECADE Server = Login Handler
            or = Login Handler + Data Server


                                Status Handlers           Data Servers

                   a                           La Index
                                       La




                   b                           Lb Index
                                       Lb
                   c
                                       Lc      Lc Index
Get a Data
                        Status Server



       Status Handlers                  Data Servers
    Login
a     1           La Index
                              2
             La
      4
                             3




      Status Handlers
Remote Get without Data Transfer
                               Status Server



          Status Handlers                      Data Servers

     a                    La Index
                 La

             2        3



     b   1                Lb Index

         4       Lb
Remote Get with Data Transfer
                              Status Server



        Status Handlers                       Data Servers

   a                     La Index
                La

            2        3              4
                                        5

   b    1                Lb Index

        6       Lb
Backup
Architecture
Content Provider

                                       vCDN Provider
                   Service Provider
                                                                                ISP 2
                   Web Server



                                                         AS (multiple layers)

                                           ISP 1




        User                                                                            DECADE
                                         DECADE        DECADE        DECADE

                   Data
                   Control Msg                                                                   15
Discussion 1
Content Provider

                                          vCDN Provider
                   Service Provider
                                                                                   ISP 2
                                      x
                   Web Server


                                      ?          x
                                                            AS (multiple layers)

                                              ISP 1




        User                                                                               DECADE
                                            DECADE        DECADE        DECADE

                   Data
                   Control Msg                                                                      16
Discussion 2
Content Provider

                                       vCDN Provider
                   Service Provider
                                                                                ISP 2
                   Web Server



                                                         AS (multiple layers)

                                           ISP 1




        User                                                                            DECADE
                                         DECADE        DECADE        DECADE
                                      How do DECADE servers interact with each other?
                   Data
                   Control Msg                                                                   17

Weitere ähnliche Inhalte

Was ist angesagt?

Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...
Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...
Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...Ontico
 
Session 49 - Semantic metadata management practical
Session 49 - Semantic metadata management practical Session 49 - Semantic metadata management practical
Session 49 - Semantic metadata management practical ISSGC Summer School
 
A Deep Dive into Apache Cassandra for .NET Developers
A Deep Dive into Apache Cassandra for .NET DevelopersA Deep Dive into Apache Cassandra for .NET Developers
A Deep Dive into Apache Cassandra for .NET DevelopersLuke Tillman
 
The Apache Cassandra ecosystem
The Apache Cassandra ecosystemThe Apache Cassandra ecosystem
The Apache Cassandra ecosystemAlex Thompson
 
Distribute Storage System May-2014
Distribute Storage System May-2014Distribute Storage System May-2014
Distribute Storage System May-2014Công Lợi Dương
 
Cache-partitioning
Cache-partitioningCache-partitioning
Cache-partitioningdavidkftam
 

Was ist angesagt? (7)

Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...
Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...
Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...
 
Session 49 - Semantic metadata management practical
Session 49 - Semantic metadata management practical Session 49 - Semantic metadata management practical
Session 49 - Semantic metadata management practical
 
A Deep Dive into Apache Cassandra for .NET Developers
A Deep Dive into Apache Cassandra for .NET DevelopersA Deep Dive into Apache Cassandra for .NET Developers
A Deep Dive into Apache Cassandra for .NET Developers
 
Session9part2 Servers Detailed
Session9part2  Servers DetailedSession9part2  Servers Detailed
Session9part2 Servers Detailed
 
The Apache Cassandra ecosystem
The Apache Cassandra ecosystemThe Apache Cassandra ecosystem
The Apache Cassandra ecosystem
 
Distribute Storage System May-2014
Distribute Storage System May-2014Distribute Storage System May-2014
Distribute Storage System May-2014
 
Cache-partitioning
Cache-partitioningCache-partitioning
Cache-partitioning
 

Andere mochten auch

Mission vishvas-resume template-6
Mission vishvas-resume template-6Mission vishvas-resume template-6
Mission vishvas-resume template-6vishvasyadav45
 
Общественный контроль и дружинники
Общественный контроль и дружинники Общественный контроль и дружинники
Общественный контроль и дружинники Vadim Karastelev
 
You have the_floor2
You have the_floor2You have the_floor2
You have the_floor2chiicokb
 
Corinth Education Summit - Jan. 23, 2014
Corinth Education Summit - Jan. 23, 2014Corinth Education Summit - Jan. 23, 2014
Corinth Education Summit - Jan. 23, 2014Mia Nickels
 
Pmi pmp-resume template-9
Pmi pmp-resume template-9Pmi pmp-resume template-9
Pmi pmp-resume template-9vishvasyadav45
 
Mission vishvas-resume template-109
Mission vishvas-resume template-109Mission vishvas-resume template-109
Mission vishvas-resume template-109vishvasyadav45
 
Vishvas resume template-8
Vishvas resume template-8Vishvas resume template-8
Vishvas resume template-8vishvasyadav45
 
Ch. 4 notes
Ch. 4 notesCh. 4 notes
Ch. 4 noteshheyrman
 
Отчетный доклад от группы Вопрошание
Отчетный доклад от группы ВопрошаниеОтчетный доклад от группы Вопрошание
Отчетный доклад от группы ВопрошаниеVadim Karastelev
 
Resolution Foundation tax credit cuts presentation
Resolution Foundation tax credit cuts presentationResolution Foundation tax credit cuts presentation
Resolution Foundation tax credit cuts presentationResolutionFoundation
 
Pmi pmp-resume template3
Pmi pmp-resume template3Pmi pmp-resume template3
Pmi pmp-resume template3vishvasyadav45
 
CII Multilateral Newsletter, October 2013, Vol. 1, Issue 1
CII Multilateral Newsletter, October 2013, Vol. 1, Issue 1CII Multilateral Newsletter, October 2013, Vol. 1, Issue 1
CII Multilateral Newsletter, October 2013, Vol. 1, Issue 1Confederation of Indian Industry
 
Ben Page Resolution Foundation slides
Ben Page Resolution Foundation slidesBen Page Resolution Foundation slides
Ben Page Resolution Foundation slidesResolutionFoundation
 

Andere mochten auch (19)

Mission vishvas-resume template-6
Mission vishvas-resume template-6Mission vishvas-resume template-6
Mission vishvas-resume template-6
 
Общественный контроль и дружинники
Общественный контроль и дружинники Общественный контроль и дружинники
Общественный контроль и дружинники
 
Untitled Presentation
Untitled PresentationUntitled Presentation
Untitled Presentation
 
You have the_floor2
You have the_floor2You have the_floor2
You have the_floor2
 
Corinth Education Summit - Jan. 23, 2014
Corinth Education Summit - Jan. 23, 2014Corinth Education Summit - Jan. 23, 2014
Corinth Education Summit - Jan. 23, 2014
 
Pmi pmp-resume template-9
Pmi pmp-resume template-9Pmi pmp-resume template-9
Pmi pmp-resume template-9
 
Resume template 9
Resume template 9Resume template 9
Resume template 9
 
Resume template 18
Resume template 18Resume template 18
Resume template 18
 
Mission vishvas-resume template-109
Mission vishvas-resume template-109Mission vishvas-resume template-109
Mission vishvas-resume template-109
 
Can we afford to care?
Can we afford to care? Can we afford to care?
Can we afford to care?
 
Vishvas resume template-8
Vishvas resume template-8Vishvas resume template-8
Vishvas resume template-8
 
Ch. 4 notes
Ch. 4 notesCh. 4 notes
Ch. 4 notes
 
PRISM, January 2014
PRISM, January 2014 PRISM, January 2014
PRISM, January 2014
 
CII Policy Watch [on] Manufacturing Sector
CII Policy Watch [on] Manufacturing SectorCII Policy Watch [on] Manufacturing Sector
CII Policy Watch [on] Manufacturing Sector
 
Отчетный доклад от группы Вопрошание
Отчетный доклад от группы ВопрошаниеОтчетный доклад от группы Вопрошание
Отчетный доклад от группы Вопрошание
 
Resolution Foundation tax credit cuts presentation
Resolution Foundation tax credit cuts presentationResolution Foundation tax credit cuts presentation
Resolution Foundation tax credit cuts presentation
 
Pmi pmp-resume template3
Pmi pmp-resume template3Pmi pmp-resume template3
Pmi pmp-resume template3
 
CII Multilateral Newsletter, October 2013, Vol. 1, Issue 1
CII Multilateral Newsletter, October 2013, Vol. 1, Issue 1CII Multilateral Newsletter, October 2013, Vol. 1, Issue 1
CII Multilateral Newsletter, October 2013, Vol. 1, Issue 1
 
Ben Page Resolution Foundation slides
Ben Page Resolution Foundation slidesBen Page Resolution Foundation slides
Ben Page Resolution Foundation slides
 

Ähnlich wie Decade architecture discussion 20110311

3.5 SDN CloudStack Developer Day
3.5  SDN CloudStack Developer Day3.5  SDN CloudStack Developer Day
3.5 SDN CloudStack Developer DayKimihiko Kitase
 
(ATS3-PLAT06) Handling “Big Data” with Pipeline Pilot (MapReduce/NoSQL)
(ATS3-PLAT06) Handling “Big Data” with Pipeline Pilot (MapReduce/NoSQL)(ATS3-PLAT06) Handling “Big Data” with Pipeline Pilot (MapReduce/NoSQL)
(ATS3-PLAT06) Handling “Big Data” with Pipeline Pilot (MapReduce/NoSQL)BIOVIA
 
RunningQuantumOnQuantumAtNicira.pdf
RunningQuantumOnQuantumAtNicira.pdfRunningQuantumOnQuantumAtNicira.pdf
RunningQuantumOnQuantumAtNicira.pdfOpenStack Foundation
 
Dragonflow Austin Summit Talk
Dragonflow Austin Summit Talk Dragonflow Austin Summit Talk
Dragonflow Austin Summit Talk Eran Gampel
 
Xldb2011 tue 1005_linked_in
Xldb2011 tue 1005_linked_inXldb2011 tue 1005_linked_in
Xldb2011 tue 1005_linked_inliqiang xu
 
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016Cloud Native Day Tel Aviv
 
Networking is NOT Free: Lessons in Network Design
Networking is NOT Free: Lessons in Network DesignNetworking is NOT Free: Lessons in Network Design
Networking is NOT Free: Lessons in Network DesignRandy Bias
 
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...IndicThreads
 
Realtime Apache Hadoop at Facebook
Realtime Apache Hadoop at FacebookRealtime Apache Hadoop at Facebook
Realtime Apache Hadoop at Facebookparallellabs
 
Distributed Design and Architecture of Cloud Foundry
Distributed Design and Architecture of Cloud FoundryDistributed Design and Architecture of Cloud Foundry
Distributed Design and Architecture of Cloud FoundryDerek Collison
 
Qcon 111122082620-phpapp02
Qcon 111122082620-phpapp02Qcon 111122082620-phpapp02
Qcon 111122082620-phpapp02Newlink
 
OpenStack and OpenFlow Demos
OpenStack and OpenFlow DemosOpenStack and OpenFlow Demos
OpenStack and OpenFlow DemosBrent Salisbury
 
Openstack@ebay: Practical SDN deployment with Quantum
Openstack@ebay: Practical SDN deployment with QuantumOpenstack@ebay: Practical SDN deployment with Quantum
Openstack@ebay: Practical SDN deployment with QuantumJean-Christophe "JC" Martin
 
Cluster Computing with Dryad
Cluster Computing with DryadCluster Computing with Dryad
Cluster Computing with Dryadbutest
 

Ähnlich wie Decade architecture discussion 20110311 (20)

3.5 SDN CloudStack Developer Day
3.5  SDN CloudStack Developer Day3.5  SDN CloudStack Developer Day
3.5 SDN CloudStack Developer Day
 
CloudStack Networking
CloudStack NetworkingCloudStack Networking
CloudStack Networking
 
(ATS3-PLAT06) Handling “Big Data” with Pipeline Pilot (MapReduce/NoSQL)
(ATS3-PLAT06) Handling “Big Data” with Pipeline Pilot (MapReduce/NoSQL)(ATS3-PLAT06) Handling “Big Data” with Pipeline Pilot (MapReduce/NoSQL)
(ATS3-PLAT06) Handling “Big Data” with Pipeline Pilot (MapReduce/NoSQL)
 
RunningQuantumOnQuantumAtNicira.pdf
RunningQuantumOnQuantumAtNicira.pdfRunningQuantumOnQuantumAtNicira.pdf
RunningQuantumOnQuantumAtNicira.pdf
 
mumbai network diagram
mumbai  network diagrammumbai  network diagram
mumbai network diagram
 
Dragonflow Austin Summit Talk
Dragonflow Austin Summit Talk Dragonflow Austin Summit Talk
Dragonflow Austin Summit Talk
 
Xldb2011 tue 1005_linked_in
Xldb2011 tue 1005_linked_inXldb2011 tue 1005_linked_in
Xldb2011 tue 1005_linked_in
 
Data Aggregation System
Data Aggregation SystemData Aggregation System
Data Aggregation System
 
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016
 
Networking is NOT Free: Lessons in Network Design
Networking is NOT Free: Lessons in Network DesignNetworking is NOT Free: Lessons in Network Design
Networking is NOT Free: Lessons in Network Design
 
Cliser
CliserCliser
Cliser
 
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
 
Realtime Apache Hadoop at Facebook
Realtime Apache Hadoop at FacebookRealtime Apache Hadoop at Facebook
Realtime Apache Hadoop at Facebook
 
Distributed Design and Architecture of Cloud Foundry
Distributed Design and Architecture of Cloud FoundryDistributed Design and Architecture of Cloud Foundry
Distributed Design and Architecture of Cloud Foundry
 
Qcon 111122082620-phpapp02
Qcon 111122082620-phpapp02Qcon 111122082620-phpapp02
Qcon 111122082620-phpapp02
 
OpenStack and OpenFlow Demos
OpenStack and OpenFlow DemosOpenStack and OpenFlow Demos
OpenStack and OpenFlow Demos
 
Openstack@ebay: Practical SDN deployment with Quantum
Openstack@ebay: Practical SDN deployment with QuantumOpenstack@ebay: Practical SDN deployment with Quantum
Openstack@ebay: Practical SDN deployment with Quantum
 
ElephantDB
ElephantDBElephantDB
ElephantDB
 
Introduction to Hadoop
Introduction to HadoopIntroduction to Hadoop
Introduction to Hadoop
 
Cluster Computing with Dryad
Cluster Computing with DryadCluster Computing with Dryad
Cluster Computing with Dryad
 

Decade architecture discussion 20110311

  • 1. DECADE Architecture Discussion Lijiang Chen 2011/3/11
  • 2. What are possible options? -- In one ISP point of view
  • 4. Inside Data Center • Pros – Easy coordinate, load balance, de-duplication…. • Cons – Far from end-host – Long latency? – Middle-mile bottleneck – what’s the distinguish from Data Center applications?
  • 6. Distributed in Edge • Pros – Near end-host, law latency, load balance … • Cons – Difficult data de-duplication between servers (how to efficiently utilize resources?)
  • 7. Argument: We should put DECADE in edge
  • 8. Motivation Example Every Server will keep a copy for a period of time?! 8
  • 9. Problem • Coupled DECADE access with data storage – CDN’s cache mechanism based on utilization – DECADE’s “cache” has constraint • Need to guarantee a basic (or temporary) available time (1 hour, 1 day, 1 month?) • Solution: – Decouple DECADE access and data management
  • 10. Decoupled DECADE access and data management Status Server DECADE Server = Login Handler or = Login Handler + Data Server Status Handlers Data Servers a La Index La b Lb Index Lb c Lc Lc Index
  • 11. Get a Data Status Server Status Handlers Data Servers Login a 1 La Index 2 La 4 3 Status Handlers
  • 12. Remote Get without Data Transfer Status Server Status Handlers Data Servers a La Index La 2 3 b 1 Lb Index 4 Lb
  • 13. Remote Get with Data Transfer Status Server Status Handlers Data Servers a La Index La 2 3 4 5 b 1 Lb Index 6 Lb
  • 15. Architecture Content Provider vCDN Provider Service Provider ISP 2 Web Server AS (multiple layers) ISP 1 User DECADE DECADE DECADE DECADE Data Control Msg 15
  • 16. Discussion 1 Content Provider vCDN Provider Service Provider ISP 2 x Web Server ? x AS (multiple layers) ISP 1 User DECADE DECADE DECADE DECADE Data Control Msg 16
  • 17. Discussion 2 Content Provider vCDN Provider Service Provider ISP 2 Web Server AS (multiple layers) ISP 1 User DECADE DECADE DECADE DECADE How do DECADE servers interact with each other? Data Control Msg 17