SlideShare ist ein Scribd-Unternehmen logo
1 von 19
Downloaden Sie, um offline zu lesen
Model-Driven
Cloud Data Storage
Juan Castrejón, Genoveva Vargas-Solar, Christine Collet, Rafael Lozano
Université de Grenoble, CNRS, Grenoble INP, Tecnológico de Monterrey




CloudMDE 2012
2




Background
•  Cloud computing (NIST-2011)
   •  Utility computing model for enabling ubiquitous, convenient, on-
      demand network access to a shared pool of configurable resources

•  Cloud data storage (Ruiz-2011, Armbrust-2009)
   •  Store, retrieve and manage large amounts of data, using highly
      scalable distributed infrastructures


•  Polyglot persistence (Fowler-2011)
   •  Different data storage technologies for different kinds of data
   •  Each storage mechanism introduces a new interface to be learned
   •  To get decent performance, you have to understand a lot about
      how the technology works
3




Background
•  Variety of data storage models and implementations
 (Cattell-2011, Edlich-2012)
  •  Models: key-value, document, extensible record, graph, blob,
     object, queue, xml, relational
  •  Implementations: Redis, Voldemort, MongoDB, CouchDB,
     Cassandra, Neo4J, db4o, eXist-db, etc. (As of today, over 120 options)


•  Cloud deployment environments (Ruiz-2011)
   •  Different combinations of pricing, support, service level
      agreements, and management APIs
   •  Public providers (Amazon, Windows Azure, Xeround, etc.)
   •  Private providers (Eucalyptus, OpenNebula, etc.)
4

Use the right tool for the right job…




                                                        How do I know which is the
                                                        right tool for the right job?




                                        (Katsov-2012)
5




Problem
•  How to specify data requirements for cloud environments?


•  For a set of data requirements, how to choose an
 appropriate combination of cloud storage system
 implementation and deployment provider?

•  How to generate/manage everything that’s required to
 work with the selection that I make?
6




Existing solutions
•  Integration of cloud storage platforms (Livenson-2011)
    •  Cloud Data Management Interface (CDMI) (SNIA-2011) proxy to
       integrate blob and queue data stores
•  Data integration over NoSQL stores (Curé-2011)
   •  Integration of relational and NoSQL databases (Document, column)
   •  Focus on efficient answering of queries
•  Storage provider selection (Ruiz-2011, Ruiz-2012)
   •  Characterize storage providers features (Ex: performance, cost)
   •  Specify requirements for application datasets (Ex: expected size,
      access latency, concurrent clients)
   •  Based on the previous information, an assignment of datasets to
      different storage systems is proposed
7




Existing solutions
•  Modeling as a Service (Bruneliere-2010)
   •  Deploy and execute model-driven services over the Internet (SaaS)


•  Design and deploy applications in the cloud (Peidro-2011)
   •  Promotes graphical models to capture cloud requirements
   •  Models automatically deployed to PaaS and IaaS environments


•  Application design/execution in multiple clouds (Ardagna-2012)
  •  MDE quality-driven method for design, development and operation
  •  Monitoring and feedback system
8




Limitations of existing solutions
•  Support for a limited set of cloud storage interfaces


•  Data integration can be highly based on the relational
 model

•  Limited information for the selection of data storage
 systems

•  Consideration for high-level cloud models (SaaS) but
 limited support for low-level models (PaaS and IaaS)
9




Objectives
1.  Provide adequate notations and environments to
   characterize cloud data storage requirements

2.  Selection of cloud data storage implementations and
   deployment providers

3.  Management of the required artifacts to work with
   different combinations of cloud storage implementations
   and providers
10




  Objectives
                          Cloud
                       requirements
                                Conceptual                    High-level of abstraction
                                  models                (Conceptual models and environments)




Selection process      Logical    Logical    Logical
Artifacts management   model      model      model




                       Physical   Physical   Physical           Low-level of abstraction
                        model      model      model     (Storage implementations and providers)
11




Proposed solution
•  Rely on Model-Driven Engineering (MDE) (Kent-2002) to:
   •  Characterize cloud storage requirements
   •  Encapsulate selection, administration and use of cloud data
      storage implementations


•  Why MDE?
   •  Avoid dependencies between high-level (data models) and low-
      level abstractions (storage implementations and providers)
   •  Emphasis on relying on different levels of modeling notations
   •  Generation of low-level abstractions by using automatic
      transformation procedures
12




Objective 1: Data requirements for the cloud
•  Do traditional modeling notations (ER and UML diagrams)
 make sense for data storage in the cloud?
  •  Define-extend notations and environments for cloud data modeling
•  What requirements should a cloud data storage notation
 consider?
  •  Rely on quality standards (ISO/IEC SQuaRE, S-Cube) to guide this
    analysis. Example: performance, efficiency, portability, etc.
•  How to characterize the proposed requirements?
   •  Associate quality metrics relevant to (cloud) scenarios, based on
      the characteristics of the reference standard (Jureta-2010)
   •  Validate currently proposed metrics. For example: throughput, cost,
      access latency, etc.
13




Objective 2: Data storage selection
•  Based on the analysis of historic data and usage patterns
   •  Both in test applications and within systems generated in our modeling
      environment
•  Monitoring data is gathered in a non-intrusive manner
   •  AOP monitoring
   •  Monitor the behaviour of the selected implementation/providers, based
      on the metrics specified in the modeling environment
   •  Compare expected values and actual performance
•  Monitoring data is shared in open/collaborative manner
   •  Used by our decision process
   •  Available for external users
•  Users could work, at the same time, with multiple combinations
 of storage implementations and providers
  •  Test the performance of the different combinations
14




Objective 3: Cloud artifacts management
•  Generate the low-level artifacts to work with data storage
 implementations and deployment providers
  •  Configuration files for deployment providers
  •  Data management interfaces (CDMI, Spring Data, etc.)


•  Different levels of transformation procedures
   •  From the high-level data model to an intermediate Domain Specific
      Language (DSL) (Liu-2010, SpringRoo-2012)
   •  From the intermediate DSL to configuration files, AOP monitoring
      aspects and data management interfaces (SpringData-2012)


•  MDE transformation techniques
   •  Model-to-Model (M2M), Model-to-Text (M2T)
15




Proof of concept                                      Work in progress…

                                                                        1
•  Extension - Model2Roo (http://code.google.com/p/model2roo/)
                                                                  High-level
                                                                 abstractions

                                               Java
                                               web
                                               App
                                                          Spring Data
UML class diagram        Spring Roo




                    2
               Low-level
              abstractions
                              Graph database
                                                        Relational database
16




Preliminary results
•  Castrejón, J., Vargas-Solar, G., Collet, C., Lozano, R., :
 “Model-Driven Cloud Data Storage”. In: First International
 Workshop on Model-Driven Engineering on and for the
 Cloud (CloudMDE 2012). Co-located with ECMFA ’12.
 July 2012

•  Castrejón, J., Vargas-Solar, G., Lozano, R., : “Model2Roo:
 Web Application Development based on the Eclipse
 Modeling Framework and Spring Roo”. In: First Workshop
 on Academics Modeling with Eclipse (ACME 2012). Co-
 located with ECMFA ’12. July 2012
17




Demonstration / Questions



  Contact: Juan.Castrejon@imag.fr
18




References
•  Ardagna, D., Di Nitto, E., Casale, G., et al. MODACLOUDS, A Model-Driven Approach for the
     Design and Execution of Applications on Multiple Clouds. Models in Software Engineering
     Workshop (MiSE 2012). Co-located with ICSE ’12. (2012)
•    Armbrust M. , Fox A., Griffith R., Joseph A. D, et al. Above the Clouds: A Berkeley View of
     Cloud Computing, 2009.
•    Bruneliere, H., Cabot, J., Jouault, F.: Combining model-driven engineering and cloud
     computing. In: Modeling, Design, and Analysis for the Service Cloud Workshop.
     MDA4ServiceCloud ’10 (2010)
•    Cattell, R.: Scalable sql and nosql data stores. SIGMOD Rec. 39, 12–27 (May 2011)
•    Curé, O., Hecht, R., Le Duc, C., Lamolle, M.: Data Integration over NoSQL Stores Using
     Access Path Based Mappings. A. In: Proceedings of the 22nd International Conference on
     Database and Expert Systems Applications (DEXA 2011). Hameurlain et al. (Eds.), Part I,
     LNCS 6860, pp. 481–495, (2011)
•    Edlich, S.: List of nosql databases. http://nosqldatabase.org/ (March 2012)
•    Fowler, M.: Polyglot persistence. http://martinfowler.com/bliki/PolyglotPersistence.html
     (November 2011)
•    Jureta, I., Borgida, A., Ernst, N., Mylopoulos, J.: Techne: Towards a New Generation of
     Requirements Modeling Languages with Goals, Preferences, and Inconsistency Handling. In:
     Proceedings of the 18th IEEE International Requirements Engineering Conference. pp.
     115-124. RE 2010. IEEE Computer Society (2010)
•    Katsov, I.: Nosql data modeling techniques. http://highlyscalable.wordpress.com/ 2012/03/01/
     nosql-data-modeling-techniques/ (March 2012)
19




References
•  Kent, S.: Model driven engineering. In: Butler, M., Petre, L., Sere, K. (eds.) Integrated Formal Methods,
     LNCS, vol. 2335, pp. 286–298. Springer Berlin (2002)
•    Lenzerini, M.: Data integration is harder than you thought. In: Proceedings of the 9th International
     Conference on Cooperative Information Systems. pp. 22-26. CooplS ’01, Springer-Verlag, London, UK
     (2001)
•    Livenson, I., Laure, E.: Towards Transparent Integration of Heterogeneous Cloud Storage Platforms. In:
     Fourth International Workshop on Data Intensive Distributed Computing. DIDC ’11. Co-located with HDPC
     ‘11 (2011)
•    Liu, D., Zic, J.: Cloud#: A specification language for modeling cloud. In: Proceedings of the 2011 IEEE 4th
     International Conference on Cloud Computing. pp. 533–540. CLOUD ’11, IEEE Computer Society,
     Washington, DC, USA (2011)
•    Peidro, J.E., Muñoz-Escoí, F.D.: Towards the next generation of model driven cloud platforms. In: 1st
     International Conference on Cloud Computing and Services Science. pp. 494–500. CLOSER ’11 (2011)
•    Ruiz-Alvarez, A., Humphrey, M.: An automated approach to cloud storage service selection. In: Proceedings
     of the 2nd international workshop on Scientific cloud computing. pp. 39–48. ScienceCloud ’11, ACM, New
     York, NY, USA (2011)
•    Ruiz-Alvarez, A., Humphrey, M.: A model and decision procedure for data storage in cloud computing. In:
     Proceedings of the IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing. CCGrid ’12
     (2012)
•    Storage Networking Industry Association (SNIA): Cloud data management interface (CDMI). http://
     www.snia.org/cdmi (September 2011)
•    SpringSource: Spring data projects. http://www.springsource.org/spring-data (March 2012)
•    SpringSource: Spring roo. http://www.springsource.org/spring-roo (March 2012)

Weitere ähnliche Inhalte

Was ist angesagt?

yuchung Resume LA
yuchung Resume LAyuchung Resume LA
yuchung Resume LATom Chung
 
[2015/2016] AADL (Architecture Analysis and Design Language)
[2015/2016] AADL (Architecture Analysis and Design Language)[2015/2016] AADL (Architecture Analysis and Design Language)
[2015/2016] AADL (Architecture Analysis and Design Language)Ivano Malavolta
 
seanresume15-a
seanresume15-aseanresume15-a
seanresume15-aSean Lynch
 
Architecture Knowledge
Architecture KnowledgeArchitecture Knowledge
Architecture KnowledgeAakash Ahmad
 
MoDisco Poster EclipseCon 2009
MoDisco Poster EclipseCon 2009MoDisco Poster EclipseCon 2009
MoDisco Poster EclipseCon 2009fmadiot
 
Fostering MBSE in Engineering Culture
Fostering MBSE in Engineering CultureFostering MBSE in Engineering Culture
Fostering MBSE in Engineering CultureObeo
 
Discover models out of existing applications with Eclipse/MoDisco
Discover models out of existing applications with Eclipse/MoDiscoDiscover models out of existing applications with Eclipse/MoDisco
Discover models out of existing applications with Eclipse/MoDiscofmadiot
 
[2017/2018] AADL - Architecture Analysis and Design Language
[2017/2018] AADL - Architecture Analysis and Design Language[2017/2018] AADL - Architecture Analysis and Design Language
[2017/2018] AADL - Architecture Analysis and Design LanguageIvano Malavolta
 
MoDisco & ATL - Eclipse DemoCamp Indigo 2011 in Nantes
MoDisco & ATL - Eclipse DemoCamp Indigo 2011 in NantesMoDisco & ATL - Eclipse DemoCamp Indigo 2011 in Nantes
MoDisco & ATL - Eclipse DemoCamp Indigo 2011 in NantesHugo Bruneliere
 
Mia-Software at Eclipse Modeling Symposium 2010
Mia-Software at Eclipse Modeling Symposium 2010Mia-Software at Eclipse Modeling Symposium 2010
Mia-Software at Eclipse Modeling Symposium 2010fmadiot
 

Was ist angesagt? (12)

yuchung Resume LA
yuchung Resume LAyuchung Resume LA
yuchung Resume LA
 
[2015/2016] AADL (Architecture Analysis and Design Language)
[2015/2016] AADL (Architecture Analysis and Design Language)[2015/2016] AADL (Architecture Analysis and Design Language)
[2015/2016] AADL (Architecture Analysis and Design Language)
 
seanresume15-a
seanresume15-aseanresume15-a
seanresume15-a
 
Architecture Knowledge
Architecture KnowledgeArchitecture Knowledge
Architecture Knowledge
 
MoDisco Poster EclipseCon 2009
MoDisco Poster EclipseCon 2009MoDisco Poster EclipseCon 2009
MoDisco Poster EclipseCon 2009
 
Struts Ppt 1
Struts Ppt 1Struts Ppt 1
Struts Ppt 1
 
Fostering MBSE in Engineering Culture
Fostering MBSE in Engineering CultureFostering MBSE in Engineering Culture
Fostering MBSE in Engineering Culture
 
Discover models out of existing applications with Eclipse/MoDisco
Discover models out of existing applications with Eclipse/MoDiscoDiscover models out of existing applications with Eclipse/MoDisco
Discover models out of existing applications with Eclipse/MoDisco
 
[2017/2018] AADL - Architecture Analysis and Design Language
[2017/2018] AADL - Architecture Analysis and Design Language[2017/2018] AADL - Architecture Analysis and Design Language
[2017/2018] AADL - Architecture Analysis and Design Language
 
MoDisco & ATL - Eclipse DemoCamp Indigo 2011 in Nantes
MoDisco & ATL - Eclipse DemoCamp Indigo 2011 in NantesMoDisco & ATL - Eclipse DemoCamp Indigo 2011 in Nantes
MoDisco & ATL - Eclipse DemoCamp Indigo 2011 in Nantes
 
Month 3 report
Month 3 reportMonth 3 report
Month 3 report
 
Mia-Software at Eclipse Modeling Symposium 2010
Mia-Software at Eclipse Modeling Symposium 2010Mia-Software at Eclipse Modeling Symposium 2010
Mia-Software at Eclipse Modeling Symposium 2010
 

Andere mochten auch (9)

Community Career Center: Introduction to Cloud Storage (Dropbox, Google Drive...
Community Career Center: Introduction to Cloud Storage (Dropbox, Google Drive...Community Career Center: Introduction to Cloud Storage (Dropbox, Google Drive...
Community Career Center: Introduction to Cloud Storage (Dropbox, Google Drive...
 
SkyDrive and Google Drive Cloud Storage Options
SkyDrive and Google Drive Cloud Storage OptionsSkyDrive and Google Drive Cloud Storage Options
SkyDrive and Google Drive Cloud Storage Options
 
Understaning Risk
Understaning RiskUnderstaning Risk
Understaning Risk
 
Google drive
Google driveGoogle drive
Google drive
 
Cloudschool 2014
Cloudschool 2014Cloudschool 2014
Cloudschool 2014
 
An introduction of cloud storage
An introduction of cloud storage An introduction of cloud storage
An introduction of cloud storage
 
Cloud storage
Cloud storageCloud storage
Cloud storage
 
Cloud storage slides
Cloud storage slidesCloud storage slides
Cloud storage slides
 
Google drive powerpoint
Google drive powerpointGoogle drive powerpoint
Google drive powerpoint
 

Ähnlich wie Model-Driven Cloud Data Storage

Cloud Computing: A Perspective on Next Basic Utility in IT World
Cloud Computing: A Perspective on Next Basic Utility in IT World Cloud Computing: A Perspective on Next Basic Utility in IT World
Cloud Computing: A Perspective on Next Basic Utility in IT World IRJET Journal
 
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...Igor De Souza
 
The elephantintheroom bigdataanalyticsinthecloud
The elephantintheroom bigdataanalyticsinthecloudThe elephantintheroom bigdataanalyticsinthecloud
The elephantintheroom bigdataanalyticsinthecloudKhazret Sapenov
 
Cloud-Computing-Course-Description-and-Syllabus-Spring2020.pdf
Cloud-Computing-Course-Description-and-Syllabus-Spring2020.pdfCloud-Computing-Course-Description-and-Syllabus-Spring2020.pdf
Cloud-Computing-Course-Description-and-Syllabus-Spring2020.pdfKanagarajSubramani1
 
Ieee projects-2014-bulk-ieee-projects-2015-title-list-for-me-be-mphil-final-y...
Ieee projects-2014-bulk-ieee-projects-2015-title-list-for-me-be-mphil-final-y...Ieee projects-2014-bulk-ieee-projects-2015-title-list-for-me-be-mphil-final-y...
Ieee projects-2014-bulk-ieee-projects-2015-title-list-for-me-be-mphil-final-y...birdsking
 
CloudComputingJun28.ppt
CloudComputingJun28.pptCloudComputingJun28.ppt
CloudComputingJun28.pptVipin Singhal
 
CloudComputingJun28.ppt
CloudComputingJun28.pptCloudComputingJun28.ppt
CloudComputingJun28.pptgeminass1
 
ClouNS - A Cloud-native Application Reference Model for Enterprise Architects
ClouNS - A Cloud-native Application Reference Model for Enterprise ArchitectsClouNS - A Cloud-native Application Reference Model for Enterprise Architects
ClouNS - A Cloud-native Application Reference Model for Enterprise ArchitectsNane Kratzke
 
Use Case: Apollo Group at Oracle Open World
Use Case: Apollo Group at Oracle Open WorldUse Case: Apollo Group at Oracle Open World
Use Case: Apollo Group at Oracle Open WorldMongoDB
 
TERM PAPER presentation (2).pptx
TERM PAPER presentation (2).pptxTERM PAPER presentation (2).pptx
TERM PAPER presentation (2).pptxKalashShandilya1
 
Simplifying Cloud Architectures with Data Virtualization
Simplifying Cloud Architectures with Data VirtualizationSimplifying Cloud Architectures with Data Virtualization
Simplifying Cloud Architectures with Data VirtualizationDenodo
 
IC2E A Configuration Crawler for Cloud Appliances
IC2E A Configuration Crawler for Cloud AppliancesIC2E A Configuration Crawler for Cloud Appliances
IC2E A Configuration Crawler for Cloud AppliancesDr.-Ing. Michael Menzel
 
Towards CloudML, a Model-Based Approach to Provision Resources in the Clouds
Towards CloudML, a Model-Based Approach  to Provision Resources in the CloudsTowards CloudML, a Model-Based Approach  to Provision Resources in the Clouds
Towards CloudML, a Model-Based Approach to Provision Resources in the CloudsSébastien Mosser
 
Scaling Multi-Cloud Deployments with Denodo: Automated Infrastructure Management
Scaling Multi-Cloud Deployments with Denodo: Automated Infrastructure ManagementScaling Multi-Cloud Deployments with Denodo: Automated Infrastructure Management
Scaling Multi-Cloud Deployments with Denodo: Automated Infrastructure ManagementDenodo
 
A Successful Journey to the Cloud with Data Virtualization
A Successful Journey to the Cloud with Data VirtualizationA Successful Journey to the Cloud with Data Virtualization
A Successful Journey to the Cloud with Data VirtualizationDenodo
 
(R)evolution of the computing continuum - A few challenges
(R)evolution of the computing continuum  - A few challenges(R)evolution of the computing continuum  - A few challenges
(R)evolution of the computing continuum - A few challengesFrederic Desprez
 

Ähnlich wie Model-Driven Cloud Data Storage (20)

Cloud Computing: A Perspective on Next Basic Utility in IT World
Cloud Computing: A Perspective on Next Basic Utility in IT World Cloud Computing: A Perspective on Next Basic Utility in IT World
Cloud Computing: A Perspective on Next Basic Utility in IT World
 
Concurrent and Distributed CloudSim Simulations
Concurrent and Distributed CloudSim SimulationsConcurrent and Distributed CloudSim Simulations
Concurrent and Distributed CloudSim Simulations
 
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...
 
The elephantintheroom bigdataanalyticsinthecloud
The elephantintheroom bigdataanalyticsinthecloudThe elephantintheroom bigdataanalyticsinthecloud
The elephantintheroom bigdataanalyticsinthecloud
 
Cloud-Computing-Course-Description-and-Syllabus-Spring2020.pdf
Cloud-Computing-Course-Description-and-Syllabus-Spring2020.pdfCloud-Computing-Course-Description-and-Syllabus-Spring2020.pdf
Cloud-Computing-Course-Description-and-Syllabus-Spring2020.pdf
 
Madhava_Sr_JAVA_J2EE
Madhava_Sr_JAVA_J2EEMadhava_Sr_JAVA_J2EE
Madhava_Sr_JAVA_J2EE
 
Ieee projects-2014-bulk-ieee-projects-2015-title-list-for-me-be-mphil-final-y...
Ieee projects-2014-bulk-ieee-projects-2015-title-list-for-me-be-mphil-final-y...Ieee projects-2014-bulk-ieee-projects-2015-title-list-for-me-be-mphil-final-y...
Ieee projects-2014-bulk-ieee-projects-2015-title-list-for-me-be-mphil-final-y...
 
CloudComputingJun28.ppt
CloudComputingJun28.pptCloudComputingJun28.ppt
CloudComputingJun28.ppt
 
CloudComputingJun28.ppt
CloudComputingJun28.pptCloudComputingJun28.ppt
CloudComputingJun28.ppt
 
CloudComputingJun28.ppt
CloudComputingJun28.pptCloudComputingJun28.ppt
CloudComputingJun28.ppt
 
ClouNS - A Cloud-native Application Reference Model for Enterprise Architects
ClouNS - A Cloud-native Application Reference Model for Enterprise ArchitectsClouNS - A Cloud-native Application Reference Model for Enterprise Architects
ClouNS - A Cloud-native Application Reference Model for Enterprise Architects
 
Use Case: Apollo Group at Oracle Open World
Use Case: Apollo Group at Oracle Open WorldUse Case: Apollo Group at Oracle Open World
Use Case: Apollo Group at Oracle Open World
 
TERM PAPER presentation (2).pptx
TERM PAPER presentation (2).pptxTERM PAPER presentation (2).pptx
TERM PAPER presentation (2).pptx
 
Simplifying Cloud Architectures with Data Virtualization
Simplifying Cloud Architectures with Data VirtualizationSimplifying Cloud Architectures with Data Virtualization
Simplifying Cloud Architectures with Data Virtualization
 
IC2E A Configuration Crawler for Cloud Appliances
IC2E A Configuration Crawler for Cloud AppliancesIC2E A Configuration Crawler for Cloud Appliances
IC2E A Configuration Crawler for Cloud Appliances
 
Towards CloudML, a Model-Based Approach to Provision Resources in the Clouds
Towards CloudML, a Model-Based Approach  to Provision Resources in the CloudsTowards CloudML, a Model-Based Approach  to Provision Resources in the Clouds
Towards CloudML, a Model-Based Approach to Provision Resources in the Clouds
 
Scaling Multi-Cloud Deployments with Denodo: Automated Infrastructure Management
Scaling Multi-Cloud Deployments with Denodo: Automated Infrastructure ManagementScaling Multi-Cloud Deployments with Denodo: Automated Infrastructure Management
Scaling Multi-Cloud Deployments with Denodo: Automated Infrastructure Management
 
A Successful Journey to the Cloud with Data Virtualization
A Successful Journey to the Cloud with Data VirtualizationA Successful Journey to the Cloud with Data Virtualization
A Successful Journey to the Cloud with Data Virtualization
 
(R)evolution of the computing continuum - A few challenges
(R)evolution of the computing continuum  - A few challenges(R)evolution of the computing continuum  - A few challenges
(R)evolution of the computing continuum - A few challenges
 
Cloud computingjun28
Cloud computingjun28Cloud computingjun28
Cloud computingjun28
 

Kürzlich hochgeladen

CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 

Kürzlich hochgeladen (20)

CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 

Model-Driven Cloud Data Storage

  • 1. Model-Driven Cloud Data Storage Juan Castrejón, Genoveva Vargas-Solar, Christine Collet, Rafael Lozano Université de Grenoble, CNRS, Grenoble INP, Tecnológico de Monterrey CloudMDE 2012
  • 2. 2 Background •  Cloud computing (NIST-2011) •  Utility computing model for enabling ubiquitous, convenient, on- demand network access to a shared pool of configurable resources •  Cloud data storage (Ruiz-2011, Armbrust-2009) •  Store, retrieve and manage large amounts of data, using highly scalable distributed infrastructures •  Polyglot persistence (Fowler-2011) •  Different data storage technologies for different kinds of data •  Each storage mechanism introduces a new interface to be learned •  To get decent performance, you have to understand a lot about how the technology works
  • 3. 3 Background •  Variety of data storage models and implementations (Cattell-2011, Edlich-2012) •  Models: key-value, document, extensible record, graph, blob, object, queue, xml, relational •  Implementations: Redis, Voldemort, MongoDB, CouchDB, Cassandra, Neo4J, db4o, eXist-db, etc. (As of today, over 120 options) •  Cloud deployment environments (Ruiz-2011) •  Different combinations of pricing, support, service level agreements, and management APIs •  Public providers (Amazon, Windows Azure, Xeround, etc.) •  Private providers (Eucalyptus, OpenNebula, etc.)
  • 4. 4 Use the right tool for the right job… How do I know which is the right tool for the right job? (Katsov-2012)
  • 5. 5 Problem •  How to specify data requirements for cloud environments? •  For a set of data requirements, how to choose an appropriate combination of cloud storage system implementation and deployment provider? •  How to generate/manage everything that’s required to work with the selection that I make?
  • 6. 6 Existing solutions •  Integration of cloud storage platforms (Livenson-2011) •  Cloud Data Management Interface (CDMI) (SNIA-2011) proxy to integrate blob and queue data stores •  Data integration over NoSQL stores (Curé-2011) •  Integration of relational and NoSQL databases (Document, column) •  Focus on efficient answering of queries •  Storage provider selection (Ruiz-2011, Ruiz-2012) •  Characterize storage providers features (Ex: performance, cost) •  Specify requirements for application datasets (Ex: expected size, access latency, concurrent clients) •  Based on the previous information, an assignment of datasets to different storage systems is proposed
  • 7. 7 Existing solutions •  Modeling as a Service (Bruneliere-2010) •  Deploy and execute model-driven services over the Internet (SaaS) •  Design and deploy applications in the cloud (Peidro-2011) •  Promotes graphical models to capture cloud requirements •  Models automatically deployed to PaaS and IaaS environments •  Application design/execution in multiple clouds (Ardagna-2012) •  MDE quality-driven method for design, development and operation •  Monitoring and feedback system
  • 8. 8 Limitations of existing solutions •  Support for a limited set of cloud storage interfaces •  Data integration can be highly based on the relational model •  Limited information for the selection of data storage systems •  Consideration for high-level cloud models (SaaS) but limited support for low-level models (PaaS and IaaS)
  • 9. 9 Objectives 1.  Provide adequate notations and environments to characterize cloud data storage requirements 2.  Selection of cloud data storage implementations and deployment providers 3.  Management of the required artifacts to work with different combinations of cloud storage implementations and providers
  • 10. 10 Objectives Cloud requirements Conceptual High-level of abstraction models (Conceptual models and environments) Selection process Logical Logical Logical Artifacts management model model model Physical Physical Physical Low-level of abstraction model model model (Storage implementations and providers)
  • 11. 11 Proposed solution •  Rely on Model-Driven Engineering (MDE) (Kent-2002) to: •  Characterize cloud storage requirements •  Encapsulate selection, administration and use of cloud data storage implementations •  Why MDE? •  Avoid dependencies between high-level (data models) and low- level abstractions (storage implementations and providers) •  Emphasis on relying on different levels of modeling notations •  Generation of low-level abstractions by using automatic transformation procedures
  • 12. 12 Objective 1: Data requirements for the cloud •  Do traditional modeling notations (ER and UML diagrams) make sense for data storage in the cloud? •  Define-extend notations and environments for cloud data modeling •  What requirements should a cloud data storage notation consider? •  Rely on quality standards (ISO/IEC SQuaRE, S-Cube) to guide this analysis. Example: performance, efficiency, portability, etc. •  How to characterize the proposed requirements? •  Associate quality metrics relevant to (cloud) scenarios, based on the characteristics of the reference standard (Jureta-2010) •  Validate currently proposed metrics. For example: throughput, cost, access latency, etc.
  • 13. 13 Objective 2: Data storage selection •  Based on the analysis of historic data and usage patterns •  Both in test applications and within systems generated in our modeling environment •  Monitoring data is gathered in a non-intrusive manner •  AOP monitoring •  Monitor the behaviour of the selected implementation/providers, based on the metrics specified in the modeling environment •  Compare expected values and actual performance •  Monitoring data is shared in open/collaborative manner •  Used by our decision process •  Available for external users •  Users could work, at the same time, with multiple combinations of storage implementations and providers •  Test the performance of the different combinations
  • 14. 14 Objective 3: Cloud artifacts management •  Generate the low-level artifacts to work with data storage implementations and deployment providers •  Configuration files for deployment providers •  Data management interfaces (CDMI, Spring Data, etc.) •  Different levels of transformation procedures •  From the high-level data model to an intermediate Domain Specific Language (DSL) (Liu-2010, SpringRoo-2012) •  From the intermediate DSL to configuration files, AOP monitoring aspects and data management interfaces (SpringData-2012) •  MDE transformation techniques •  Model-to-Model (M2M), Model-to-Text (M2T)
  • 15. 15 Proof of concept Work in progress… 1 •  Extension - Model2Roo (http://code.google.com/p/model2roo/) High-level abstractions Java web App Spring Data UML class diagram Spring Roo 2 Low-level abstractions Graph database Relational database
  • 16. 16 Preliminary results •  Castrejón, J., Vargas-Solar, G., Collet, C., Lozano, R., : “Model-Driven Cloud Data Storage”. In: First International Workshop on Model-Driven Engineering on and for the Cloud (CloudMDE 2012). Co-located with ECMFA ’12. July 2012 •  Castrejón, J., Vargas-Solar, G., Lozano, R., : “Model2Roo: Web Application Development based on the Eclipse Modeling Framework and Spring Roo”. In: First Workshop on Academics Modeling with Eclipse (ACME 2012). Co- located with ECMFA ’12. July 2012
  • 17. 17 Demonstration / Questions Contact: Juan.Castrejon@imag.fr
  • 18. 18 References •  Ardagna, D., Di Nitto, E., Casale, G., et al. MODACLOUDS, A Model-Driven Approach for the Design and Execution of Applications on Multiple Clouds. Models in Software Engineering Workshop (MiSE 2012). Co-located with ICSE ’12. (2012) •  Armbrust M. , Fox A., Griffith R., Joseph A. D, et al. Above the Clouds: A Berkeley View of Cloud Computing, 2009. •  Bruneliere, H., Cabot, J., Jouault, F.: Combining model-driven engineering and cloud computing. In: Modeling, Design, and Analysis for the Service Cloud Workshop. MDA4ServiceCloud ’10 (2010) •  Cattell, R.: Scalable sql and nosql data stores. SIGMOD Rec. 39, 12–27 (May 2011) •  Curé, O., Hecht, R., Le Duc, C., Lamolle, M.: Data Integration over NoSQL Stores Using Access Path Based Mappings. A. In: Proceedings of the 22nd International Conference on Database and Expert Systems Applications (DEXA 2011). Hameurlain et al. (Eds.), Part I, LNCS 6860, pp. 481–495, (2011) •  Edlich, S.: List of nosql databases. http://nosqldatabase.org/ (March 2012) •  Fowler, M.: Polyglot persistence. http://martinfowler.com/bliki/PolyglotPersistence.html (November 2011) •  Jureta, I., Borgida, A., Ernst, N., Mylopoulos, J.: Techne: Towards a New Generation of Requirements Modeling Languages with Goals, Preferences, and Inconsistency Handling. In: Proceedings of the 18th IEEE International Requirements Engineering Conference. pp. 115-124. RE 2010. IEEE Computer Society (2010) •  Katsov, I.: Nosql data modeling techniques. http://highlyscalable.wordpress.com/ 2012/03/01/ nosql-data-modeling-techniques/ (March 2012)
  • 19. 19 References •  Kent, S.: Model driven engineering. In: Butler, M., Petre, L., Sere, K. (eds.) Integrated Formal Methods, LNCS, vol. 2335, pp. 286–298. Springer Berlin (2002) •  Lenzerini, M.: Data integration is harder than you thought. In: Proceedings of the 9th International Conference on Cooperative Information Systems. pp. 22-26. CooplS ’01, Springer-Verlag, London, UK (2001) •  Livenson, I., Laure, E.: Towards Transparent Integration of Heterogeneous Cloud Storage Platforms. In: Fourth International Workshop on Data Intensive Distributed Computing. DIDC ’11. Co-located with HDPC ‘11 (2011) •  Liu, D., Zic, J.: Cloud#: A specification language for modeling cloud. In: Proceedings of the 2011 IEEE 4th International Conference on Cloud Computing. pp. 533–540. CLOUD ’11, IEEE Computer Society, Washington, DC, USA (2011) •  Peidro, J.E., Muñoz-Escoí, F.D.: Towards the next generation of model driven cloud platforms. In: 1st International Conference on Cloud Computing and Services Science. pp. 494–500. CLOSER ’11 (2011) •  Ruiz-Alvarez, A., Humphrey, M.: An automated approach to cloud storage service selection. In: Proceedings of the 2nd international workshop on Scientific cloud computing. pp. 39–48. ScienceCloud ’11, ACM, New York, NY, USA (2011) •  Ruiz-Alvarez, A., Humphrey, M.: A model and decision procedure for data storage in cloud computing. In: Proceedings of the IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing. CCGrid ’12 (2012) •  Storage Networking Industry Association (SNIA): Cloud data management interface (CDMI). http:// www.snia.org/cdmi (September 2011) •  SpringSource: Spring data projects. http://www.springsource.org/spring-data (March 2012) •  SpringSource: Spring roo. http://www.springsource.org/spring-roo (March 2012)