SlideShare ist ein Scribd-Unternehmen logo
1 von 8
Downloaden Sie, um offline zu lesen
Cloud Computing and Storage
Implementation Considerations on
              APIs


            Mark Carlson

            Updated: 3/01/12
Various Discussion/Issues
•    In a Cloud Computing (IaaS) interface, how much information do you need to
     expose about the storage connections and fabrics/networks used to connect
     the virtual machines with their volumes?
•    Principals of information hiding and abstraction come into play
•    Private clouds and public clouds may have different requirements
•    Information includes:
      –  Interface type
           •  Block (SAN)
           •  File (NAS)
      –  Access Control
           •  Principals
           •  End point addressing
           •  Fabric/VLAN Management
Background on Storage Protocols
•    For Fibre Channel and FCoE
      –  A Host Bus Adapter (HBA) or Converged Network Adapter (CNA) is required on the
         host
      –  This can be virtualized for each guest using N Port ID Virtualization (NPIV) –
         special driver on guest
•    For IP Storage (iSCSI, NFS, CIFS/SMB/SMB2)
      –  Only a NIC is required on the host
      –  Guest OS loads iSCSI initiator driver or remote filesystem client
•  Volumes versus disks
      –    Volumes are shared, persistent over start/stop cycles (SAN/NAS)
      –    Disks are provided by the Hypervisor from internal filesystem (DAS)

•  Cloud provider may use different SAN/NAS technologies and different
   protocols between physical server hosting a virtual machine and the
   storage
•  For Volumes, Hypervisor may also play a role to "adapt" protocols/
   interfaces to match client specification
      –  e.g. virtual machine 'sees' a volume as a local SCSI device ”mapped" to a
         raw device by hypervisor which in fact accesses the remote volume using
         iSCSI etc.
Two Basic Models for Implementations
•    Rather than continue to add storage concepts and management functions to
     CIMI, perhaps we should reference an existing cloud storage standard (CDMI)
•    If the IaaS API implementation is provided by one vendor and the DaaS API
     implementation is provided by a different vendor, how do they coordinate the
     connections? (Slide 4 shows a picture of this)
•    If the IaaS API and DaaS API implementations are provided by a common
     infrastructure (orchestration) can the information that is exposed be
     abstracted/simplified? (Slide 5 shows a picture of this)
•    Does the back end storage network have to be exposed in all cases?
•    Or can it’s management be “orchestrated” and the storage network
     implementation hidden by the API?
Separate Infrastructure Implementations
•    Because the two
     infrastructures have
     separate
     implementations,
     there must be
     information in the
     respective APIs that
     allow for Cross-
     Communication
•    The IaaS
     implementation may
     be a Client of the
     DaaS API
•    The DaaS
     implementation may
     be a Client of the IaaS
     API
Common Implementation Infrastructure
•    Because there is a
     common
     implementation, the
     back end storage
     network can be
     “hidden” and private
•    The connectivity
     information about this
     network does not
     need to be exposed
     through the APIs
•    The cross
     communication
     between IaaS and
     DaaS
     implementations
     happens internally
Proposal

•  If there are sufficient members that see a
   situation where we need separate
   implementations, we need to allow for the
   storage connections information to be
   exposed.
•  Add the connectivity and credential
   information to the APIs but make it optional
   to implement (in the common infrastructure
   case).
•  Make it as simple as possible
Proposition: Needed parameters
•  Shared Storage Protocol type
   –  FC, FCoE, iSCSI, NFS, CIFS/SMB/SMB2
•  Shared “device” addressing
   –  IP address/FQDN for IP Storage
   –  FC WWN for FC based storage
•  Share “Name”
   –  Exported Filesystem Name (NFS/CIFS)
   –  Target:LUN (iSCSI, FC, FCoE)
•  Unique Device identification across guest Machines
   –  Provider needs freedom to supply this from their own
      infrastructure (may be opaque to client)
   –  If Provider is also an implementation of CDMI – this would
      be CDMI ObjectID

Weitere ähnliche Inhalte

Was ist angesagt?

Business driven IT design
Business driven IT designBusiness driven IT design
Business driven IT design
Chris Haddad
 

Was ist angesagt? (20)

CloudStack Architecture and Refactor
CloudStack Architecture and RefactorCloudStack Architecture and Refactor
CloudStack Architecture and Refactor
 
SoftLayer Storage Services Overview
SoftLayer Storage Services OverviewSoftLayer Storage Services Overview
SoftLayer Storage Services Overview
 
Integration in the age of DevOps
Integration in the age of DevOpsIntegration in the age of DevOps
Integration in the age of DevOps
 
Getting Started with Apache CloudStack
Getting Started with Apache CloudStackGetting Started with Apache CloudStack
Getting Started with Apache CloudStack
 
HDS and VMware vSphere Virtual Volumes (VVol)
HDS and VMware vSphere Virtual Volumes (VVol) HDS and VMware vSphere Virtual Volumes (VVol)
HDS and VMware vSphere Virtual Volumes (VVol)
 
Introductio to Docker and usage in HPC applications
Introductio to Docker and usage in HPC applicationsIntroductio to Docker and usage in HPC applications
Introductio to Docker and usage in HPC applications
 
WeOp - The Operations Summit
WeOp - The Operations SummitWeOp - The Operations Summit
WeOp - The Operations Summit
 
Business driven IT design
Business driven IT designBusiness driven IT design
Business driven IT design
 
Informix on Docker Hub
Informix on Docker HubInformix on Docker Hub
Informix on Docker Hub
 
OpenStack Atlanta Summit - IBM, SoftLayer, and OpenStack: Present and Future
OpenStack Atlanta Summit - IBM, SoftLayer, and OpenStack: Present and FutureOpenStack Atlanta Summit - IBM, SoftLayer, and OpenStack: Present and Future
OpenStack Atlanta Summit - IBM, SoftLayer, and OpenStack: Present and Future
 
Microsoft NZ Cloud OS Summit: Enabling the Private Cloud
Microsoft NZ Cloud OS Summit: Enabling the Private CloudMicrosoft NZ Cloud OS Summit: Enabling the Private Cloud
Microsoft NZ Cloud OS Summit: Enabling the Private Cloud
 
Build your own private Cloud environment
Build your own private Cloud environmentBuild your own private Cloud environment
Build your own private Cloud environment
 
Realistic Networking in generic multi-site Cloud Deployments
Realistic Networking in generic multi-site Cloud DeploymentsRealistic Networking in generic multi-site Cloud Deployments
Realistic Networking in generic multi-site Cloud Deployments
 
Maintaining a Healthy OpenStack Cloud: What does it take?
Maintaining a Healthy OpenStack Cloud: What does it take?Maintaining a Healthy OpenStack Cloud: What does it take?
Maintaining a Healthy OpenStack Cloud: What does it take?
 
Kube ovn-sandbox-proposal
Kube ovn-sandbox-proposalKube ovn-sandbox-proposal
Kube ovn-sandbox-proposal
 
SoftLayer Bluemix User Summit 2015 Tokyo - Blue Box Breakout Session
SoftLayer Bluemix User Summit 2015 Tokyo - Blue Box Breakout SessionSoftLayer Bluemix User Summit 2015 Tokyo - Blue Box Breakout Session
SoftLayer Bluemix User Summit 2015 Tokyo - Blue Box Breakout Session
 
Helix core on aws webinar
Helix core on aws webinar Helix core on aws webinar
Helix core on aws webinar
 
NephoScale Elastic Networking
NephoScale Elastic NetworkingNephoScale Elastic Networking
NephoScale Elastic Networking
 
How Software-Defined Data Center Technology Is Changing Cloud Computing
How Software-Defined Data Center Technology Is Changing Cloud ComputingHow Software-Defined Data Center Technology Is Changing Cloud Computing
How Software-Defined Data Center Technology Is Changing Cloud Computing
 
Pivotal cloud cache for .net microservices
Pivotal cloud cache for .net microservicesPivotal cloud cache for .net microservices
Pivotal cloud cache for .net microservices
 

Andere mochten auch

Andere mochten auch (6)

rOCCI : An overview of the Ruby OCCI Framework
rOCCI: An overview of the Ruby OCCI FrameworkrOCCI: An overview of the Ruby OCCI Framework
rOCCI : An overview of the Ruby OCCI Framework
 
Cloud standards interoperability: status update on OCCI and CDMI implementations
Cloud standards interoperability: status update on OCCI and CDMI implementationsCloud standards interoperability: status update on OCCI and CDMI implementations
Cloud standards interoperability: status update on OCCI and CDMI implementations
 
OGF Cloud Standards: Current status and ongoing interoperability efforts wi...
OGF Cloud Standards: Current status and ongoing interoperability efforts wi...OGF Cloud Standards: Current status and ongoing interoperability efforts wi...
OGF Cloud Standards: Current status and ongoing interoperability efforts wi...
 
Presentation on cloud computing security issues using HADOOP and HDFS ARCHITE...
Presentation on cloud computing security issues using HADOOP and HDFS ARCHITE...Presentation on cloud computing security issues using HADOOP and HDFS ARCHITE...
Presentation on cloud computing security issues using HADOOP and HDFS ARCHITE...
 
What's Next in Growth? 2016
What's Next in Growth? 2016What's Next in Growth? 2016
What's Next in Growth? 2016
 
32 Ways a Digital Marketing Consultant Can Help Grow Your Business
32 Ways a Digital Marketing Consultant Can Help Grow Your Business32 Ways a Digital Marketing Consultant Can Help Grow Your Business
32 Ways a Digital Marketing Consultant Can Help Grow Your Business
 

Ähnlich wie Cloud computing and storage

1.2 build cloud_fabric_final
1.2 build cloud_fabric_final1.2 build cloud_fabric_final
1.2 build cloud_fabric_final
Paulo Freitas
 
Lxp storage iSCSI Best Practice
Lxp storage iSCSI Best PracticeLxp storage iSCSI Best Practice
Lxp storage iSCSI Best Practice
cmegroz
 
Building a Distributed Block Storage System on Xen
Building a Distributed Block Storage System on XenBuilding a Distributed Block Storage System on Xen
Building a Distributed Block Storage System on Xen
The Linux Foundation
 
Understanding nas (network attached storage)
Understanding nas (network attached storage)Understanding nas (network attached storage)
Understanding nas (network attached storage)
sagaroceanic11
 
Private cloud-webinar
Private cloud-webinarPrivate cloud-webinar
Private cloud-webinar
WSO2
 

Ähnlich wie Cloud computing and storage (20)

Sicurezza integrate nella tua piattaforma Cloud-Native con VMware NSX (Pivota...
Sicurezza integrate nella tua piattaforma Cloud-Native con VMware NSX (Pivota...Sicurezza integrate nella tua piattaforma Cloud-Native con VMware NSX (Pivota...
Sicurezza integrate nella tua piattaforma Cloud-Native con VMware NSX (Pivota...
 
Cloud storage infrastructures
Cloud storage infrastructuresCloud storage infrastructures
Cloud storage infrastructures
 
Storage Area networking and upcoming trends
Storage Area networking and upcoming trendsStorage Area networking and upcoming trends
Storage Area networking and upcoming trends
 
1.2 build cloud_fabric_final
1.2 build cloud_fabric_final1.2 build cloud_fabric_final
1.2 build cloud_fabric_final
 
Lxp storage iSCSI Best Practice
Lxp storage iSCSI Best PracticeLxp storage iSCSI Best Practice
Lxp storage iSCSI Best Practice
 
Por trás da infraestrutura do Cloud - Campus Party 2014
Por trás da infraestrutura do Cloud - Campus Party 2014Por trás da infraestrutura do Cloud - Campus Party 2014
Por trás da infraestrutura do Cloud - Campus Party 2014
 
The Future of SDN in CloudStack by Chiradeep Vittal
The Future of SDN in CloudStack by Chiradeep VittalThe Future of SDN in CloudStack by Chiradeep Vittal
The Future of SDN in CloudStack by Chiradeep Vittal
 
Building a Distributed Block Storage System on Xen
Building a Distributed Block Storage System on XenBuilding a Distributed Block Storage System on Xen
Building a Distributed Block Storage System on Xen
 
Directions for CloudStack Networking
Directions for CloudStack  NetworkingDirections for CloudStack  Networking
Directions for CloudStack Networking
 
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
 
Txlf2012
Txlf2012Txlf2012
Txlf2012
 
The Pendulum Swings Back: Converged and Hyperconverged Environments
The Pendulum Swings Back: Converged and Hyperconverged EnvironmentsThe Pendulum Swings Back: Converged and Hyperconverged Environments
The Pendulum Swings Back: Converged and Hyperconverged Environments
 
Container Networking Deep Dive
Container Networking Deep DiveContainer Networking Deep Dive
Container Networking Deep Dive
 
ServerVirtualization.pptx
ServerVirtualization.pptxServerVirtualization.pptx
ServerVirtualization.pptx
 
Lecture5_ServerVirtualization.pptx
Lecture5_ServerVirtualization.pptxLecture5_ServerVirtualization.pptx
Lecture5_ServerVirtualization.pptx
 
Understanding nas (network attached storage)
Understanding nas (network attached storage)Understanding nas (network attached storage)
Understanding nas (network attached storage)
 
State of the Container Ecosystem
State of the Container EcosystemState of the Container Ecosystem
State of the Container Ecosystem
 
Integration and Interoperation of existing Nexus networks into an ACI Archite...
Integration and Interoperation of existing Nexus networks into an ACI Archite...Integration and Interoperation of existing Nexus networks into an ACI Archite...
Integration and Interoperation of existing Nexus networks into an ACI Archite...
 
Private cloud-webinar
Private cloud-webinarPrivate cloud-webinar
Private cloud-webinar
 
network storage
network storagenetwork storage
network storage
 

Kürzlich hochgeladen

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Kürzlich hochgeladen (20)

Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 

Cloud computing and storage

  • 1. Cloud Computing and Storage Implementation Considerations on APIs Mark Carlson Updated: 3/01/12
  • 2. Various Discussion/Issues •  In a Cloud Computing (IaaS) interface, how much information do you need to expose about the storage connections and fabrics/networks used to connect the virtual machines with their volumes? •  Principals of information hiding and abstraction come into play •  Private clouds and public clouds may have different requirements •  Information includes: –  Interface type •  Block (SAN) •  File (NAS) –  Access Control •  Principals •  End point addressing •  Fabric/VLAN Management
  • 3. Background on Storage Protocols •  For Fibre Channel and FCoE –  A Host Bus Adapter (HBA) or Converged Network Adapter (CNA) is required on the host –  This can be virtualized for each guest using N Port ID Virtualization (NPIV) – special driver on guest •  For IP Storage (iSCSI, NFS, CIFS/SMB/SMB2) –  Only a NIC is required on the host –  Guest OS loads iSCSI initiator driver or remote filesystem client •  Volumes versus disks –  Volumes are shared, persistent over start/stop cycles (SAN/NAS) –  Disks are provided by the Hypervisor from internal filesystem (DAS) •  Cloud provider may use different SAN/NAS technologies and different protocols between physical server hosting a virtual machine and the storage •  For Volumes, Hypervisor may also play a role to "adapt" protocols/ interfaces to match client specification –  e.g. virtual machine 'sees' a volume as a local SCSI device ”mapped" to a raw device by hypervisor which in fact accesses the remote volume using iSCSI etc.
  • 4. Two Basic Models for Implementations •  Rather than continue to add storage concepts and management functions to CIMI, perhaps we should reference an existing cloud storage standard (CDMI) •  If the IaaS API implementation is provided by one vendor and the DaaS API implementation is provided by a different vendor, how do they coordinate the connections? (Slide 4 shows a picture of this) •  If the IaaS API and DaaS API implementations are provided by a common infrastructure (orchestration) can the information that is exposed be abstracted/simplified? (Slide 5 shows a picture of this) •  Does the back end storage network have to be exposed in all cases? •  Or can it’s management be “orchestrated” and the storage network implementation hidden by the API?
  • 5. Separate Infrastructure Implementations •  Because the two infrastructures have separate implementations, there must be information in the respective APIs that allow for Cross- Communication •  The IaaS implementation may be a Client of the DaaS API •  The DaaS implementation may be a Client of the IaaS API
  • 6. Common Implementation Infrastructure •  Because there is a common implementation, the back end storage network can be “hidden” and private •  The connectivity information about this network does not need to be exposed through the APIs •  The cross communication between IaaS and DaaS implementations happens internally
  • 7. Proposal •  If there are sufficient members that see a situation where we need separate implementations, we need to allow for the storage connections information to be exposed. •  Add the connectivity and credential information to the APIs but make it optional to implement (in the common infrastructure case). •  Make it as simple as possible
  • 8. Proposition: Needed parameters •  Shared Storage Protocol type –  FC, FCoE, iSCSI, NFS, CIFS/SMB/SMB2 •  Shared “device” addressing –  IP address/FQDN for IP Storage –  FC WWN for FC based storage •  Share “Name” –  Exported Filesystem Name (NFS/CIFS) –  Target:LUN (iSCSI, FC, FCoE) •  Unique Device identification across guest Machines –  Provider needs freedom to supply this from their own infrastructure (may be opaque to client) –  If Provider is also an implementation of CDMI – this would be CDMI ObjectID