MSys’ Storage Experts propose Dynamic Storage Provisioning in Kubernetes at SNIA SDC US 2020

Alpharetta, Georgia (USA), September 30, 2020 – MSys Technologies’ Storage expert Divya and Arun recently proposed a solution that empowers admins to create storage volumes on-demand by leveraging dynamic provisioning at SNIA SDC US 2020. The technical talk focused around Container Storage Interface (CSI) Volume methodology to create storage volume on demand at run time.

Divya, during her talk, demonstrated dynamic provisioning in Kubernetes of Persistent Volume (PV) and PV Claim (PVC). Divya walked the audience through load balancing, which helps manage Container Storage Provider (CSP).

Divya’s proposed solution leverages Kubernetes CSI driver to enable Container Storage Provider (CSP) to perform data management operations on storage resources. It explains how CSI creates and deploys plugins to expose new storage systems with load balancing in Kubernetes without tweaking the core code. It also explains storage class and central storage provided by Nimble Storage Array, to create and manage CSI volume.

Divya enumerates, “my focus was in provisioning storage dynamically to a broad framework orchestrated by Kubernetes. Generally, K8s Pods are mortal, so when a pod dies, the data created inside it is lost forever. We propose a solution, called Dynamic Provisioning to overcome this data loss and to avoid manual creation of Persistent Volume (PV) and PV Claim (PVC).”

Further reflecting on Dynamic Provisioning, Divya added, “Previously, cluster management was a manual process by contacting storage providers to create new storage volumes. Subsequently, Persistent Volume objects were created to represent them in Kubernetes. Dynamic provisioning eliminated the need for cluster managers to pre-provision storage. Instead, it automatically provisions storage when requested by users. Persistent Volume types are implemented as plugins. Kubernetes currently supports many plugins like: AWSElasticBlockStore, AzureDisk, CSI, FlexVolume, NFS, Cinder, Glusterfs”

SC-PV-PVC Relationship

Divya stressed implementing statefulsets in Kubernetes for data-generating applications, which will contain a PVC request. This will contact the Storage Class, which in turn, will provision a PV and the PVC gets bound to this PV, in order to use this storage. This storage will, ultimately, be used by the pod/deployment which requested for the PVC for its data.

SC-PV-PVC Relationship

PVC in Kubernetes Manifest

A Persistent Volume Claim is simply a Volume requirement from the user There are different ways to create and deploy it in Kubernetes. One way is to do it via CLI command : kubectl create -f pvc.yaml Another way is to integrate it along with the Statefulset manifest file.

PVC in Kubernetes Manifest

The future of Volume Provisioning

Speaking on the future of Volume Provisioning, Divya said, “The future of Volume Provisioning in Kubernetes lies in leveraging the key components of Storage Architecture. The applications should be empowered to run independantly while dissociating them from a traditional, monolithic design. And still bring them together in a cluster to perform as ONE with some components even supporting externally, like Volume store is the new vision of all Orchestrators.”

About MSys Technologies

MSys Technologies (Red Herring Asia 100 Winners) is a reliable partner for product engineering services and digital transformation projects for its ISV and Enterprise clientele. We design, develop, and manage modern distributed systems and complex ecosystem integrations. For more, please refer https://www.msystechnologies.com/ 

About SNIA

The Storage Networking Industry Association (SNIA) is a non-profit organization made up of member companies spanning information technology. A globally recognized and trusted authority, SNIA’s mission is to lead the storage industry in developing and promoting vendor-neutral architectures, standards, and educational services that facilitate the efficient management, movement, and security of information. For more, please refer https://www.snia.org/