--- title: Ceph storage for Kubernetes description: Opposites attract.  Stateful and stateless. Storage and container management systems are almost polar opposites of each other.  One deals with permanently storing, and protecting data for as long as it’s needed.  The other automatically manages highly dynamic workloads, scaling resources up and down as required.   More organisations are t […] url: https://canonical.com/blog/storage-for-kubernetes?format=md --- 1. [Blog](https://canonical.com/blog) 2. Article --- [Philip Williams](https://canonical.com/blog/author/philwilliams "More about Philip Williams") 19 October 2023 # Ceph storage for Kubernetes [ceph](https://canonical.com/blog/tag/ceph) [Storage](https://canonical.com/blog/tag/storage) --- Share the article ## Opposites attract.  Stateful and stateless. Photo by [Alice Yamamura](https://unsplash.com/@aakemiy?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText) on [Unsplash](https://unsplash.com/photos/iAVTikZXqR0?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText) Storage and container management systems are almost polar opposites of each other.  One deals with permanently storing, and protecting data for as long as it’s needed.  The other automatically manages highly dynamic workloads, scaling resources up and down as required. More organisations are taking a container-first approach to application deployment and management, but the underlying challenge of safely and securely storing data still remains the same.  Any storage system needs to be able to protect against hardware failure and maintain the availability of an organisation’s most important asset – its data. Data growth happens alarmingly quickly, it is estimated that more than 2,500 PetaBytes (PB) of new data is created every day.  Thankfully, this is distributed across many organisations so no one has to deal with this kind of growth on their own, yet.  Scale-out storage systems like Ceph, are a great fit to deal with storage growth in any size of organisation, just by adding more nodes to a cluster you are able to add not just capacity, but also more compute power – so that performance and capacity scale hand in hand. Creating data takes time and effort too, it’s not possible to just recreate some datasets if they happened to be lost – for example, photos or videos, medical records or financial transactions.  The significance of losses might be different across datasets – losing a photo is less critical than the loss of a credit to your bank account.  There are also regulatory requirements to consider as well, medical data needs to be permanently preserved for as long as 100 years. ## How do we bring the two together? A container management system such as Kubernetes uses the Container Storage Interface (CSI) to integrate with external storage systems for their block and file based storage needs. This provides two interfaces for interaction: * A **control plane** that is used for storage management  – specifically the creation, allocation and reclamation of volumes. * A **data plane** used for high speed parallel access to data stored in the storage system. The CSI also implements storage classes so that underlying storage types can be mapped to classes based on the performance capabilities – for certain workloads it might be important that the data is stored on the fastest SSD based disks, but for others, like an archive, the data could be stored on less expensive NL-SAS or SATA capacity oriented disks. ## Ceph: a secure, scaleable and trusted storage solution From research organisations such as the Wellcome Sanger Institute and CERN to global telecom giants like Deutsche Telekom and BT, thousands of organisations the world over have turned to Ceph to provide reliable and scalable storage for their needs. Alongside the scaling and resiliency features of Ceph another significant advantage is that it provides interfaces for multiple storage types within a single cluster, eliminating the need for multiple storage solutions or specialised hardware, thus reducing management overheads. ## Try out Ceph for Kubernetes If you want to quickly test a robust production-ready storage solution that integrates well with Kubernetes, try MicroCeph. Microk8s is the easiest and fastest way to get Kubernetes up and running. You can experiment with the latest upstream features and toggle services on and off and seamlessly move your work from dev to production. In the latest MicroK8s release (1.28), the rook-ceph addon was included to allow for easy integration with an external Ceph cluster.  In this [guide](https://microk8s.io/docs/how-to-ceph) we deploy a 3 node [MicroCeph](https://snapcraft.io/microceph) cluster, deploy [MicroK8s](https://snapcraft.io/microk8s), and then integrate the two to create a powerful compute and storage cluster. ## Learn more In this [whitepaper](https://ubuntu.com/engage/introduction-to-cloud-native-storage), we discuss using Ceph in a containerised environment in much more detail.  You can learn about the different types of storage systems, the different access methods used to store and retrieve data, the way that data can be protected, more detail on how the two systems are interconnected, and a detailed introduction to Ceph. ## Additional resources * [What is Ceph >](https://ubuntu.com/ceph/what-is-ceph) * [Webinar – Reduce your storage costs with cloud adjacent storage >](https://ubuntu.com/engage/cloud-adjacent-storage) * [Webinar – Reduce complexity & increase storage efficiency with multi-protocol Ceph >](https://ubuntu.com/engage/multi-protocol-storage) * [White paper – Cloud storage cost optimisation >](https://ubuntu.com/engage/optimize-cloud-storage-costs) * [White paper – A guide to software-defined storage for enterprises >](https://ubuntu.com/engage/software-defined-storage-for-enterprises) ## Sign up for our newsletter Get the latest Canonical news and updates in your inbox. Work email: \*I agree to receive information about Canonical's products and services. By submitting this form, I confirm that I have read and agree to [Canonical's Privacy Policy](https://canonical.com/legal/dataprivacy). Sign up ## Share on --- ## Related posts [### Predict, compare, and reduce costs with our S3 cost calculator](https://canonical.com/blog/predict-compare-and-reduce-costs-with-our-s3-cost-calculator) Previously I have written about how useful public cloud storage can be when starting a new project without knowing how much data you will need to store. However, as datasets... [Philip Williams](https://canonical.com/blog/author/philwilliams) 18 February 2026 [### MicroCeph: why it’s the superior MinIO alternative (and how to use it)](https://canonical.com/blog/microceph-why-its-the-superior-minio-alternative) Recently, the team at MinIO moved the open source project into maintenance mode and will no longer accept any changes. That means that no new features or enhancements will be... [Philip Williams](https://canonical.com/blog/author/philwilliams) 19 December 2025 [### How to reduce data storage costs by up to 50% with Ceph](https://canonical.com/blog/how-to-reduce-data-storage-costs-by-up-to-50-with-ceph) Canonical Ceph with IntelⓇ Quick Assist Technology (QAT) In our last blog post we talked about how you can use Intel® QAT with Canonical Ceph, today we’ll cover why this... [Philip Williams](https://canonical.com/blog/author/philwilliams) 3 February 2025 [### How to utilize CPU offloads to increase storage efficiency](https://canonical.com/blog/how-to-utilize-cpu-offloads-to-increase-storage-efficiency) Canonical Ceph with IntelⓇ Quick Assist Technology (QAT) When storing large amounts of data, the cost ($) to store each gigabyte (GB) is the typical measure used to gauge the... [Philip Williams](https://canonical.com/blog/author/philwilliams) 27 January 2025