--- title: The role of secure data storage in fueling AI innovation description: 'There is no AI without data Artificial intelligence is the most exciting technology revolution of recent years. Nvidia, Intel, AMD and others continue to produce faster and faster GPU’s enabling larger models, and higher throughput in decision making processes. Outside of the immediate AI-hype, one area still remains somewhat overlooked: […]' url: https://canonical.com/blog/secure-data-storage-ai?format=md --- 1. [Blog](https://canonical.com/blog) 2. Article --- [Philip Williams](https://canonical.com/blog/author/philwilliams "More about Philip Williams") 11 April 2024 # The role of secure data storage in fueling AI innovation [ceph](https://canonical.com/blog/tag/ceph) [Storage](https://canonical.com/blog/tag/storage) --- Share the article ## ## There is no AI without data Artificial intelligence is the most exciting technology revolution of recent years. Nvidia, Intel, AMD and others continue to produce faster and faster GPU’s enabling larger models, and higher throughput in decision making processes. Outside of the immediate AI-hype, one area still remains somewhat overlooked: AI needs data (find out more [here](https://ubuntu.com/blog/storage-for-ai)). First and foremost, storage systems need to provide high performance access to ever growing datasets, but more importantly they need to ensure that this data is securely stored, not just for the present, but also for the future. There are multiple different types of data used in typical AI systems: * Raw and pre-processed data * Training data * Models * Results All of this data takes time and computational effort to collect, process and output, and as such need to be protected. In some cases, like telemetry data from a self-driving car, this data might never be able to be reproduced.  Even after training data is used to create a model, its value is not diminished; improvements to models require consistent training data sets so that any adjustments can be fairly benchmarked. Raw, pre-processed, training and results data sets can contain personally identifiable information and as such steps need to be taken to ensure that it is stored in a secure fashion. And more than just the moral responsibility of safely storing data, there can be significant penalties associated with data breaches. ## Challenges with securely storing AI data We covered many of the risks associated with securely storing data in this [blog post](https://ubuntu.com/blog/cloud-storage-security). The same risks apply in an AI setting as well. Afterall machine learning is another application that consumes storage resources, albeit sometimes at a much larger scale. AI use cases are relatively new, however the majority of modern storage systems, including the open source solutions like [Ceph](https://ubuntu.com/ceph), have mature features that can be used to mitigate these risks. ### Physical theft thwarted by data at rest encryption Any disk used in a storage system could theoretically be lost due to theft, or when returned for warranty replacement after a failure event. By using at rest encryption, every byte of data stored on a disk, spinning media, or flash, is useless without the cryptographic keys needed to unencrypt the data. Thus protecting sensitive data, or proprietary models created after hours or even days of processing. ### Strict access control to keep out uninvited guests A key tenet of any system design is ensuring that users (real people, or headless accounts) have access only to the resources they need, and that at any time that access can easily be removed. Storage systems like Ceph use both their own access control mechanisms and also integrate with centralised auth systems like LDAP to allow easy access control. ### Eavesdropping defeated by in flight encryption There is nothing worse than someone listening into a conversation that they should not be privy to. The same thing can happen in computer networks too. By employing encryption on all network flows: client to storage, and internal storage system networks no data can be leaked to 3rd parties eavesdropping on the network. ### Recover from ransomware with snapshots and versioning It seems like every week another large enterprise has to disclose a ransomware event, where an unauthorised 3rd party has taken control of their systems and encrypted the data. Not only does this lead to downtime but also the possibility of having to pay a ransom for the decryption key to regain control of their systems and access to their data. AI projects often represent a significant investment of both time and resources, so having an initiative undermined by a ransomware attack could be highly damaging. Using point in time snapshots or versioning of objects can allow an organisation to revert to a previous non-encrypted state, and potentially resume operations sooner. ## Learn more Ceph is one storage solution that can be used to store various AI datasets, and is not only scalable to meet performance and capacity requirements, but also has a number of features to ensure data is stored securely. Find out more about how Ceph solves AI storage challenges: Find out more about Ceph [here](https://ubuntu.com/ceph/). ## Additional resources * [What is Ceph?](https://ubuntu.com/ceph/what-is-ceph) * [Blog : Ceph storage for AI](https://ubuntu.com/blog/storage-for-ai) * [Webinar : AI storage with Ceph](https://ubuntu.com/engage/ai-storage-with-ceph) * [White paper – A guide to software-defined storage for enterprises](https://ubuntu.com/engage/software-defined-storage-for-enterprises) * [Explore Canonical’s AI solutions](https://canonical.com/solutions/ai) ## Sign up for our newsletter Get the latest Canonical news and updates in your inbox. Work email: \*I agree to receive information about Canonical's products and services. By submitting this form, I confirm that I have read and agree to [Canonical's Privacy Policy](https://canonical.com/legal/dataprivacy). Sign up ## Share on --- ## Related posts [### Predict, compare, and reduce costs with our S3 cost calculator](https://canonical.com/blog/predict-compare-and-reduce-costs-with-our-s3-cost-calculator) Previously I have written about how useful public cloud storage can be when starting a new project without knowing how much data you will need to store. However, as datasets... [Philip Williams](https://canonical.com/blog/author/philwilliams) 18 February 2026 [### MicroCeph: why it’s the superior MinIO alternative (and how to use it)](https://canonical.com/blog/microceph-why-its-the-superior-minio-alternative) Recently, the team at MinIO moved the open source project into maintenance mode and will no longer accept any changes. That means that no new features or enhancements will be... [Philip Williams](https://canonical.com/blog/author/philwilliams) 19 December 2025 [### How to reduce data storage costs by up to 50% with Ceph](https://canonical.com/blog/how-to-reduce-data-storage-costs-by-up-to-50-with-ceph) Canonical Ceph with IntelⓇ Quick Assist Technology (QAT) In our last blog post we talked about how you can use Intel® QAT with Canonical Ceph, today we’ll cover why this... [Philip Williams](https://canonical.com/blog/author/philwilliams) 3 February 2025 [### How to utilize CPU offloads to increase storage efficiency](https://canonical.com/blog/how-to-utilize-cpu-offloads-to-increase-storage-efficiency) Canonical Ceph with IntelⓇ Quick Assist Technology (QAT) When storing large amounts of data, the cost ($) to store each gigabyte (GB) is the typical measure used to gauge the... [Philip Williams](https://canonical.com/blog/author/philwilliams) 27 January 2025