--- title: 'Kubernetes for Data Science: meet Kubeflow' description: Meet Kubeflow, the machine learning toolkit for Kubernetes. From repeatable ML experiments to deployment of scalable AI applications in one workflow. url: https://canonical.com/blog/kubernetes-for-data-science-meet-kubeflow?format=md --- 1. [Blog](https://canonical.com/blog) 2. Article --- [Rui Vasconcelos](https://canonical.com/blog/author/ruivasconcelos "More about Rui Vasconcelos") 26 May 2020 # Kubernetes for Data Science: meet Kubeflow [AI](https://canonical.com/blog/tag/ai) [Cloud Native](https://canonical.com/blog/tag/cloud-native) [deep learning](https://canonical.com/blog/tag/deep-learning) [Kubeflow](https://canonical.com/blog/tag/kubeflow) [kubernetes](https://canonical.com/blog/tag/kubernetes) [ML](https://canonical.com/blog/tag/ml) [MLOps](https://canonical.com/blog/tag/mlops) --- Share the article #### Deep Learning is set to thrive Data science has exploded as a practice in the past decade and has become an undisputed driver of innovation. The forcing factors behind the rising interest in Machine Learning, a not so new concept, have consolidated and created anunparalleled capacity for Deep Learning, a subset of Artificial Neural Networks with many hidden layers, to thrive in the years to come. Deep Learning enabling factors: * **Computational capacity:** increased exponentially (GPGPU*s* and TPUs) * **Hardware availability:** at low cost (Public & hybrid Clouds, efficient data centres) * **Data availability**: publicly accessible data, low-cost widespread IoT devices * **Open source community:** Libraries – [TensorFlow](https://www.tensorflow.org/), [PyTorch](https://pytorch.org/); Competitions – [Kaggle](https://www.kaggle.com/) #### But it still faces many challenges The common pathway for a data scientist is to start by writing a model on a [Jupyter](https://jupyter.org/) notebook using Python and amazing open source libraries such as [TensorFlow](https://www.tensorflow.org/), [Keras](https://keras.io/) or [PyTorch](https://pytorch.org/). When starting out, we tend to be focused on the end result of the model, but, there is a lot more. While trying to bring the model to the hands of users or to edge devices, things get more complicated. In fact, developing the model itself is only a fairly small portion of the effort required to train, deploy and manage an AI project. There is just a lot of background work to be done: Area = effort The typical Machine Learning workflow can look like this: With these different stages, having diverse requirements, the challenges that arise are threefold: 1. **Composability –** The workflow from data ingestion to model serving, monitoring and logging, includes many components spread across multiple systems making it hard to manage, secure and maintain. 2. **Portability –** At different stages of the ML process, computation requirements change, and so does the hardware in which your software is running – Laptop, on-prem training rig, public cloud. 3. **Scalability –** Computation requirements for AI projects are very dynamic, a training phase is resource intensive, while the inference phase is lightweight and speedy, hence, having elasticity at the infrastructure level is compulsory. The word that best defines these needs is MLOps. ### **Kubernetes can help** [Kubernetes](https://kubernetes.io/) (a.k.a. K8s) is an open source system to automate deployment, scaling, and management of containerized applications widely used in the world of DevOps. For Data Scientists with the above mentioned challenges, this means they can package each step of the process as a container, making it system agnostic (portable) and composable (i.e. modular building blocks), and have Kubernetes handle the deployment and management at scale. However, why not simply use the great powers of Kubernetes? The only problem is, we need to become experts in: – Kubernetes service endpoints – Immutable deployments – Persistent volumes – GPGPU passthrough – Drivers & the GPL – Containers – Cloud APIs – Packaging – DevOps – Scaling – (…) ### **Meet Kubeflow** [Kubeflow](http://kubeflow.org) makes deployments of Machine Learning workflows on Kubernetes simple, portable and scalable. Kubeflow is the machine learning toolkit for Kubernetes. It extends Kubernetes ability to run independent and configurable steps, with machine learning specific frameworks and libraries. And, it is all open source! Run it on your workstation, on-premises training rig, or in any hybrid or public cloud, in a new or already running Kubernetes deployment. Within Kubeflow you will find all the open source tools and frameworks you need: * Jupyter Notebooks * Frameworks for Training: *[PyTorch](https://pytorch.org/)*, *[TensorFlow](https://www.tensorflow.org/)*, [Chainer](https://chainer.org/), [MPI](https://www.kubeflow.org/docs/components/training/mpi/), [MXNet](https://www.kubeflow.org/docs/components/training/mxnet/) * Hyperparameter tuning: [Katib](https://www.kubeflow.org/docs/components/hyperparameter-tuning/hyperparameter/) * Serving: [KFServing](https://www.kubeflow.org/docs/components/serving/kfserving/), [Seldon Core](https://www.seldon.io/tech/products/core/), [BentoML](https://github.com/bentoml/BentoML), [Nvidia Triton](https://developer.nvidia.com/nvidia-triton-inference-server), [TensorFlow Serving](https://www.kubeflow.org/docs/components/serving/tfserving_new/) * Multi-Tenancy:[Multi-user isolation and Identity Access Management (IAM)](https://www.kubeflow.org/docs/components/multi-tenancy/) To know more, visit [ubuntu.com/kubeflow](https://ubuntu.com/kubeflow), or install Kubeflow by following the tutorial [Deploy Kubeflow on Ubuntu, Windows and MacOS](https://ubuntu.com/tutorials/deploy-kubeflow-ubuntu-windows-mac). In upcoming posts, we will dive deeper into the technologies that make Kubeflow, and how you can leverage them to enhance your Data Science capabilities. Subscribe to our Cloud and Server newsletter to stay up to date. ## Sign up for our newsletter Get the latest Canonical news and updates in your inbox. Work email: \*I agree to receive information about Canonical's products and services. By submitting this form, I confirm that I have read and agree to [Canonical's Privacy Policy](https://canonical.com/legal/dataprivacy). Sign up ## Share on --- ## Related posts [### Arduino® VENTUNO™ Q is available for pre-order with Ubuntu pre-installed](https://canonical.com/blog/arduino-ventuno-q-is-available-for-pre-order-with-ubuntu-pre-installed) London, UK – August 25, 2026 – Following our initial collaboration announcement in March 2026, Canonical and Arduino (a subsidiary of Qualcomm Technologies, Inc.) are excited... [Canonical](https://canonical.com/blog/author/canonical) 25 August 2026 [### A look into Ubuntu Core 26: Building a local AI inference appliance in a virtual machine](https://canonical.com/blog/ubuntu-core-26-ai-box) Welcome to this blog series which explores innovative uses of Ubuntu Core. Throughout this series, Canonical’s Engineers will show what you can build with this Core 26 release,... [Gabriel Aguiar Noury](https://canonical.com/blog/author/g-aguiar-noury) 16 June 2026 [### AI at the edge: simplifying infrastructure with Cisco and Canonical](https://canonical.com/blog/ai-at-the-edge-simplifying-infrastructure-with-cisco-and-canonical) Legacy infrastructure was not designed for the requirements of the AI era. While large-scale model training remains centralized in data centers, test-time inference is rapidly... [Pedro Lazzarotto](https://canonical.com/blog/author/pedro-lazzarotto) 11 June 2026 [### What is RDMA over Converged Ethernet (RoCE)?](https://canonical.com/blog/what-is-rdma-over-converged-ethernet-roce) Previous articles walked through RDMA (Remote Direct Memory Access) as a programming model and InfiniBand as the fabric that was built around it. Both led to the same... [Benjamin Ryzman](https://canonical.com/blog/author/benjaminryzman) 9 June 2026