---
title: Apache Spark on Kubernetes | Apache Spark
description: Charmed Spark simplifies provisioning and maintenance for Apache Spark
  on Kubernetes on any Public & Private Cloud
url: https://canonical.com/data/spark-on-kubernetes?format=md
---

# Run production-grade Apache Spark® workloads on Kubernetes

```
snap install spark-client
snap install microk8s
microk8s enable dns rbac
microk8s.kubectl create namespace spark
spark-client.service-account-registry create --username spark
 --namespace spark --conf spark.executor.instances=3
spark-client.spark-shell
```

Simplify the provisioning and maintenance of Apache Spark on Kubernetes with Charmed Spark. Run it on any Public or Private Cloud.

---

[Try it now](https://canonical.com/data/spark/docs/latest)
[Contact us](https://canonical.com/contact-us)

---

## The best way to run Spark

Adopting Kubernetes as your Spark cluster resource manager grants you access to the huge community as well as the innovation, scalability and flexibility that Kubernetes has to offer.

* Easy deployment and integration versus legacy Hadoop YARN
* Advanced, pluggable networking options, including Cilium, Calico, Contrail and Flannel
* Support for industry standard authentication protocols including OIDC
* Converge your big data workloads with other applications on the same infrastructure
* Get the same user experience in your lab as you get in the cloud with [MicroK8s](https://canonical.com/microk8s)

---

If you're already using Spark on Kubernetes, Charmed Spark from Canonical offers a drop in replacement for upstream Spark.

New users can get up and running with Charmed Spark on MicroK8s in just a few commands.

---

[Access the docs](https://canonical.com/data/spark/docs/latest)

---

## Charmed Spark features

---

### Native Kubernetes support

Charmed Spark runs on CNCF conformant Kubernetes including AWS EKS and [Canonical Kubernetes](https://ubuntu.com/kubernetes).

---

### Cost-effective

Charmed Spark is free to use on any Kubernetes platform. Pay only for support.

---

### Security

Includes up to 10 years of security maintenance per track with coverage for critical CVEs.

---

### Management tooling

Includes additional tooling for managing Spark on Kubernetes including observability integration, the spark8t toolkit and a Juju operator for Spark History Server.

---

## [Learn more about Charmed Spark ›](https://canonical.com/data/spark)

---

## Frequently asked questions

---

### Is this a drop-in replacement for Apache Spark?

Charmed Spark can be used as a direct replacement for upstream Apache Spark with no or minimal application changes.

---

### Can I run Charmed Spark on any Kubernetes?

You can run Charmed Spark on CNCF conformant Kubernetes.

---

### Can I run Charmed Spark on Hadoop?

Charmed Spark is designed ground up for Kubernetes and does not support deployment to Hadoop.

---

### Do you offer support?

We offer technical support with a choice of 24/7 or weekday SLAs.

---

### Can I use Charmed Spark for free?

Charmed Spark is free to use. Pay only for support.

---

### Can you deliver a complete solution?

We also offer a complete solution for big data based on Canonical Kubernetes and Charmed Ceph.

---

[Request a demo](https://canonical.com/contact-us)

---

## Learn more

### Watch

[Webinar on Spark security for big data operations](https://ubuntu.com/engage/spark-security-webinar)

Uncover best practices and practical steps to Spark security.

---

### Download

[Guide to implementing big data solutions with open source](https://ubuntu.com/engage/enterprise-data-management-big-data)

A security-maintained and fully supported solution for Apache Spark on Kubernetes.

---

### Discover

[Canonical Kubernetes](https://ubuntu.com/kubernetes)

Learn how our our Kubernetes solutions can accelerate data lake deployments in hybrid cloud environments.

---

[Download the reference architecture guide ›](https://ubuntu.com/engage/spark-reference-architecture-for-big-data)

---

Apache®, Apache Spark, Spark®, and the Spark logo are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries.

Close

### Talk to our Apache Spark solution architects

---

Fill in this form and a member of our team will be in touch shortly.