--- title: spark | Blog description: Canonical makes open source secure, reliable and easy to use, providing support for Ubuntu and a portfolio of enterprise-grade technologies. Founded in 2004, Canonical operates globally with team members in over 80 countries. url: https://canonical.com/blog/tag/spark?format=md --- # Blog posts tagged *"spark"* --- [Rob Gibbon](https://canonical.com/blog/author/robgibbon) 28 May 2026 ### [Migrating from Apache Spark 3 to Spark 4](https://canonical.com/blog/migrating-from-apache-spark-3-to-spark-4) Data Platform Ubuntu tech blog The purpose of this guide is to highlight the key differences between Apache Spark 3 and Spark 4, and provide advice on how to plan a migration. Let’s get started. The biggest changes Let’s talk about the biggest changes between Apache Spark 3.x and Spark 4. Scala 2.12 no more First up, there’s no support ... --- [Giulia Lanzafame](https://canonical.com/blog/author/giulialanzafame) 4 September 2025 ### [Implement an enterprise-ready data lakehouse architecture with Spark and Kyuubi](https://canonical.com/blog/implement-an-enterprise-ready-data-lakehouse-architecture-with-spark-and-kyuubi) Data Platform Ubuntu tech blog Here at Canonical we are excited to announce that we have shipped the first release of our solution for enterprise-ready data lakehouses, built on the combination of Apache Spark and Apache Kyuubi. Using our Charmed Apache Kyuubi in integration with Spark, you can deliver a robust, production-level, and open source data lakehouse . Our Ap ... --- [Giulia Lanzafame](https://canonical.com/blog/author/giulialanzafame) 26 June 2025 ### [Accelerating data science with Apache Spark and GPUs](https://canonical.com/blog/accelerating-data-science-with-apache-spark-and-gpus) Data Platform Ubuntu tech blog Apache Spark has always been very well known for distributing computation among multiple nodes using the assistance of partitions, and CPU cores have always performed processing within a single partition.  What’s less widely known is that it is possible to accelerate Spark with GPUs. Harnessing this power in the right situation brings imm ... --- [Giulia Lanzafame](https://canonical.com/blog/author/giulialanzafame) 10 June 2025 ### [Apache Spark security: start with a solid foundation](https://canonical.com/blog/apache-spark-security-start-with-a-solid-foundation) Data Platform Ubuntu tech blog Everyone agrees security matters – yet when it comes to big data analytics with Apache Spark, it’s not just another checkbox. Spark’s open source Java architecture introduces special security concerns that, if neglected, can quietly reveal sensitive information and interrupt vital functions. Unlike standard software, Spark design permits ... --- [Giulia Lanzafame](https://canonical.com/blog/author/giulialanzafame) 10 December 2024 ### [Spark or Hadoop: the best choice for big data teams?](https://canonical.com/blog/spark-or-hadoop-the-best-choice-for-big-data-teams) Data Platform Ubuntu tech blog I always find the Olympics to be an unusual experience. I’m hardly an athletics fanatic, yet I can’t help but get swept up in the spirit of the competition. When the Olympics took place in Paris last summer, I suddenly began rooting for my country in sports I barely knew existed. I would spend random ... --- [Rob Gibbon](https://canonical.com/blog/author/robgibbon) 15 October 2024 ### [Apache Spark 4.0 beta release – try it now](https://canonical.com/blog/apache-spark-4-0-beta-release-try-it-now) Data Platform Ubuntu tech blog Apache Spark is a popular framework for developing distributed, parallel data processing applications. Our solution for Apache Spark on Kubernetes has made significant progress in the past year since we launched, adding support for Apache Iceberg, a new GPU accelerated image using the NVIDIA Spark-RAPIDS plugin, and support for the Volcan ... --- [Rob Gibbon](https://canonical.com/blog/author/robgibbon) 15 July 2024 ### [Deploying and scaling Apache Spark on Amazon AWS EKS](https://canonical.com/blog/deploying-and-scaling-apache-spark-on-amazon-eks) Data Platform Ubuntu tech blog Move over Hadoop, it’s time for Spark on Kubernetes Apache Spark, a framework for parallel distributed data processing, has become a popular choice for building streaming applications, data lake houses and big data extract-transform-load data processing (ETL). It is horizontally scalable, fault-tolerant, and performs well at high scale. H ... --- [Rob Gibbon](https://canonical.com/blog/author/robgibbon) 23 May 2024 ### [Can it play Doom? Running an AI LAN party on a Spark cluster with ViZDoom](https://canonical.com/blog/can-it-play-doom-running-an-ai-lan-party-on-a-spark-cluster-with-vizdoom) AI Ubuntu tech blog It’s all about AI these days, so I decided to try and answer the important question: can you make a Spark cluster run AI agents that play a game of Doom, in a multiplayer LAN party? Although I’m no data scientist, I was able to get this to work and I’ll show you how so ... --- [Rob Gibbon](https://canonical.com/blog/author/robgibbon) 17 October 2023 ### [Why we built a Spark solution for Kubernetes](https://canonical.com/blog/why-we-built-a-spark-solution-for-kubernetes) Data Platform Ubuntu tech blog We’re super excited to announce that we have shipped the first release of our solution for big data – Charmed Spark. Charmed Spark packages a supported distribution of Apache Spark and optimises it for deployment to Kubernetes, which is where most of the industry is moving these days. Reimagining how to work with big data ... --- [Hasmik Zmoyan](https://canonical.com/blog/author/hzmoyan) 21 September 2023 ### [Open source tooling at GITEX Global](https://canonical.com/blog/open-source-tooling-at-gitex-global) AI Ubuntu tech blog Innovate at speed with AI. Stay secure and compliant with Ubuntu Pro Date: 16-20 October 2023 Location: Dubai, UAE Booth: Booth B31, Hall 26, DevSlam Canonical is excited to attend GITEX Global 2023, the largest event in the Middle East. Generative AI, predictive analytics and multi-cloud environments are at the heart of a technological r ... --- [Rob Gibbon](https://canonical.com/blog/author/robgibbon) 10 August 2023 ### [Write a Spark big data job with ChatGPT](https://canonical.com/blog/write-a-spark-big-data-job-with-chatgpt) AI Ubuntu tech blog I’ve read and watched more than a few articles about ChatGPT in the last couple of months. It seems the large language model AI hype machine just can’t stop.  As somebody with a passion for music production, some of the more interesting things I’ve seen included a guy using ChatGPT to build a virtual effect ... --- 1. *Previous page* 2. [1](https://canonical.com/blog/tag/spark?format=md&page=1) 3. [2](https://canonical.com/blog/tag/spark?format=md&page=2) 4. [*Next page*](https://canonical.com/blog/tag/spark?format=md&page=2)