--- title: 'Apache Bigtop and Juju: a charming approach to big data' description: Juju users have been enjoying our collection of Big Data charms for over two years. During this time, we’ve learned a lot about what our users want from this complex corner of big software. The Apache Bigtop community distills best practices for installing big data software. They extensively test and package Apache big data projects […] url: https://canonical.com/blog/announcing-charms-for-apache-bigtop-big-data?format=md --- 1. [Blog](https://canonical.com/blog) 2. Article --- [Jorge O. Castro](https://canonical.com/blog/author/jorge "More about Jorge O. Castro") 7 June 2016 # Apache Bigtop and Juju: a charming approach to big data [Juju](https://canonical.com/blog/tag/juju) [planetubuntu](https://canonical.com/blog/tag/planetubuntu) --- Share the article Juju users have been enjoying our collection of Big Data charms for over two years. During this time, we’ve learned a lot about what our users want from this complex corner of big software. The [Apache Bigtop](http://bigtop.apache.org/) community distills best practices for installing big data software. They extensively test and package Apache big data projects to ensure users are able to manage their deployments. This community also provides a foundation for other projects and products to build from. Juju charms distill the operational intelligence needed to run big software such as [Openstack](https://jujucharms.com/openstack), [Kubernetes](https://jujucharms.com/observable-kubernetes), and the Bigtop stack across clouds and architectures. Charms provide an Open Source service-oriented approach to sharing how complex software should be modeled. By modeling Bigtop with charms, we can rapidly deploy and test complex solutions at scale (and across clouds). These tests uncover hard problems, which leads to community collaboration, which leads to making individual Bigtop components better. Bigtop charms allow operators and developers to use, test, and benchmark the Bigtop stack on their laptops, bare metal, or favorite cloud. Every time a Bigtop charm gets better, Bigtop also gets better – and vice versa. Since Juju can repeatedly deploy charms on multiple clouds and architectures, it allows us to quickly identify issues in individual components as well the relationships to other components in the Bigtop stack. Today we are thrilled to announce the Bigtop charms, bundles, and test plans live alongside the Bigtop source! The source layers for the charms for the Apache Hadoop component of Bigtop, along with instructions for building the charms from these layers, can now be found in the Apache Bigtop repository at: The Bigtop repository also includes the hadoop-processing bundle, which encapsulates how to deploy and relate these charms to get a fully-functioning, scalable Hadoop cluster in minutes: Additionally, we included a test plan for the [Cloud Weather Report](https://github.com/juju-solutions/cloud-weather-report) project to run the Bigtop solutions across multiple clouds and report back testing and benchmarking results: Jump in and submit a pull request for any of those charms or bundles. If there is a specific workload that you would like to share with others, please mail the [Bigtop Dev List](http://bigtop.apache.org/mail-lists.html). To see current ideas, take a look at our [Apache Bigtop Charming Effort community wiki](https://github.com/juju-solutions/bigdata-community/wiki/Apache-Bigtop) and/or chime in on the in-progress JIRA bugs: If you already have Juju 2 installed, give the latest Bigtop Hadoop bundle a try with: ``` juju deploy hadoop-processing ``` Or deploy the bundle using the card below: [View details](https://jujucharms.com/hadoop-processing) # hadoop-processing by [bigdata-charmers](https://jujucharms.com/u/bigdata-charmers) * Deploy with the CLI: * [Deploy with Juju](https://demo.jujucharms.com/?deploy-target=bundle/hadoop-processing-3) © [Canonical Ltd](http://www.canonical.com). If you’re new to Juju, follow the [getting started instructions](https://jujucharms.com/docs/devel/getting-started) to start developing on these Bigtop solutions. If you need help with that, we’d be happy to walk you through the process on the [Juju mailing list](https://lists.ubuntu.com/mailman/listinfo/juju). For those of you looking for some face to face training, join us at the next [Juju Charmer Summit](http://summit.juju.solutions/) September 12th-14th, 2016 in Pasadena, CA for charm development, design, and best practices. It’s free for anyone to attend. The Bigtop community is vibrant, collaborative, and friendly — a community we are excited to be a part of to help make Apache big data software better! [Get in touch Interested in running Ubuntu in your organization?](https://ubuntu.com/about/contact-us/form) ## Sign up for our newsletter Get the latest Canonical news and updates in your inbox. Work email: \*I agree to receive information about Canonical's products and services. By submitting this form, I confirm that I have read and agree to [Canonical's Privacy Policy](https://canonical.com/legal/dataprivacy). Sign up ## Share on --- ## Related posts [### Deploy your Spring Boot application to production](https://canonical.com/blog/deploy-spring-application-to-production) In this article we walk through the steps required to deploy a Spring Boot application to production using Juju and Kubernetes. The goal is to showcase the integration of the... [Javier de la Puente](https://canonical.com/blog/author/javierdelapuente) 13 January 2026 [### Cut data center energy costs with bare metal automation](https://canonical.com/blog/cut-data-center-energy-costs-with-bare-metal-automation) Data centers don’t have to be power-hungry monsters. With smart automation using tools like MAAS, you can reduce energy waste and operational costs, and make your... [David Beamonte](https://canonical.com/blog/author/dbeamonte) 26 June 2025 [### The hitchhiker’s guide to infrastructure modernization](https://canonical.com/blog/hitchhikers-guide-to-infrastructure-modernization) One of my favourite authors, Douglas Adams, once said that “we are stuck with technology when what we really want is just stuff that works.” Whilst Adams is right about a lot... [Isobel Kate Maxwell](https://canonical.com/blog/author/iso-maxwell) 24 April 2025 [### Effortless observability for Django applications](https://canonical.com/blog/effortless-observability-for-django-applications) Observability is critical for web operations to ensure that the application is working as expected and to identify any potential issues. However, setting up observability has... [jdkandersson](https://canonical.com/blog/author/jdkandersson) 13 March 2025