Your submission was sent successfully! Close

Thank you for signing up for our newsletter!
In these regular emails you will find the latest updates from Canonical and upcoming events where you can meet our team.Close

Thank you for contacting our team. We will be in touch shortly.Close

  1. Blog
  2. Article

on 12 September 2023

Faster AI application development with Canonical and NVIDIA AI Enterprise

Ubuntu KVM support comes to NVIDIA AI Enterprise

Canonical continues to expand its collaboration with NVIDIA by providing Ubuntu KVM Hypervisor support with NVIDIA AI Enterprise 4.0 — which is generally available starting today. Organisations using GPU virtualisation on Ubuntu can look forward to a seamless migration to the new NVIDIA AI Enterprise licence. 

NVIDIA AI Enterprise 4.0

NVIDIA AI Enterprise 4.0 is now supported  across workstations, data centres, and cloud deployments, with updates including:

  • NVIDIA NeMo for building, customising, and deploying generative AI models, 
  • two new AI workflows for accelerating generative AI use cases, 
  • enhanced manageability with the NVIDIA Triton Management Service for automating deployment at scale, and
  • enterprise-grade support.  

NVIDIA AI Enterprise provides an end-to-end, secure, cloud-native software platform for developing and deploying AI applications, helping organisations solve new challenges while increasing operational efficiency. The new NVIDIA Triton Management Service streamlines and efficiently manages model deployment, and NeMo enables the building, customisation, and deployment of complex large language models to offer enterprises an easy, cost-effective, and fast way to adopt generative AI.

Ubuntu KVM and NVIDIA AI Enterprise 4.0

Data scientists and developers leveraging NVIDIA frameworks and workflows with Ubuntu across the board now have a single platform to rapidly develop AI applications on the latest generation NVIDIA GPUs.  With support for GPU virtualisation coming to Ubuntu KVM, organisations can then rapidly deploy the same models utilising existing on-prem or cloud infrastructure to power AI workloads. 

Fig. Ubuntu KVM and NVIDIA AI Enterprise 4.0

GPU virtualisation is an important tool that makes it possible to share a single GPU across multiple virtual machines (VMs). This leads to better GPU resource utilisation, as well as significant cost savings directly passed to macro-impacted IT budgets. The NVIDIA virtual GPU (vGPU) solution has traditionally been supported with Ubuntu KVM. Canonical and NVIDIA have now validated NVIDIA’s virtualisation solution to enable GPU passthrough to NVIDIA AI Enterprise Containers and VMs with minimal performance impact. Once customers and users point to a new NVIDIA AI Enterprise licence server, usage should continue with no disruption.

Using NVIDIA AI Enterprise in conjunction with Ubuntu KVM, enterprises can now scale deployments across multi- and hybrid-cloud deployments.

Security and support — for your full deep learning stack

Ubuntu is the first choice open-source operating system for the majority of AI developers, and Canonical is proud to back the innovators at NVIDIA by providing an optimised, secure operating system. Through NVIDIA AI Enterprise 4.0, NVIDIA customers automatically have access to Canonical’s security promise beyond the operating system, keeping the open source content in NVIDIA containers secure. With NVIDIA AI Enterprise, organisations aiming to deploy the latest AI innovations can now get enterprise-grade support from NVIDIA. Customers can, additionally, get support from Canonical for their open source infrastructure software, including popular upstream projects including Kubernetes and Kubeflow. 

Speaking about these solutions, Maciej Mazur, AI/ML Principal at Canonical, said:  “The certification of Ubuntu KVM with NVIDIA AI Enterprise provides customers with all the necessary ingredients for an end-to-end solution: containers for training the latest LLMs from NVIDIA, as well as , enterprise-grade support for infrastructure software from Canonical.” 

Getting started is easy (and free). You can rest assured that Canonical experts are available to help if required.

Get started with Canonical open source solutions with NVIDIA AI Enterprise 

Talk to us

Related posts

Shashank Balashankar
19 March 2024

Canonical collaborates with NVIDIA to simplify enterprise AI deployments with NVIDIA BlueField-3 operating an optimised, Ubuntu-based Linux OS 

Networking Article

The NVIDIA BlueField-3 networking platform – powering the latest data processing units (DPUs) and SuperNICs, and transforming data centre performance and efficiency – runs BlueField OS, an optimised Linux operating system (OS) derived from Ubuntu. With Ubuntu’s signature maintenance and support guarantees, the comprehensive Ubuntu Pro sof ...

Felicia Jia
29 February 2024

Join Canonical at 2024 GTC AI Conference

AI Article

As a key technology partner with NVIDIA, Canonical is proud to showcase our joint solutions at NVIDIA GTC again. Join us in person at NVIDIA GTC on March 18-21, 2024 to explore what’s next in AI and accelerated computing. We will be at booth 1601 in the MLOps & LLMOps Pavilion, demonstrating how open source ...

Hasmik Zmoyan
25 January 2024

Ubuntu AI podcast: AI for day-to-day tasks

AI Ubuntu

Welcome to Ubuntu AI podcast, where we talk about AI with the industry leaders. This episode was recorded in Riga, during the Ubuntu Summit 2023. We’re talking about the implementation of AI solutions for day-to-day tasks with the CEO of Nextcloud Frank Karlitschek. AI usage in Nextcloud We are talking about the AI usage at ...