---
title: How to launch a Deep Learning VM on Google Cloud
description: How to launch a Deep Learning VM on Google Cloud
url: https://canonical.com/blog/how-to-launch-a-deep-learning-vm-on-google-cloud?format=md
---

1. [Blog](https://canonical.com/blog)
2. Article

---

[Hugo Huang](https://canonical.com/blog/author/hugohuangtao "More about Hugo Huang")

on 11 December 2025

# How to launch a Deep Learning VM on Google Cloud

[accelerator](https://canonical.com/blog/tag/accelerator)
[deep learning](https://canonical.com/blog/tag/deep-learning)
[Google Cloud](https://canonical.com/blog/tag/google-cloud)

Share on:* [Facebook](https://www.facebook.com/sharer/sharer.php?u=https://www.canonical.com/blog/how-to-launch-a-deep-learning-vm-on-google-cloud "Share on Facebook")
* [Twitter](https://twitter.com/share?text=How%20to%20launch%20a%20Deep%20Learning%20VM%20on%20Google%20Cloud&url=https://www.canonical.com/blog/how-to-launch-a-deep-learning-vm-on-google-cloud&hashtags=ubuntu "Share on Twitter")
* [LinkedIn](https://www.linkedin.com/shareArticle?mini=true&url=https://www.canonical.com/blog/how-to-launch-a-deep-learning-vm-on-google-cloud&title=How%20to%20launch%20a%20Deep%20Learning%20VM%20on%20Google%20Cloud "Share on LinkedIn")

---

---

## Newsletter signup

Get the latest Canonical news and updates in your inbox.

Work email:

\*I agree to receive information about Canonical's
products and services.

By submitting this form, I confirm that I have read and agree to [Canonical's Privacy Policy](https://canonical.com/legal/data-privacy).

Sign up

Setting up a local Deep Learning environment can be a headache. Between managing CUDA drivers, resolving Python library conflicts, and ensuring you have enough GPU power, you often spend more time configuring than coding.

Google Cloud and Canonical work together to solve this with [Deep Learning VM Images](https://console.cloud.google.com/marketplace/details/click-to-deploy-images/deeplearning), which use Ubuntu Accelerator Optimized OS as the base OS. These are pre-configured virtual machines optimized for data science and machine learning tasks. They come pre-installed with popular frameworks, such as PyTorch, and the necessary NVIDIA drivers.

In this guide, I’ll walk you through how to launch a Deep Learning VM on GCP using the Console, and how to verify your software stack so you can start training immediately.

# Why use a Deep Learning VM?

* **Pre-installed frameworks:** No need to pip install generic libraries manually.
* **GPU-ready:** NVIDIA drivers are pre-installed and verified.
* **Jupyter integration:** Seamless access to JupyterLab right out of the box.

# How to make a Deep Learning VM in GCP

## Step 1: Navigate to the GCP Marketplace

First, log in to your Google Cloud Console. Instead of creating a generic Compute Engine instance, we want to use a specialized image from the Marketplace.

1. Open the [Google Cloud Console](https://console.cloud.google.com).
2. In the search bar at the top, type **“Deep Learning VM”**.
3. Select the product named **Deep Learning VM** published by Google.

## Step 2: Configure your instance

Once you are on the Marketplace Deep Learning VM listing page, click **Launch**. This will take you to the deployment configuration screen. This is where you define the power behind your model.

Here are the key settings you need to pay attention to:

* **Zone:** Make sure to select a zone that supports the specific GPU you want to use (in my case, I selected the us-central1-f zone).
* **Machine Type:** Choose a CPU/RAM combination that meets your requirements if you don’t need a GPU.
* **GPU Type:** You can add your GPU type, such as the NVIDIA T4, A100, or H100.

*Configuring the VM instance in the Google Cloud Console.*

Once you have made your selections, click **Deploy**.

## Step 3: Connect and verify

After a minute or two, your VM will be deployed. You can find it listed in your **Compute Engine > VM Instances** page.

To access the machine, click the **SSH** button next to your new instance. This opens a terminal window directly in your browser.

## Step 4: Check the software stack & drivers

Now, let’s make sure everything is working under the hood.

### 1. Verify NVIDIA drivers

If you have attached a GPU, the most important check is to ensure the drivers have loaded correctly. Run the following command in your SSH terminal:

nvidia-smi

You should see a table listing your GPU (e.g., A100) and the CUDA version.

### 2. Check pre-installed software

Google’s Deep Learning VMs usually come with PyTorch pre-configured. You can check the installed packages to ensure your favorite libraries are there:

pip show torch

## Conclusion

And that’s it! In just a few minutes, you have built a fully configured Deep Learning environment. You can now start running training scripts directly from the terminal.

**Don’t forget:** Deep Learning VMs with GPUs can be expensive. Remember to **stop** your instance when you aren’t using it to avoid unexpected charges!

[Learn  more about Canonical’s offerings on GCP](https://documentation.ubuntu.com/gcp/google-explanation/canonical-offerings/)

## Read more

* [Ubuntu on Google Cloud](http://ubuntu.com/gcp)
* [Optimizing AI workloads with Ubuntu AI images](https://discourse.ubuntu.com/t/optimizing-ai-workloads-with-ubuntu-ai-images/67099)

#### Related posts

---

[Hugo Huang](https://canonical.com/blog/author/hugohuangtao)

28 May 2026

### [Canonical announces optimized Ubuntu images for TPU virtual machines by Google Cloud](https://canonical.com/blog/canonical-announces-optimized-ubuntu-images-for-tpu-virtual-machines-by-google-cloud)

AI

Ubuntu tech blog

Canonical and Google Cloud announced the availability of certified Ubuntu images for Google’s Cloud TPU Virtual Machines. ...

---

[Hugo Huang](https://canonical.com/blog/author/hugohuangtao)

10 November 2025

### [Canonical announces optimized Ubuntu images for Google Cloud’s Axion N4A Virtual Machines](https://canonical.com/blog/canonical-announces-optimized-ubuntu-images-for-google-clouds-axion-n4a-virtual-machines)

Canonical announcements

Ubuntu tech blog

Today Canonical, the publishers of Ubuntu, and Google Cloud announced the immediate availability of optimized Ubuntu images for the new Axion-based N4A virtual machines (VMs) on Google Compute Engine. ...

---

[Hugo Huang](https://canonical.com/blog/author/hugohuangtao)

27 March 2025

### [Ubuntu Confidential VMs Now Available on Google Cloud A3 with NVIDIA H100 GPUs](https://canonical.com/blog/ubuntu-confidential-vms-now-available-on-google-cloud-a3-with-nvidia-h100-gpus)

AI

Ubuntu tech blog

Organizations are racing to harness the transformative power of AI, but sensitive data privacy and model security remain critical roadblocks. What if you could unlock the full potential of AI without compromising your most valuable assets? Canonical is thrilled to announce the availability of Ubuntu Confidential VMs on Google Cloud’s acce ...
