---
title: Blog posts tagged "LLMs"
description: Canonical makes open source secure, reliable and easy to use, providing
  support for Ubuntu and a portfolio of enterprise-grade technologies. Founded in
  2004, Canonical operates globally with team members in over 80 countries.
url: https://canonical.com/blog/tag/llms?format=md
---

# Blog posts tagged "LLMs"

#### [Understanding disaggregated GenAI model serving with llm-d](https://canonical.com/blog/understanding-disaggregated-genai-model-serving-with-llm-d)

What is llm-d? llm-d is an open source solution for managing high-scale, high-performance Large Language Model (LLM) deployments. LLMs are at the heart of generative AI – so when you chat with ChatGPT or Gemini, you’re talking to an LLM. Simple LLM deployments – where an LLM is deployed to a single server – can

---

AI

#### [Why we brought hardware-optimized GenAI inference to Ubuntu](https://canonical.com/blog/genai-inference)

On October 23rd, we announced the beta availability of silicon-optimized AI models in Ubuntu. Developers can locally install DeepSeek R1 and Qwen 2.5 VL with a single command, benefiting from maximized hardware performance and automated dependency management. Application developers can access the local API of a quantized generative AI (Ge

---

AI