---
title: Blog posts tagged "Model Serving"
description: Canonical makes open source secure, reliable and easy to use, providing
  support for Ubuntu and a portfolio of enterprise-grade technologies. Founded in
  2004, Canonical operates globally with team members in over 80 countries.
url: https://canonical.com/blog/tag/model-serving?format=md
---

# Blog posts tagged "Model Serving"

#### [Understanding disaggregated GenAI model serving with llm-d](https://canonical.com/blog/understanding-disaggregated-genai-model-serving-with-llm-d)

What is llm-d? llm-d is an open source solution for managing high-scale, high-performance Large Language Model (LLM) deployments. LLMs are at the heart of generative AI – so when you chat with ChatGPT or Gemini, you’re talking to an LLM. Simple LLM deployments – where an LLM is deployed to a single server – can

---

AI

#### [What is KFServing?](https://canonical.com/blog/what-is-kfserving)

TL;DR: KFServing is a novel cloud-native multi-framework model serving tool for serverless inference. A bit of history KFServing was born as part of the Kubeflow project, a joint effort between AI/ML industry leaders to standardize machine learning operations on top of Kubernetes. It aims at solving the difficulties of model deployment to

---

AI