Ollama

[aaronpowell]

.NET Aspire issue link

microsoft/aspire#4177

Overview

Ollama is a popular tool for running SLM and LLM locally via Docker.

Based on the referenced link, there is a desire to have an official Ollama integration for .NET Aspire. There is an existing OSS project (here) which provides support and the owners are happy for it to be brought into the CT.

API breakdown

var ollama = builder.AddOllama("ollama", modelName: "llama3");

Usage example

No response

Additional context

No response

Help us help you

None