Secure Ollama Cloud Inference with DeepFellow
Use Ollama Cloud models through DeepFellow's anonymization layer via the native Ollama-compatible API or the OpenAI-compatible API.
Using Ollama Cloud models through DeepFellow is safer than using them directly thanks to our anonymization layer.
You need to have an Ollama Cloud API Key and the "ollama-cloud" service installed — read how to install services in the Infra Web Panel guide.
Native Ollama API
DeepFellow exposes an Ollama-compatible endpoint at /api/chat. Point any Ollama-compatible client at your DeepFellow server, and it will work without any code changes.
curl -X 'POST' \
'https://deepfellow-server-host/api/chat' \
-H 'Authorization: Bearer DEEPFELLOW-PROJECT-API-KEY' \
-H 'Content-Type: application/json' \
-d '{
"model": "gpt-oss:20b",
"messages": [
{
"role": "user",
"content": "Explain how AI works."
}
],
"stream": false
}'from ollama import Client
client = Client(
host="https://deepfellow-server-host",
headers={"Authorization": "Bearer DEEPFELLOW-PROJECT-API-KEY"},
)
response = client.chat(
model="gpt-oss:20b",
messages=[
{"role": "user", "content": "Explain how AI works."}
],
)
print(response.message.content)import { Ollama } from 'ollama';
const client = new Ollama({
host: 'https://deepfellow-server-host',
headers: { Authorization: 'Bearer DEEPFELLOW-PROJECT-API-KEY' }
});
const response = await client.chat({
model: 'gpt-oss:20b',
messages: [{ role: 'user', content: 'Explain how AI works.' }]
});
console.log(response.message.content);OpenAI SDK
DeepFellow also provides an OpenAI-compatible API, so you can use the OpenAI SDK with Ollama Cloud models by pointing it at your DeepFellow server.
from openai import OpenAI
client = OpenAI(
api_key="DEEPFELLOW-PROJECT-API-KEY",
base_url="https://deepfellow-server-host/v1",
)
response = client.chat.completions.create(
model="gpt-oss:20b",
messages=[
{"role": "system", "content": "You are a helpful assistant."},
{
"role": "user",
"content": "Explain how AI works."
}
]
)
print(response.choices[0].message.content)import OpenAI from 'openai';
const openai = new OpenAI({
apiKey: 'DEEPFELLOW-PROJECT-API-KEY',
baseURL: 'https://deepfellow-server-host/v1'
});
const response = await openai.chat.completions.create({
model: 'gpt-oss:20b',
messages: [
{ role: 'system', content: 'You are a helpful assistant.' },
{
role: 'user',
content: 'Explain how AI works.'
}
]
});
console.log(response.choices[0].message.content);We use cookies on our website. We use them to ensure proper functioning of the site and, if you agree, for purposes such as analytics, marketing, and targeting ads.