Supported Models
DeepFellow as a framework doesn't have any limitation as to which models you use, so pick from thousands of models of various types – LLM, STT, TTS, txt2img, embedding, decision, etc.
You can also use proprietary models or connect your own, to build exactly what you need.
Install any models you want through supported backends:
- Ollama
- llama.cpp
- vLLM
- SGLang
- Stable Diffusion Next
- Speaches AI
- OpenAI
- Google AI
- Anthropic
- Docker
- Rerank
- Ollama External
- Ollama Cloud
Below there's a list of the most popular specialized open-source models available to use with DeepFellow.
Community offers hundreds of thousands more models that you can also use.
Text, Reasoning, Tool Use
- gpt-oss
- deepseek-r1
- qwen3
- mistral
- gemma3
- llama3.1
- phi4
- polish models: bielik, pllum
- and many more
Embedding
- embeddinggemma
- mxbai-embed-large
- nomic-embed-text
- and many more
Image Generation
For image generation, DeepFellow supports stable diffusion models from HuggingFace and CivitAI.
They can be layered with LORAs (low-rank adapters) to adjust the artistic style of the image being generated.
Read image generation guide to learn more.
Speech-to-Text/Text-to-Speech
- faster-whisper
- Whisper, Qwen3-ASR, Voxtral, and Granite Speech (vllm)
- piper
- Kokoro
- XTTS-v2
- Chatterbox TTS
- VibeVoice
- pyannote/speaker-diarization-3.1
- nvidia/parakeet-tdt-0.6b-v2
- and many more
XTTS-v2, Chatterbox TTS, VibeVoice, pyannote/speaker-diarization-3.1, and nvidia/parakeet-tdt-0.6b-v2 aren't in the default Speaches AI model list. Add them as custom models.
Read our guides to learn more about Speech-to-Text / Text-to-Speech:
Decision
- nimble, nimble-v3
- tev1
- clef, clef-flash
- laya
- kev
- d3
- pplx-decider
- strands-decider
- clef:27b on Ollama Cloud
- and many more
Decision models answer choice, yes/no, and score questions with probabilities instead of text. Decision models on the ollama service need Ollama 0.35.0 or newer. For more information, see Decision Models.
Adding More Models
DeepFellow allows you to install your own custom models or connect any application packaged as a Docker container.
You can install:
- Models available in the Ollama library – use ollama service in DeepFellow Infra.
- Models available in HuggingFace in GGUF format – use llamacpp service in DeepFellow Infra.
- Models available in HuggingFace supported by vLLM, including speech to text models such as Whisper that are not in the vllm catalog – use vllm service in DeepFellow Infra.
- Models available in HuggingFace supported by SGLang, including LLM, reranker, and embedding models – use sglang service in DeepFellow Infra.
- Models from OpenAI/Google – use openai/google service in DeepFellow Infra.
- Any image generation model compatible with stable diffusion (e.g. Civitai, HuggingFace) – use stable-diffusion-next service in DeepFellow Infra.
- Any LoRA compatible with stable diffusion (e.g. HuggingFace, Civitai) – use stable-diffusion-next service in DeepFellow Infra.
- Any docker image – use custom service in DeepFellow Infra.
- Any reranking model – use rerank service in DeepFellow Infra.
- Models hosted on a separate Ollama instance – use ollama-external service in DeepFellow Infra.
- Models hosted on Ollama Cloud – use ollama-cloud service in DeepFellow Infra.
Learn more about Custom Models.
Proprietary Models
We offer an anonymization layer for using commercial models from OpenAI, Google, Anthropic, and Ollama Cloud:
We use cookies on our website. We use them to ensure proper functioning of the site and, if you agree, for purposes such as analytics, marketing, and targeting ads.