Installation
The minimal setup for DeepFellow Architecture is one DeepFellow Server and one instance of DeepFellow Infra. DeepFellow Server and DeepFellow Infra can be installed on the same machine. For efficiency at scale, we recommend installing them on different server machines. Note that you can install more DeepFellow Infras and connect them together into so called Mesh to gain efficiency via load-balancing.
See Architecture for an example layout.
To perform administrative tasks via CLI, see Logging In.
Requirements
Make sure you have the following programs in your system before installing DeepFellow:
- Git - version 2.30.0 or newer
- Python 3 – version 3.10 or newer
- Docker engine - version 28.0.0 or newer
- Python package manager – one of the following: uv, pipx, pip3 / pip
DeepFellow Infra manages Docker containers through the Docker socket. Run Docker in rootless mode on the machine that hosts Infra. A Docker daemon running as root grants anyone with access to the socket root access to the host.
Quick Install
Make sure you have DeepFellow CLI on your system:
curl https://deepfellow.ai/install.sh | bashFor a single-command setup with recommended defaults, run:
deepfellow suite installThis command runs the whole installation in a single pass:
- DeepFellow Infra
- Starts the
ollamaservice with GPU-accelerated defaults - Installs three models: a chat model, an embedding model, and a fast model
- Starts the
- DeepFellow Server
- Sets up a Milvus vector database
- Creates the admin account
- Creates a "Workspace" organization and a "Default" project
- Creates an "app" API key for the project
- Grants the project access to the three models just installed
It prompts for the admin account's name, email, and password. Skip the prompts with:
- The
--admin-name,--admin-email, and--admin-passwordflags, or - The
DF_SERVER_ADMIN_NAME,DF_SERVER_ADMIN_EMAIL, andDF_SERVER_ADMIN_PASSWORDenvironment variables
See DeepFellow Suite for the full list of options.
Continue with DeepFellow Infra and DeepFellow Server to configure each component individually, for example to customize SSL, connect Infras into a Mesh, or choose a different vector database.
We use cookies on our website. We use them to ensure proper functioning of the site and, if you agree, for purposes such as analytics, marketing, and targeting ads.