DeepFellow DOCS

Installation

The minimal setup for DeepFellow Architecture is one DeepFellow Server and one instance of DeepFellow Infra. DeepFellow Server and DeepFellow Infra can be installed on the same machine. For efficiency at scale, we recommend installing them on different server machines. Note that you can install more DeepFellow Infras and connect them together into so called Mesh to gain efficiency via load-balancing.

See Architecture for an example layout.

To perform administrative tasks via CLI, see Logging In.

Requirements

Make sure you have the following programs in your system before installing DeepFellow:

DeepFellow Infra manages Docker containers through the Docker socket. Run Docker in rootless mode on the machine that hosts Infra. A Docker daemon running as root grants anyone with access to the socket root access to the host.

Quick Install

Make sure you have DeepFellow CLI on your system:

curl https://deepfellow.ai/install.sh | bash

For a single-command setup with recommended defaults, run:

deepfellow suite install

This command runs the whole installation in a single pass:

  • DeepFellow Infra
    • Starts the ollama service with GPU-accelerated defaults
    • Installs three models: a chat model, an embedding model, and a fast model
  • DeepFellow Server
    • Sets up a Milvus vector database
    • Creates the admin account
    • Creates a "Workspace" organization and a "Default" project
    • Creates an "app" API key for the project
    • Grants the project access to the three models just installed

It prompts for the admin account's name, email, and password. Skip the prompts with:

  • The --admin-name, --admin-email, and --admin-password flags, or
  • The DF_SERVER_ADMIN_NAME, DF_SERVER_ADMIN_EMAIL, and DF_SERVER_ADMIN_PASSWORD environment variables

See DeepFellow Suite for the full list of options.

Continue with DeepFellow Infra and DeepFellow Server to configure each component individually, for example to customize SSL, connect Infras into a Mesh, or choose a different vector database.

We use cookies on our website. We use them to ensure proper functioning of the site and, if you agree, for purposes such as analytics, marketing, and targeting ads.