DeepFellow Infra

Installation

$ deepfellow infra install
💡      Installing DeepFellow Infra.
❓      Provide a DF_NAME for this Infra (infra):
❓      Provide a DF_INFRA_URL for this Infra (http://infra:8086):
❓      Provide a docker network name (deepfellow-infra-net):
❓      Is it safe to print API keys here? [y/n] (n):
💡      Configuration of DF_INFRA_ADMIN_API_KEY
        key required for an admin identify in DeepFellow Infra.
💡      Configuration of DF_INFRA_API_KEY
        key needed to communication between DeepFellow Infra and DeepFellow Server.
💡      Configuration of DF_MESH_KEY
        key needed by other DeepFellow Infra to attach to this DeepFellow Infra and thus extend the Mesh.

❓      Provide an optional Hugging Face Token (hf***bc):
❓      Provide an optional Civitai Token (13***ff):

💡      Generated /home/mchambers/.deepfellow/infra/.env.
💡      Updated /home/johndoe/.deepfellow/config.
💡      Updated /home/johndoe/.deepfellow/secrets.
💡      Saved Docker Compose configuration to /home/johndoe/.deepfellow/infra/compose.yaml
💡      Pulling docker image(s).
✅      DeepFellow Infra installed.
        To start the docker image - `deepfellow infra start`.
        For info about installation - `deepfellow infra info`.

Non-Interactive Installation

For scripting and automation, pass --non-interactive with the required options:

deepfellow --non-interactive infra install

The installer applies default values for all prompts and auto-generates API keys. To customize any value after installation, use deepfellow infra env set. See Envs for the full list of variables.

After Installation

Start

$ deepfellow infra start
💡 Starting DeepFellow Infra
✅ DeepFellow Infra started.

Install First Model

To install a model, you need to install a service first. Type in your terminal:

deepfellow infra service install ollama
deepfellow infra model install ollama gemma3:1b

Install bigger models according to your available VRAM. See Hardware Requirements for model recommendations by VRAM tier.

After successful installation, you will see:

✅      Service ollama installed.
✅      Model gemma3:1b installed.

The ollama service runs locally and needs no API key. To install a remote service, pass the provider API key with the --api-key flag:

deepfellow infra service install claude --api-key ANTHROPIC_API_KEY
deepfellow infra service install google --api-key GEMINI_API_KEY
deepfellow infra service install openai --api-key OPENAI_API_KEY

When you omit --api-key for a service that requires one, the CLI prompts you for the key.

To list the services installed on an Infra instance, run:

deepfellow infra service list

The command shows only installed services. For each one it prints the id, type, instance, description, and whether the backend is downloaded:

$ deepfellow infra service list
💡      id: ollama
        type: ollama
        instance: default
        description: Self-hosted easy to use LLM model runner.
        downloaded: True

When no services are installed, the command prints No services installed.

To target a specific instance, pass --url. Otherwise the command resolves the instance from the DF_INFRA_EXTERNAL_URL environment variable or prompts you for it:

deepfellow infra service list --url http://localhost:8086

To uninstall model you can type:

deepfellow infra model uninstall ollama gemma3:1b

If you have many installed models in one of the services you can simply uninstall the service:

deepfellow infra service uninstall ollama

All models in the service will be uninstalled automatically.

Connect More Infras

You can build an arbitrary topology (called Mesh) with your Infras by connecting them in child-parent relations.

Repeat the previous installation and configuration steps for each machine you dedicate to be DeepFellow Infra.

Then, to connect two Infras, use the following command on one of them:

deepfellow infra connect DF_INFRA_MESH_URL DF_MESH_KEY

To disconnect them:

deepfellow infra disconnect

See Connecting Infras into a Mesh for a worked example that connects a parent and a child Infra.

Configure SSL

You can setup the SSL certificates automatically by typing:

deepfellow infra ssl-on

This command will create and setup a certificate for you for default port 443. You can use your own key file and cert file as well as customize the port and the URL at which Infra with SSL is available:

deepfellow infra ssl-on [SSL-KEY-PATH] [SSL-CERT-PATH] --port [SSL-PORT] --url [SSL-INFRA-URL]

Alternatively, you can expose given DeepFellow Infra through an nginx reverse proxy that handles SSL/TLS termination.

Envs

See Configuration for every variable DeepFellow Infra reads, with its config.json field and default value. See Environment Variables (CLI) to inspect and change them from the command line.

Restart

To apply a configuration change or recover the stack without running two commands, restart DeepFellow Infra. The restart command stops the whole Docker Compose stack, then starts it again.

$ deepfellow infra restart
💡 Restarting DeepFellow Infra
💡 DeepFellow Infra started on http://localhost:8086

To restart an installation in a non-default location, pass --directory (or --dir).

Uninstall

See Uninstall to remove DeepFellow Infra.