Plugins

Plugin system enables dynamic control over request inputs and response outputs at each endpoint.

It works by intercepting requests to and responses from an LLM in order to:

• check the request body (e.g., to detect abuse),
• check the request headers (e.g. header manipulations like splitting, injections, smuggling),
• transform data (e.g. anonymize sensitive data),
• change style and tone of the model,
• and more.

Plugins can be layered and composed in order to achieve modular and sequential modification of the request as needed in a FIFO (First In, First Out) manner.

Adding plugins is simple – see our tutorial for creating your own plugins.