Skip to main content

Cohere

Overview

Cohere provides both LLM capabilities and advanced re-ranking models that can be used to improve the relevance of generated content and reduce inconsistencies from document indexing.

Configuration

To use Cohere, configure it in the Plugin settings page under the AI Gateway section:

FieldDescriptionExample
API KeyYour Cohere API keyyour-cohere-api-key
Base URLOptional, to point at a gatewayhttps://ai-gateway.example.com/cohere
HeadersOptional, e.g. for authentication with gatewayKey: X-Custom-Header
Value: custom-value

For Language Models

Set the default language model:

Language Model: cohere|command-a-03-2025

For Re-ranking

Optionally configure Cohere for re-ranking:

Reranking Model: cohere|rerank-v3.5

Supported Models

Re-ranking:

  • rerank-v3.5 (recommended)

A full list of supported models can be found in the Cohere documentation.