Skip to main content

Cohere

Overview​

Cohere provides both LLM capabilities and advanced re-ranking models that can be used to improve the relevance of generated content and reduce inconsistencies from document indexing.

Configuration​

To use Cohere, configure it in the Config Manager under the AI Gateway section:

ai:
  providers:
    cohere:
      apiKey: your-cohere-api-key
      baseURL: https://ai-gateway.example.com/cohere # Optional, to point at a gateway
      headers: # Optional, e.g. for authentication with gateway
        - key: X-Custom-Header
          value: custom-value

For Language Models​

Set the default language model:

ai:
  models:
    languageModel: cohere|command-a-03-2025

For Re-ranking​

Optionally configure Cohere for re-ranking:

ai:
  models:
    rerankingModel: cohere|rerank-v3.5

Supported Models​

Re-ranking:

  • rerank-v3.5 (recommended)

A full list of supported models can be found in the Cohere documentation.