https://twitter.com/AdrienBrault/status/1734922401358483894

llm-mistral-medium.md

Here is how to use @MistralAI experimental Mistral-medium using @simonw's https://llm.datasette.io CLI:

1. Edit the OpenAI-compatible models configuration file:

vi "$(dirname "$(llm logs path)")"/extra-openai-models.yaml

2. Add the following and save:

- model_id: mistral-tiny
  model_name: mistral-tiny
  api_base: "https://api.mistral.ai/v1"
  api_key_name: mistral
- model_id: mistral-small
  model_name: mistral-small
  api_base: "https://api.mistral.ai/v1"
  api_key_name: mistral
- model_id: mistral-medium
  model_name: mistral-medium
  api_base: "https://api.mistral.ai/v1"
  api_key_name: mistral

3. Create a mistral API Key https://console.mistral.ai/users/api-keys/

4. Configure LLM with the api key:

llm keys set mistral

5. Profit:

llm -m mistral-medium "Hello"

there's a plugin for that https://github.com/simonw/llm-mistral