Setting up Ollama Cloud with Raycast's new BYOM

Yesterday Raycast announced the return of Bring Your Own Model (BYOM) to Raycast v2, their new default version of Raycast.

I've been using Raycast as my default interface for general AI stuff, switching between the built-in models as I move between use cases.

BYOM now unlocks using my Ollama Cloud subscription inside Raycast. That gets me all of Ollama's open weight models running in their cloud with Zero Data Retention (ZDR) on my interactions.

๐Ÿ‘‰
in v2, Custom Providers, and Bring Your Own Key require a Raycast Pro subscription. (More on that at the end)

Setting it up

Raycast BYOM seems to work exclusively with OpenAI style APIs, which is quite common in the AI tooling industry these days. Luckily Ollama offers exactly that, on both the local running instance and its cloud plans.

โš ๏ธ
Note that the URL for Ollama's OpenAI API (/v1) is different than that of their own default API (/api). Make sure to use the former.


Head to your Raycast settings, open the AI section and scroll down a bit to Custom Providers. Their changelog, docs and marketing calls the whole feature BYOM, in the settings it lives under Custom Providers. The naming consistency could've been better here.

By default no providers are configured, but clicking the Reveal Providers Config button opens the Finder and points you to a YAML file documenting how to set up Custom Providers, with examples for OpenRouter, Vercel AI Gateway and LiteLLM.

I decided to purely set up Ollama, so I observed the template file, deleted it and wrote a minimal one containing only Ollama Cloud. Copy this example into a providers.yaml in this directory, create a new API key on Ollama and add it to the config:

providers:
  - id: ollama_cloud
    name: Ollama Cloud
    base_url: https://ollama.com/v1
    api_keys:
      raycast: YOUR_KEY_FROM_OLLAMA
    models:
      - id: glm-5.3-flash
        name: GLM Flash (latest)
        provider: ollama_cloud
        context: 1000000
        abilities:
          temperature:
            supported: false
          vision:
            supported: true
          system_message:
            supported: true
          tools:
            supported: true
          reasoning_effort:
            supported: true

Custom provider template at ~/.config/raycast/ai/providers.yaml

Adding models

My example above includes glm-5.3-flash (a recent favorite) and aliases it as GLM Flash (latest) for use in Raycast. I like using aliases: I tend to use the latest version of my preferred models anyway, and this way I don't have to remember which version is actually latest. When a new one drops, I just update the model ID in the config and keep selecting GLM Flash (latest) in my Raycast AI chats.

To add more models to the config correctly, head over to Ollama's models page and filter on Cloud models. From there, copy its ID (without the :latest suffix) and pay attention to the supported capabilities and context window.

Check these three properties on the model's page and it them to your config

It's a bit annoying Raycast can't infer this automatically like e.g Hermes, LiteLLM and most tools can, so adapt them accordingly for the model you want to add to the custom provider. For reasoning models, Raycast recommends setting temperature to false and reasoning_effort to true.

The manual claims no restart is needed since Raycast watches the file for changes, but I had to restart Raycast once before the Ollama provider showed up. Your mileage may vary. After that you just start chatting with it like any other Raycast AI model.