Skip to main content
🚧 These docs are still under construction. Reach out on Discord if you’d like more information on anything about Agent Cloud.
Models attach to an agent to specify the specific model and provider the agent will be using. Models are also used in Datasources to embed data, to learn more about embedding visit the Datasources page.
In short, embedding is the process of turning data of any type into data that agents can process and understand. There are models specific for embedding and these should not be used for agents.
When you first register for the cloud platform you will be prompted to configure a simple OpenAI GPT model, if you’ve already done this then there is no need to configure more unless you intend to use multiple agents.

​
Model Components

Models don’t require much to set up, all that’s required is a valid api key for the selected model to allow the platform to access the selected LLM. The model you choose depends on a variety of factors including token budget, datasource size (for embedding), task complexity and more. maybe more info on model selection?

​
Vendor

Select your vendor, we support a range of model vendors, select one and configure it accordingly. Different vendors require different configuration for their models. Below is our current list of supported vendors:
Setup for an OpenAI model is very straightforward, all that’s required is a valid OpenAI api key.
These are the following agent compatible models we support:
  • gpt-4o-mini. Read more about it here
  • gpt-4o. Read more about it here
  • gpt-4-turbo. Read more about it here
  • gpt-4. Read more about it here
These are the following embedding models we support:
  • text-embedding-3-small. Read more about it here
  • text-embedding-3-large. Read more about it here
  • text-embedding-ada-002. Read more about it here
Need someone to explain to me how azure openai works
Similar to OpenAI, Anthropic setup only requires a valid Anthropic api key.
These are the follwoing agent compatible models we support:
  • claude-3-5-sonnet-20240620. Read more about it here
  • claude-3-sonnet-20240229. Read more about it here
  • claude-3-haiku-2024307. Read more about it here
  • claude-3-opus-20240229. Read more about it here
Need someone to explain how Ollama locally works
FastEmbed is a library provided by Qdrant to allow for easy embedding of data, it requires no api key an you simply select the model to use.
You can read more about FastEmbed here
We support the following embedding models:
  • fast-bge-small-en
  • fast-bge-base-en
  • fast-all-MiniLM-L6-v2
  • fast-multilingual-e5-large
Need someone to explain Groq to me
Google Vertex is an advanced platform and model to use, if you are new to Agent Cloud we reccomend using another model
Google Vertex is a platform that allows you to train your own models using Machine Learning
Lean more about Google Vertex here
⌘I