Skip to main content
Agent Platform supports a wide range of AI models—platform-hosted, open-source, externally integrated, and third-party. Choose based on your use case: agentic workflows, real-time voice, or background processing.

Models for Agentic Apps and Agents

External Models

Agentic Apps support Agent and Supervisor orchestration with models from these providers:

Open-Source Models

Agentic Apps support select open-source models from these providers:

Real-Time Voice Models

Real-Time Voice is available only with the following models:

Custom Model Integration

To use a custom third-party model in Agentic Apps, it must meet two requirements:

Tool Calling Support (Mandatory)

The model must natively support Tool Calling. Models without this capability cannot be used in Agentic Apps. If supported, enable Tool Calling explicitly during model configuration. Enable Tool Calling Learn how to enable model features

Compatible API Structure

The request and response structure must follow either:
  • Anthropic – Messages API
  • OpenAI – Chat Completions API
Request/Response Structures For setup steps, see Add an External Model Using API Integration.

Platform-Hosted Open-Source Models

The platform hosts 30+ curated open-source models, available as a service and optimizable before deployment.

Structured Output

Platform-hosted models can produce structured JSON responses, making outputs consistent and easy to parse. Supported optimization techniques: No optimization or vLLM only.
CT2-optimized, fine-tuned, Hugging Face imported, and locally imported models do not support structured output.

External Models for Easy Integration

With Easy Integration, connect to external model providers without any infrastructure setup—just authenticate and start using models in flows, tools, or agents.