Skip to content

Cloud AI Integration

Backend.AI GO allows you to mix and match local models with cloud-based APIs.

Configure providers from API > Providers. The model picker labels each cloud model with its provider after the provider is enabled and its models are selected.

Cloud providers Cloud providers in dark mode

Why Integrate Cloud APIs?

  • Hybrid Workflow: Handle sensitive data locally with Llama 4, but switch to GPT-5.4 or Claude Opus 4.8 for complex reasoning tasks.

  • Unified Interface: Chat with all your models—local or cloud—in one place. No need to switch tabs or apps.

  • Tools & Agents: Cloud models can use Backend.AI GO's agent system and tools just like local models.

Supported Providers

Backend.AI GO supports a wide range of providers:

  • OpenAI: GPT-5.4, GPT-5.2, GPT-4o (legacy).

  • Anthropic: Claude Opus 4.8, Claude Sonnet 4.6, Claude Haiku 4.5.

  • Google Gemini: Gemini 1.5 Pro, Gemini 1.5 Flash.

  • OpenAI Compatible: Connect to Any service that speaks the OpenAI API dialect (Ollama, LocalAI, DeepSeek, Groq, etc.).

  • Remote vLLM: Connect to your own high-performance inference server.

The Same Model on Two Providers

Nothing stops two providers from offering the same model. You might reach GPT-5.4 through OpenAI directly and through an OpenAI-compatible gateway, and select it on both.

When that happens the model picker shows one row per provider, each labelled with its provider badge, so both stay selectable. Picking either one sends the request to the same model name, and the router decides which of the two providers actually serves it. Choosing the second row does not yet pin the request to the second provider, so treat the two rows as one model you have configured twice rather than as a routing choice.

Security

Your API keys are stored securely in your operating system's native keychain (macOS Keychain, Windows Credential Manager). Backend.AI GO communicates directly with the provider's API; your keys and data are never sent to Lablup servers.