Skip to main content
Version: latest

Connect Providers

After setting up the basic AI Gateway with the mock backend, you can configure it to work with real AI model providers. This section will guide you through connecting different AI providers to your gateway.

Example Providers

In this getting started guide you'll find quickstart setups to connect to the following providers:

  • OpenAI - Connect to OpenAI's GPT models
  • AWS Bedrock - Access AWS Bedrock's suite of foundation models
  • Azure OpenAI - Access Azure OpenAI's suite of foundation models
tip

To learn how to connect to providers see Connecting to AI Providers and you can view all Supported Providers.

Before You Begin

Before configuring any provider, complete the Basic Usage guide.

Security Best Practices

When configuring AI providers, keep these security considerations in mind:

  • Store credentials securely using Kubernetes secrets
  • Never commit API keys or credentials to version control
  • Regularly rotate your credentials
  • Use the principle of least privilege when setting up access
  • Monitor usage and set up appropriate rate limits

Next Steps

Choose your provider to get started: