OpenAI

To add the model in the UI, follow these steps. The steps create the same model as the Config file tab.

1. Set your API key in the OPENAI_API_KEY environment variable. The UI checks that the variable exists when you save the model.

   export OPENAI_API_KEY='<your-api-key>'

2. Create a configuration file with an empty llm section, and start agentgateway in the same terminal. Without an llm section, the UI does not show the LLM > Models page.

   cat > config.yaml <<'EOF'
   # yaml-language-server: $schema=https://agentgateway.dev/schema/config
   llm:
     models: []
   EOF
   agentgateway -f config.yaml

3. Open LLM > Models, such as http://localhost:15000/ui/llm/models, and click Add model.

4. From the Provider dropdown, select OpenAI.

5. Keep the default openai/* in the Incoming model match field.

6. For the Provider API key, select Env var, and enter OPENAI_API_KEY.

7. For Outgoing model, keep Strip openai/. This option removes the openai/ prefix before the request is forwarded. To send every request to one model instead, select Explicit, and enter the model name. This option sets params.model.

   

   

8. Click Save model.

The UI writes the provider as openai instead of openAI. Agentgateway accepts both values.

Whether the UI can save depends on your storage mode. For more information, see Save changes from the UI.

Review the following example configuration.

# yaml-language-server: $schema=https://agentgateway.dev/schema/config
llm:
  models:
  - name: "openai/*"
    provider: openAI
    params:
      apiKey: "$OPENAI_API_KEY"
    transformation:
      model: llmRequest.model.stripPrefix("openai/")

Review the following table to understand this configuration.