PRODUCTION SCENARIO
A Generative AI Engineer maintains a triage app that calls the OpenAI API directly with a key kept in the app's config. Leadership wants to trial Anthropic for the same task, apply per-team rate limits, and stop copying provider keys into every service.
Which change delivers all three goals?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: Create an external model serving endpoint for OpenAI and one for Anthropic
External models are third-party models hosted outside Databricks, and serving them through external model endpoints puts OpenAI and Anthropic behind one governed interface, stores the credentials encrypted in a single place, and picks up AI Gateway rate limiting and usage tracking. Custom model serving endpoints host models you log yourself and are not the type that fronts a third-party API. A secret fixes where the key lives but not per-team limits, and an in-app SDK proxy leaves keys and limits inside every service.