PRODUCTION SCENARIO
A publisher fine-tuned a model in Amazon Bedrock to generate headlines. The custom model will serve a few hundred requests a day in unpredictable bursts. The company does not want to pay for idle dedicated capacity.
Which solution will meet these requirements?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: Create a custom model deployment and invoke it for on-demand inference.
Amazon Bedrock offers two ways to run a custom model: Provisioned Throughput, which reserves dedicated capacity billed by the hour, or a custom model deployment for on-demand inference, which bills only for what is used and needs no provisioned compute. Low, bursty traffic favors the on-demand deployment.