Inference

Short answer

Inference is the act of running a trained AI model to produce an output, such as a generated sentence, image, or prediction. Unlike training, which happens once or periodically, inference happens every time a user makes a request. Because each request consumes computing resources, inference costs largely determine the price of offering AI features at scale.