Inference

Inference is when a trained AI model is used to produce an answer, as opposed to training, when the model is being built.

In practice: Every time you send a prompt, the model runs inference to generate the reply. Inference costs computing power each time, which is why AI tools charge per use, limit free plans and slow down at busy times.

Why it matters when picking a tool

Speed and cost of inference explain many differences between tools and plans: faster models, priority access and higher limits usually cost more. If response time matters for you, for example in live chat, test tools at busy hours.