AI & Technology

What Is Inference in AI?

In AI, inference is the stage where a trained model is used to make predictions or generate output from new input — for example, answering a question or classifying an image. Training teaches the model; inference is the model being put to use, and it happens every time someone sends a request.

Training vs. Inference

Training is usually done once or occasionally and requires large amounts of computing power. Inference happens continuously and at scale, so its speed and cost per request matter greatly for AI products.

Inference Cost

For language models, inference cost is often measured per token processed and generated.

🧮 Calculate It Yourself

Put Inference (AI) into practice with these free calculators — no sign-up, nothing stored.

📐 ROI Calculator Return on investment, net gain, and annualized ROI — any currency. Calculate → 📐 Unit Converter Convert length, weight, and temperature between metric and imperial units. Calculate →

🔗 Related Terms

Token (AI) Training Data Model Parameters (AI) Large Language Model (LLM)

More AI & Technology Terms

📖 Browse all glossary terms or explore all free calculators.

Last updated: September 29, 2026. This definition is for general educational purposes only. It is not financial, investment, tax, legal, or medical advice, and it does not recommend any product or course of action. For decisions about your own situation, consult a qualified professional.