Definition
A Small Language Model (SLM) is a smaller model designed to use fewer parameters and resources than a large language model.
The advantage of a smaller model can include:
- Lower inference cost
- Faster responses
- Easier deployment
- More focused specialization
- Greater suitability for company-specific or task-specific applications
A company may not need a massive general-purpose model for every use case. A smaller model trained or adapted for a narrow task can sometimes provide a more practical solution.
Why It Matters
Quantization and SLMs help you reason about latency, hosting, and inference cost — the levers that decide whether an AI feature is actually affordable to run.