Model Context Protocol (MCP)
A protocol for connecting AI systems with external tools and data sources, extending what a model can see and do.
Glossary
A growing glossary of AI concepts and terminology — the building blocks behind LLMs, retrieval, agents, and reasoning that every AI PM should know.
A protocol for connecting AI systems with external tools and data sources, extending what a model can see and do.
A longer-running AI process that uses models, tools, and other systems to take a sequence of actions toward a goal.
Models designed to solve problems through additional inference — such as chain-of-thought — rather than an immediate answer.
Models that can work with multiple types of data — text, images, video, and audio — instead of just text.
Compressing older conversation history into a shorter representation to control context size and inference cost.
The broader practice of assembling and managing everything an AI model needs to produce a useful result — beyond a single prompt.
Combining information retrieval with language generation so an LLM can answer using domain-specific context.
A database that stores vector representations and enables fast similarity search — the retrieval layer behind most RAG systems.
Smaller models built with fewer parameters and resources than an LLM — cheaper, faster, and often good enough.
Reducing the numerical precision of a trained model's weights to cut memory and compute needs at inference time.
Transferring useful behavior from a larger 'teacher' model into a smaller, cheaper 'student' model.
Training a system using feedback about the quality of its actions or outputs, reinforcing what works.
Adapting a pre-trained base model to perform better for a specific task, domain, or response style.
Providing examples inside a prompt so a model understands the expected task or response format — no retraining required.
A training approach where the structure of existing data provides the learning signal, without manual labeling.
A neural network trained to predict the next token in a sequence — the foundation of modern generative AI.
The model architecture — built on attention and feedforward layers — behind modern language models.
The mechanism that lets a language model use surrounding context to interpret a word or token correctly.
A numerical representation of meaning in multidimensional space — the basis for semantic search and retrieval.
The process of breaking input text into smaller units, called tokens, before a language model processes it.
No concepts in this category yet.