Retrieval-Augmented Generation, step by step
Two phases: index once, then retrieve and generate on every question.
- ChunkSplit documents into passages — commonly 200–800 tokens, with a little overlap.
- Embed and storeVector for each chunk, kept in a vector database with its source.
- RetrieveEmbed the question, fetch the nearest chunks.
- RerankOptionally re-score the top 50 down to the top 5 with a stronger model.
- GeneratePut the chunks in the prompt and ask the model to answer only from them.
Where it goes wrong
- Chunks too large — the relevant sentence is diluted
- Chunks too small — the context is missing
- No citations — the answer cannot be checked
Ask the model to say when the retrieved text does not contain the answer. Without that instruction it will guess.
Questions about the Retrieval-Augmented Generation poster
- What’s on the Retrieval-Augmented Generation poster?
- 5 numbered steps, with a full worked run-through. Two phases: index once, then retrieve and generate on every question. Chunk — Split documents into passages — commonly 200–800 tokens, with a little overlap.; Embed and store — Vector for each chunk, kept in a vector database with its source.; Retrieve — Embed the question, fetch the nearest chunks.; Rerank — Optionally re-score the top 50 down to the top 5 with a stronger model.; Generate — Put the chunks in the prompt and ask the model to answer only from them.. Ask the model to say when the retrieved text does not contain the answer. Without that instruction it will guess.
- Who is the Retrieval-Augmented Generation poster for?
- Retrieval-Augmented Generation belongs to the Computing section rather than to a school year, because computing is not something one grade owns. Anyone learning ai & ml can pin it up — a beginner, a student mid-course, or someone revising years later.
- When should you use the Retrieval-Augmented Generation poster?
- Retrieval quality sets the ceiling. A perfect model cannot answer from documents it was never shown. A wall chart earns its place by being glanceable from where the work is happening, so Retrieval-Augmented Generation belongs on the wall where that computing work actually happens, within glancing distance, rather than filed away.
- What other posters go with Retrieval-Augmented Generation?
- Embeddings, Evaluating AI Output and LLM Vocabulary sit alongside Retrieval-Augmented Generation in the Computing section. Printed together they make a wall rather than a single sheet, which is how a reference set actually gets used.EmbeddingsEvaluating AI OutputLLM Vocabulary
- Is the Retrieval-Augmented Generation poster free to download and print?
- Yes. Retrieval-Augmented Generation downloads as a free PDF with no account, no email and no watermark, like everything else in the Computing section. Print as many copies as you like for a home, a classroom, a library or a tutoring group; reselling the file is the only thing the licence rules out.Read the licence
- What size does the Retrieval-Augmented Generation poster print at?
- Retrieval-Augmented Generation is a vector PDF laid out for US Letter, and prints on A4 with Fit to page — the same file, no separate download. Because every mark on it is drawn rather than photographed, it stays sharp enlarged to A3, A2 or A1 at a copy shop. Colour carries emphasis only, so a greyscale print of Retrieval-Augmented Generation loses nothing.Printing guide
Related posters
Charts that sit alongside Retrieval-Augmented Generation on the same wall.
Browse every Computing poster, or start from the full catalogue.