← Tools

B2B / Engineering

Free tool

RAG Cost Estimator

Break RAG spend into corpus embedding, query embeds, and generation. Useful when retrieval volume dwarfs chat traffic and you need a monthly envelope before building.

  1. 1Fill inputs
  2. 2Run
  3. 3Copy / export

Inputs

Results

Estimate RAG spend

Set corpus size, chunking, and query rate to project monthly $.

How it works

From inputs to a decision

Break RAG spend into corpus embedding, query embeds, and generation. Useful when retrieval volume dwarfs chat traffic and you need a monthly envelope before building.

  1. 01

    Enter document count and average tokens per document.

  2. 02

    Set chunk size, overlap, embedding model, and top-K.

  3. 03

    Add query RPS and generation model.

  4. 04

    Review setup vs monthly embedding and generation totals.

Tips for better results

  • Toggle monthly re-embed only if your corpus refreshes often.
  • Pair with GPU TCO if you plan to self-host the generator.
  • Use the same prompt pack and RPS when comparing models.

Frequently asked questions

What costs does the RAG estimator include?
Corpus embedding (setup and optional monthly re-embed), per-query embedding, and generation input/output from your top-K retrieval pattern.
Do I need a live vector DB for this estimate?
No. The calculator models token volume and list prices only — infrastructure hosting is separate.

Keep measuring in the same cluster — or jump to the next decision.