—  demo · rag quality lab  —

The same question. Two very different answers.

Most RAG failures are retrieval failures. Below, the same query runs through a naive keyword retriever and a properly designed pipeline — chunks, scores, reranking, citations, and an uncertainty flag where the answer has caveats.

Pick a question
query
What does our refund policy say for annual plans?
Naive RAG
keyword match · top-3
Retrieved chunks
  • Refund Policy· Monthly plans
    0.42

    Customers on monthly plans may request a full refund within 7 days of the most recent charge. Refunds are issued to the original payment method within 5 business days.

  • Cancellation· Process
    0.31

    Customers may cancel from the billing dashboard at any time. Monthly plans end at the close of the current billing period. Annual plans remain active through the end of the paid term unless cancelled within the 30-day refund window.

  • Refund Policy· Enterprise contracts
    0.22

    Refunds for enterprise contracts are governed by the Master Services Agreement and require Finance approval. Standard MSA terms allow termination for material breach with a 30-day cure period.

Final answer

Customers can request a refund within 7 days of the charge. Refunds are processed to the original payment method.

no citationsmissed key chunksno edge cases
Designed RAG
embed → rerank → cite
Retrieved chunks (top-4)
  • Refund Policy· Annual plans
    0.74

    Annual plans are refundable on a pro-rated basis within the first 30 days of the billing cycle. After 30 days, annual plans are non-refundable except where required by law. Customers downgrading mid-cycle receive credit toward the next renewal rather than a refund.

  • Cancellation· Process
    0.69

    Customers may cancel from the billing dashboard at any time. Monthly plans end at the close of the current billing period. Annual plans remain active through the end of the paid term unless cancelled within the 30-day refund window.

  • Refund Policy· Enterprise contracts
    0.61

    Refunds for enterprise contracts are governed by the Master Services Agreement and require Finance approval. Standard MSA terms allow termination for material breach with a 30-day cure period.

  • Refund Policy· Monthly plans
    0.48

    Customers on monthly plans may request a full refund within 7 days of the most recent charge. Refunds are issued to the original payment method within 5 business days.

Reranked
  • Refund Policy· Annual plans
    0.96

    Annual plans are refundable on a pro-rated basis within the first 30 days of the billing cycle. After 30 days, annual plans are non-refundable except where required by law. Customers downgrading mid-cycle receive credit toward the next renewal rather than a refund.

  • Cancellation· Process
    0.88

    Customers may cancel from the billing dashboard at any time. Monthly plans end at the close of the current billing period. Annual plans remain active through the end of the paid term unless cancelled within the 30-day refund window.

  • Refund Policy· Enterprise contracts
    0.71

    Refunds for enterprise contracts are governed by the Master Services Agreement and require Finance approval. Standard MSA terms allow termination for material breach with a 30-day cure period.

Final answer with citations

Annual plans are refundable on a pro-rated basis within the first 30 days of the billing cycle. 1

After 30 days, annual plans are non-refundable except where required by law; mid-cycle downgrades convert to credit on the next renewal rather than a refund. 1

Enterprise contracts follow the MSA and may have different terms — route those requests through Finance. 3

uncertainty flag

Edge case: annual plans purchased through a reseller or marketplace may have different refund terms — confirm with the account team before quoting policy.

cited per claimrerankedcaveats surfaced

What separates the good retriever.

  • Retrieves the right chunks

    Embeds query and corpus into the same space; pulls semantically related sections, not just keyword overlaps.

  • Reranks before answering

    A second model scores the candidates against the original question, dropping near-misses that would dilute the answer.

  • Cites every claim

    Each sentence in the answer points back to a specific document section, so the user can verify rather than trust.

  • Flags its uncertainty

    When the corpus has caveats, edge cases, or contracts that override defaults, the system says so instead of guessing.