Simulation run on this device. Scenario values are not sent anywhere — the engine is fully local.
agents studio · pro
RAG Failure Debugger
Isolate the failing stage with staged captures from a real-style pipeline.
Was it retrieval, reranking, or generation that failed?
Engine 1.0.0 · studio
- Retrieval cover
- 29%
- Grounding
- 100%
- Ungrounded terms
- 0
- Diagnosis
- Retrieval miss
- highRetrieval miss
Only 2/7 query terms appear in any chunk — the right document was never retrieved. Fix chunking/embedding or add hybrid search before touching the prompt.
Diagnose the earliest failing stage: retrieval, then rerank, then generation. Fixing the prompt cannot repair a miss.
Method
- Measures query→chunk term coverage (retrieval) and answer-term grounding against the retrieved chunks.
- Diagnoses the earliest failing stage: retrieval miss before generation drift. A prompt fix cannot repair a retrieval miss.