All questions
What’s a good fallback strategy when a prompt fails?
On failure, retry with a shorter prompt, then switch models or routes (e.g., retrieval on vs. off). Use deterministic validators to decide when to retry. If still failing, escalate to human with a concise summary of what the model tried. Keep logs so you can fix root causes later.
In practice
Retries should change something meaningful—shorter context or a stricter schema—not just rerun the same prompt.
Where to start
- 1Define clear retry conditions.
- 2Implement a second, simpler prompt path.
- 3Add model routing for stubborn cases.
- 4Capture a failure report for human review.
fallback promptsprompt retrieserror handling LLM