Diagnose context failures

processopen source

Check long-context failures by type: poisoning, distraction, confusion and clash.

Drew Breunig's four failure modes give evals a vocabulary: an error that keeps getting referenced (poisoning), over-long context (distraction), superfluous content (confusion) and conflicting content (clash).