Purpose

Week 6 adds production-grade observability to ClaimFlow AI, but Day 5 and Day 6 prove two different things.

Day 5 proves the system can be evaluated across controlled failure scenarios.

Day 6 proves a single real claim run can be explained end-to-end.

Day 5: Synthetic Packets Eval Dashboard

What It Is

Day 5 persists eval results and displays them in the eval dashboard.

The Week 6 eval uses synthetic gateway packets such as:

• model timeout
• invalid JSON response
• provider error
• cost limit exceeded
• latency spike
• missing trace ID
• missing model version
• prompt regression
• eval score drop

These packets are not normal user claim uploads. They are controlled test cases designed to simulate production AI failure modes.

Why Synthetic Packets Are Needed