Quarantine, do not delete
The difference between rejecting a bad record and destroying it is invisible in most pipelines, and it is the difference that matters during an audit.
01 / Category
Operations
Running data platforms day to day: on-call, incidents, cost and the boring parts that matter.
Other categories