Data quality and governance

Monitoring

Continuous checking of sources, runs and outputs for failures, anomalies and changes.

In practice

Monitor the data, not just the jobs. That is what catches silent failures.

at import.io

In Import.io managed engagements, every delivery is checked against a written schema contract and the source page before it ships.