Pipelines

• Create an id/record for each batch uploaded into the pipeline.

• Manage state inside the record

Monitoring/Alerts

• How are you measurign the pipeline?

• How many units are going through the pipeline?

• How long does it take to go through the pipeline?

• Can you easily test/validate a single part of the pipeline?