Pipelines

Create an id/record for each batch uploaded into the pipeline.
Manage state inside the record
Monitoring/Alerts
How are you measurign the pipeline?
How many units are going through the pipeline?
How long does it take to go through the pipeline?
Can you easily test/validate a single part of the pipeline?

Engineering Data

Configuration Files

Last modified 4yr ago