| | 100 | |
| | 101 | * {{{queue.py}}} - for queueing up data to process for a given config |
| | 102 | * {{{loader.py}}} - to actually process and load the queued data in the form of ''batches'' |
| | 103 | * {{{pollodm.py}}} - to poll the PSPS ODM to gather information about the process of each batch |
| | 104 | * {{{cleanup.py}}} - to cleanup batches from the datastore, DXLayer and local disk based on batch status acquired by {{{pollodm.py}}} |
| | 105 | * {{{metrics.py}}} - for monitoring processing. Vital statistics are stored in the czartool database |
| | 106 | * {{{plotter.py}}} - for generating density plots of pending data for a given config |
| | 107 | |
| | 108 | More detail about each program follows. |