Uploaded image for project: 'DRP 2-D Pipeline'
  1. DRP 2-D Pipeline
  2. PIPE2D-1286

Please make it possible for reduceExposure to parallelise over visits and arms

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done (View Workflow)
    • Priority: Normal
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      reduceExposure.py doesn't parallelise over all the input dataIds, although the processing is initially independent.  Please make it possible to run all visits/spectrographs/arms in parallel at least as far as a possible sequence point at full-focal-plane sky subtraction.  As I believe that there is not yet a need for such sequence points, it would be reasonable to delay that scatter/gather work until it's needed (and then probably we'll do it in gen3 middleware anyway)

        Attachments

          Activity

            People

            • Assignee:
              price price
              Reporter:
              rhl rhl
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: