Uploaded image for project: 'DRP 2-D Pipeline'
  1. DRP 2-D Pipeline
  2. PIPE2D-713

Fix 'bootstrap' in generateCommands

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Won't Fix (View Workflow)
    • Priority: Normal
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Sprint:
      2DDRP-2021 A 2, 2DDRP-2021 A3

      Description

      The shell script produced by generateCommands.py includes some but not all the bootstrap commands.

      The following YAML file:

      calibBlock:
        -
          name: pipe2d_709
          bias:
            id: visit=45677..45691
          dark:
            id: visit=45692..45706
          bootstrap:
            flatId: visit=45742
            arcId: visit=45744
          detectorMap:
            id: visit=45743..45746
      

      run with:

      (lsst-scipipe) pprice@tiger2-sumire:/scratch/pprice/pipe2d-709 $ generateCommands.py /projects/HSC/PFS/Subaru/ --calib /tigress/HSC/PFS/Subaru/CALIB-price --rerun price/pipe2d-709 --blocks=pipe2d_709 -j 20 pipe2d-709.yaml pipe2d-709.sh
      

      produced the following output:

      #!/bin/sh
      set -eux
      constructPfsBias.py /projects/HSC/PFS/Subaru --calib=/tigress/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-709/pipe2d_709/bias --doraise --batch-type=smp --cores=20 --id visit=45677..45691
      ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/bias/BIAS/*.fits
      constructPfsDark.py /projects/HSC/PFS/Subaru --calib=/tigress/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-709/pipe2d_709/dark --doraise --batch-type=smp --cores=20 --id visit=45692..45706
      ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/dark/DARK/*.fits
      ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy --config clobber=True -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/bootstrap/DETECTORMAP/*.fits
      reduceArc.py /projects/HSC/PFS/Subaru --calib=/tigress/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-709/pipe2d_709/detectorMap --doraise -j20 --id visit=45743..45746
      ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy --config clobber=True -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/detectorMap/DETECTORMAP/*.fits
      

      Note the ingestion of bootstrap calibs that are not created.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                price price
                Reporter:
                price price
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: