https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-713 DRP 2-D Pipeline <p>The shell script produced by <tt>generateCommands.py</tt> includes some but not all the bootstrap commands.</p> <p>The following YAML file:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> calibBlock: - name: pipe2d_709 bias: id: visit=45677..45691 dark: id: visit=45692..45706 bootstrap: flatId: visit=45742 arcId: visit=45744 detectorMap: id: visit=45743..45746 </pre> </div></div> <p>run with:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> (lsst-scipipe) pprice@tiger2-sumire:/scratch/pprice/pipe2d-709 $ generateCommands.py /projects/HSC/PFS/Subaru/ --calib /tigress/HSC/PFS/Subaru/CALIB-price --rerun price/pipe2d-709 --blocks=pipe2d_709 -j 20 pipe2d-709.yaml pipe2d-709.sh </pre> </div></div> <p>produced the following output:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> #!/bin/sh set -eux constructPfsBias.py /projects/HSC/PFS/Subaru --calib=/tigress/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-709/pipe2d_709/bias --doraise --batch-type=smp --cores=20 --id visit=45677..45691 ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/bias/BIAS/*.fits constructPfsDark.py /projects/HSC/PFS/Subaru --calib=/tigress/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-709/pipe2d_709/dark --doraise --batch-type=smp --cores=20 --id visit=45692..45706 ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/dark/DARK/*.fits ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy --config clobber=True -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/bootstrap/DETECTORMAP/*.fits reduceArc.py /projects/HSC/PFS/Subaru --calib=/tigress/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-709/pipe2d_709/detectorMap --doraise -j20 --id visit=45743..45746 ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy --config clobber=True -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/detectorMap/DETECTORMAP/*.fits </pre> </div></div> <p>Note the ingestion of bootstrap calibs that are not created.</p> PIPE2D-713

Fix 'bootstrap' in generateCommands

Story Normal Won't Fix Won't Fix price price Fri, 12 Feb 2021 17:13:47 +0000 Thu, 11 Mar 2021 21:51:34 +0000 Thu, 11 Mar 2021 21:51:34 +0000 0 1 <p>No, this works perfectly. It's just that I wasn't using the correct format. It wants something like:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> calibBlock: - name: pipe2d_709 bias: id: visit=45677..45691 dark: id: visit=45692..45706 bootstrap: group: - flatId: visit=45742 arcId: visit=45744 detectorMap: id: visit=45743..45746 </pre> </div></div> <p>I'll make another ticket for detecting bad formats.</p> Relates PIPE2D-706 Development Rank 0|02qpt6:508yl0chzzy0000p920zzzzzzzzr Sprint 2DDRP-2021 A 2 2DDRP-2021 A3