[PIPE2D-713] Fix 'bootstrap' in generateCommands Created: 13/Feb/21 Updated: 12/Mar/21 Resolved: 12/Mar/21 |
|
| Status: | Won't Fix |
| Project: | DRP 2-D Pipeline |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Story | Priority: | Normal |
| Reporter: | price | Assignee: | price |
| Resolution: | Won't Fix | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||
| Sprint: | 2DDRP-2021 A 2, 2DDRP-2021 A3 | ||||||||
| Description |
|
The shell script produced by generateCommands.py includes some but not all the bootstrap commands. The following YAML file:
calibBlock:
-
name: pipe2d_709
bias:
id: visit=45677..45691
dark:
id: visit=45692..45706
bootstrap:
flatId: visit=45742
arcId: visit=45744
detectorMap:
id: visit=45743..45746
run with: (lsst-scipipe) pprice@tiger2-sumire:/scratch/pprice/pipe2d-709 $ generateCommands.py /projects/HSC/PFS/Subaru/ --calib /tigress/HSC/PFS/Subaru/CALIB-price --rerun price/pipe2d-709 --blocks=pipe2d_709 -j 20 pipe2d-709.yaml pipe2d-709.sh produced the following output: #!/bin/sh set -eux constructPfsBias.py /projects/HSC/PFS/Subaru --calib=/tigress/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-709/pipe2d_709/bias --doraise --batch-type=smp --cores=20 --id visit=45677..45691 ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/bias/BIAS/*.fits constructPfsDark.py /projects/HSC/PFS/Subaru --calib=/tigress/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-709/pipe2d_709/dark --doraise --batch-type=smp --cores=20 --id visit=45692..45706 ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/dark/DARK/*.fits ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy --config clobber=True -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/bootstrap/DETECTORMAP/*.fits reduceArc.py /projects/HSC/PFS/Subaru --calib=/tigress/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-709/pipe2d_709/detectorMap --doraise -j20 --id visit=45743..45746 ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/tigress/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy --config clobber=True -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-709/pipe2d_709/detectorMap/DETECTORMAP/*.fits Note the ingestion of bootstrap calibs that are not created. |
| Comments |
| Comment by price [ 12/Mar/21 ] |
|
No, this works perfectly. It's just that I wasn't using the correct format. It wants something like:
calibBlock:
-
name: pipe2d_709
bias:
id: visit=45677..45691
dark:
id: visit=45692..45706
bootstrap:
group:
-
flatId: visit=45742
arcId: visit=45744
detectorMap:
id: visit=45743..45746
I'll make another ticket for detecting bad formats. |