[PIPE2D-1220] Create fiberProfiles from 2023 Apr/May engineering data Created: 13/May/23  Updated: 27/May/23  Resolved: 27/May/23

Status: Done
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Story Priority: Normal
Reporter: price Assignee: price
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

C


Attachments: File pipe2d-1216.ipynb     PDF File profiles-b1.pdf     PDF File profiles-b3.pdf     PDF File profiles-m1.pdf     PDF File profiles-m3.pdf     PDF File profiles-r1.pdf     PDF File profiles-r3.pdf    

 Description   

During the 2023 Apr/May engineering run, we obtained data from which to generate fiber profiles for b/r 1/3. Some limited data was also acquired for m 1/3. Build fiber profiles and install in a new calib repository (PIPE2D-1216).



 Comments   
Comment by price [ 17/May/23 ]

From my notes:

May as well rebuild the fiber profiles we built during the run, with the latest code (e.g., crosstalk corrections). Using branch tickets/PIPE2D-1209 (reduceProfile optimisations).

reduceProfiles.py /work/drp --calib=/work/price/CALIB-202304-eng --rerun=price/pipe2d-1220 --id visit=92413..92417^92419..92425^92317..92323^92251..92257^91942..91946^92272..92278^92330..92336 --normId visit=91907..91909 -j 4 -c profiles.profileRadius=10 profiles.profileOversample=3 profiles.profileSwath=2000 profiles.profileRejThresh=5 reduceExposure.isr.doFlat=False

Looks good, like before.

sqlite> DELETE FROM fiberProfiles WHERE arm in ("b", "r");
sqlite> DELETE FROM fiberProfiles_visit WHERE arm in ("b", "r");
(lsst-scipipe-3.0.0) price@pfsa-usr02-gb:/work/price/CALIB-202304-eng $ rm FIBERPROFILES/*[br]?.fits
(lsst-scipipe-3.0.0) price@pfsa-usr02-gb:/work/price/CALIB-202304-eng $ ingestPfsCalibs.py /work/drp --calib /work/drp/CALIB /work/drp/rerun/price/pipe2d-1220/FIBERPROFILES/pfsFiberProfiles-2023-04-26-091942-*.fits --validity 10000 -c clobber=True --mode=copy

For m, we don't have a full dataset: just one set of mod4 and one set with all fibers hidden. I'm going to try it, with a reduced profile radius, but I don't have high hopes of it being particularly successful.

reduceProfiles.py /work/drp --calib=/work/price/CALIB-202304-eng --rerun=price/pipe2d-1220 --id visit=92237..92241^92258..92262 arm=m --normId visit=91427..91436 arm=m -j 2 -c profiles.profileRadius=4 profiles.profileOversample=3 profiles.profileSwath=2000 profiles.profileRejThresh=5 reduceExposure.isr.doFlat=False --no-versions

Hmm. reduceProfiles doesn't work if there isn't an existing fiberProfiles in the calib registry, because it uses the fiberProfiles as part of reducing the individual exposures (e.g., centroiding on arc lines).
And the exposures being used for normalisation used the ring lamp, so they're coming up as sky exposures, not quartzes.
And for some reason, the m1 fiberProfiles is getting written with a date from 2022, not 2023.

Fixed all that.
But the m profiles are pretty rubbish. Not going any further with them.

Comment by price [ 27/May/23 ]

These calibs were installed in CALIB-2023-04-v1.

Generated at Sat Feb 10 16:04:24 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.