[PIPE2D-1039] Butler does not find matching object if validity ranges match taiObs exactly Created: 05/May/22  Updated: 05/May/22  Resolved: 05/May/22

Status: Done
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Normal
Reporter: hassan Assignee: price
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Relates
relates to PIPE2D-1023 Convert calibs to "validityUntilSuper... Done
Story Points: 1
Reviewers: hassan

 Description   

Running reduceArc.py as follows:

reduceArc.py /projects/HSC/PFS/Subaru/ --calib /scratch/hassans/CALIB-20220504 --rerun hassans/calib/arc --id visit=68100 arm
=r --config reduceExposure.isr.doFlat=False reduceExposure.isr.doApplyGains=True fitDetectorMap.doSlitOffsets=True reduceExposure.repair.doCosmicRay=False

Results in an error in accessing the appropriate CALIB detectormap:

lsst.daf.persistence.butlerExceptions.NoResults: No locations for get: datasetType:detectorMap dataId:DataId(initialdata={'visit': 68100, 'arm': 'r', 'dateObs': '2021-09-19', 'site'
: 'S', 'category': 'A', 'spectrograph': 1, 'field': 'THROUGHFOCUS', 'ccd': 1, 'filter': 'r', 'expTime': 10.0, 'dataType': 'COMPARISON', 'taiObs': '2021-09-19T09:18:46.800', 'pfsDesignId': 512368543363980592, 'slitOffset': 0.0}, tag=set())

Even those the valid detectormap exists:

$ ls -l /scratch/hassans/CALIB-20220504/DETECTORMAP/pfsDetectorMap-068100-r1.fits 
-rw-rw-r--. 1 hassans astro 2136960 May  4 13:31 /scratch/hassans/CALIB-20220504/DETECTORMAP/pfsDetectorMap-068100-r1.fits

As suggested by Paul during a slack chat, looking at the detectormap table of the calib registry:

id|arm|ccd|spectrograph|calibDate|calibTime|visit0|validStart|validEnd
18|r|1|1|2021-09-19|2021-09-19T09:18:46.800|68100|2021-09-19T09:18:46.800000|2037-12-31T00:00:00

It appears that the problem is when the start of the validity range matches exactly to the calibTime value.



 Comments   
Comment by price [ 05/May/22 ]

Reviewed and tested by hassan offline.

Merged.

Generated at Sat Feb 10 16:01:47 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.