[PIPE2D-1326] reduceExposures.py can fail with "RuntimeError: Insufficient good lines: 1 vs 8"

Mon, 6 Nov 2023 13:43:51 +0000

Kiyoto Yabe reports the error:

FATAL 2023-11-03T13:40:33.853-1000 reduceExposure ({'visit': 96925, 'dateObs': '2023-07-20', 'site': 'S', 'category': 'A', 'arm': 'b', 'spectrograph': 1, 'field': 'GE_EN1_P1_PA_90', 'ccd': 0, 'filter': 'b', 'expTime': 60.0, 'dataType': 'COMPARISON', 'taiObs': '2023-07-20T07:42:23.032', 'pfsDesignId': 1562097688427952981, 'slitOffset': 0.0})(cmdLineTask.py:446)- Failed on dataId={'visit': 96925, 'dateObs': '2023-07-20', 'site': 'S', 'category': 'A', 'arm': 'b', 'spectrograph': 1, 'field': 'GE_EN1_P1_PA_90', 'ccd': 0, 'filter': 'b', 'expTime': 60.0, 'dataType': 'COMPARISON', 'taiObs': '2023-07-20T07:42:23.032', 'pfsDesignId': 1562097688427952981, 'slitOffset': 0.0}: RuntimeError: Insufficient good lines: 1 vs 8
Traceback (most recent call last):
  File "/work/stack_INFRA-312/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/cmdLineTask.py", line 436, in __call__
    result = self.runTask(task, dataRef, kwargs)
  File "/work/stack_INFRA-312/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/cmdLineTask.py", line 504, in runTask
    return task.runDataRef(dataRef, **kwargs)
  File "/work/stack_INFRA-312/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/drp_stella/edr2-20231103/python/pfs/drp/stella/reduceExposure.py", line 264, in runDataRef
    calibs = self.getSpectralCalibs(sensorRef, exposure, pfsConfig)
  File "/work/stack_INFRA-312/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/drp_stella/edr2-20231103/python/pfs/drp/stella/reduceExposure.py", line 540, in getSpectralCalibs
    detectorMap = self.adjustDetectorMap.run(
  File "/work/stack_INFRA-312/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/drp_stella/edr2-20231103/python/pfs/drp/stella/adjustDetectorMap.py", line 79, in run
    raise RuntimeError(f"Insufficient good lines: {numGoodLines} vs {needNumLines}")
RuntimeError: Insufficient good lines: 1 vs 8

The how-to-repeat is:

$ setup drp_stella edr2-20231103
$ reduceExposure.py /work/drp --calib=/work/drp/CALIB --rerun=XXX --id visit=96925 arm=b spectrograph=1 --config isr.doFlat=False doAdjustDetectorMap=True adjustDetectorMap.doSlitOffsets=True useCalexp=True

PFS-JIRA

[PIPE2D-1326] reduceExposures.py can fail with "RuntimeError: Insufficient good lines: 1 vs 8"