[PIPE2D-512] ReduceArc.py fails on Subaru data using recent bootstrapped detectormap

Relates — Mon, 4 Jan 2021 20:23:12 +0000

Following a bootstrapDetectorMap run based on the July 2019 detectormap 'r' file available at
https://github.com/Subaru-PFS/drp_pfs_data/blob/master/detectorMap/detectorMap-2019Jul-r1.fits using Dec 2019 Subaru data

bootstrapDetectorMap.py ${repo} --calib ${repo}/CALIB --rerun ${rerunDir} --flatId visit=108 --arcId visit=436 arm=r

Followed by a run of reduceArc.py using the same Dec 2019 Subaru arc data

reduceArc.py ${repo} --calib ${repo}/CALIB --rerun calib/arc --id visit=436 arm=r

results in an error in fitContinuum.py:

reduceArc.identifyLines INFO: Matched 11 from 29 observed and 60 reference lines
reduceArc.identifyLines INFO: Matched 9 from 23 observed and 60 reference lines
reduceArc.identifyLines INFO: Matched 8 from 22 observed and 60 reference lines
reduceArc.identifyLines INFO: Matched 10 from 29 observed and 60 reference lines
reduceArc.identifyLines INFO: Matched 10 from 28 observed and 60 reference lines
reduceArc.identifyLines INFO: Matched 10 from 27 observed and 60 reference lines
reduceArc.identifyLines INFO: Matched 10 from 29 observed and 60 reference lines
reduceArc FATAL: Failed on dataId={'visit': 436, 'arm': 'r', 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'spectrograph': 1, 'field': 'ARC', 'ccd': 1, 'filter': 'r', 'expTime': 2.998, 'dataType': 'arc', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}: AssertionError: Monotonic
Traceback (most recent call last):
  File "/tigress/HSC/PFS/stack/20190925/stack/miniconda3-4.5.12-1172c30/Linux64/pipe_base/18.1.0/python/lsst/pipe/base/cmdLineTask.py", line 388, in __call__
    result = self.runTask(task, dataRef, kwargs)
  File "/tigress/HSC/PFS/stack/20190925/stack/miniconda3-4.5.12-1172c30/Linux64/pipe_base/18.1.0/python/lsst/pipe/base/cmdLineTask.py", line 447, in runTask
    return task.runDataRef(dataRef, **kwargs)
  File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/reduceArcTask.py", line 165, in runDataRef
    self.identifyLines.run(results.spectraList[0], results.detectorMapList[0], lines)
  File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/identifyLines.py", line 49, in run
    self.identifyLines(spec, detectorMap, lines)
  File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/identifyLines.py", line 84, in identifyLines
    obsLines = self.findLines.runCentroids(spectrum).centroids
  File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/findLines.py", line 89, in runCentroids
    result = self.run(spectrum)
  File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/findLines.py", line 63, in run
    continuum = self.fitContinuum.fitContinuum(spectrum) if self.config.doSubtractContinuum else None
  File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/fitContinuum.py", line 85, in fitContinuum
    good = self.maskLines(spectrum)
  File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/fitContinuum.py", line 186, in maskLines
    assert np.all(delta >= 0) or np.all(delta <= 0), "Monotonic"
AssertionError: Monotonic
reduceArc FATAL: Failed to process at least one of the components for {'visit': 436, 'arm': 'r', 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'spectrograph': 1, 'field': 'ARC', 'ccd': 1, 'filter': 'r', 'expTime': 2.998, 'dataType': 'arc', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}

PFS-JIRA

[PIPE2D-512] ReduceArc.py fails on Subaru data using recent bootstrapped detectormap