Uploaded image for project: 'DRP 2-D Pipeline'
  1. DRP 2-D Pipeline
  2. PIPE2D-512

ReduceArc.py fails on Subaru data using recent bootstrapped detectormap

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done (View Workflow)
    • Priority: Normal
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      6
    • Sprint:
      2DDRP-2020 A, 2DDRP-2021 A

      Description

      Following a bootstrapDetectorMap run based on the July 2019 detectormap 'r' file available at
      https://github.com/Subaru-PFS/drp_pfs_data/blob/master/detectorMap/detectorMap-2019Jul-r1.fits using Dec 2019 Subaru data

      bootstrapDetectorMap.py ${repo} --calib ${repo}/CALIB --rerun ${rerunDir} --flatId visit=108 --arcId visit=436 arm=r
      

      Followed by a run of reduceArc.py using the same Dec 2019 Subaru arc data

      reduceArc.py ${repo} --calib ${repo}/CALIB --rerun calib/arc --id visit=436 arm=r
      

      results in an error in fitContinuum.py:

      reduceArc.identifyLines INFO: Matched 11 from 29 observed and 60 reference lines
      reduceArc.identifyLines INFO: Matched 9 from 23 observed and 60 reference lines
      reduceArc.identifyLines INFO: Matched 8 from 22 observed and 60 reference lines
      reduceArc.identifyLines INFO: Matched 10 from 29 observed and 60 reference lines
      reduceArc.identifyLines INFO: Matched 10 from 28 observed and 60 reference lines
      reduceArc.identifyLines INFO: Matched 10 from 27 observed and 60 reference lines
      reduceArc.identifyLines INFO: Matched 10 from 29 observed and 60 reference lines
      reduceArc FATAL: Failed on dataId={'visit': 436, 'arm': 'r', 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'spectrograph': 1, 'field': 'ARC', 'ccd': 1, 'filter': 'r', 'expTime': 2.998, 'dataType': 'arc', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}: AssertionError: Monotonic
      Traceback (most recent call last):
        File "/tigress/HSC/PFS/stack/20190925/stack/miniconda3-4.5.12-1172c30/Linux64/pipe_base/18.1.0/python/lsst/pipe/base/cmdLineTask.py", line 388, in __call__
          result = self.runTask(task, dataRef, kwargs)
        File "/tigress/HSC/PFS/stack/20190925/stack/miniconda3-4.5.12-1172c30/Linux64/pipe_base/18.1.0/python/lsst/pipe/base/cmdLineTask.py", line 447, in runTask
          return task.runDataRef(dataRef, **kwargs)
        File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/reduceArcTask.py", line 165, in runDataRef
          self.identifyLines.run(results.spectraList[0], results.detectorMapList[0], lines)
        File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/identifyLines.py", line 49, in run
          self.identifyLines(spec, detectorMap, lines)
        File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/identifyLines.py", line 84, in identifyLines
          obsLines = self.findLines.runCentroids(spectrum).centroids
        File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/findLines.py", line 89, in runCentroids
          result = self.run(spectrum)
        File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/findLines.py", line 63, in run
          continuum = self.fitContinuum.fitContinuum(spectrum) if self.config.doSubtractContinuum else None
        File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/fitContinuum.py", line 85, in fitContinuum
          good = self.maskLines(spectrum)
        File "/tigress/hassans/software/drp_stella/python/pfs/drp/stella/fitContinuum.py", line 186, in maskLines
          assert np.all(delta >= 0) or np.all(delta <= 0), "Monotonic"
      AssertionError: Monotonic
      reduceArc FATAL: Failed to process at least one of the components for {'visit': 436, 'arm': 'r', 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'spectrograph': 1, 'field': 'ARC', 'ccd': 1, 'filter': 'r', 'expTime': 2.998, 'dataType': 'arc', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                hassan hassan
                Reporter:
                hassan hassan
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: