Uploaded image for project: 'DRP 2-D Pipeline'
  1. DRP 2-D Pipeline
  2. PIPE2D-1095

Fix w.2022.42 weekly test failure

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Done (View Workflow)
    • Priority: Normal
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      1
    • Sprint:
      Gen3 transition

      Description

      The latest weekly, w.2022.42 fails following the changes introduced by PIPE2D-668.

      A snippet of the log is provided below.

      + sh /scratch/pprice/jenkins/weekly/2022-10-16/process/science.sh
      + reduceExposure.py /scratch/pprice/jenkins/weekly/2022-10-16/process --calib=/scratch/pprice/jenkins/weekly/2022-10-16/process/CALIB --rerun=science/pipeline --doraise -j10 --id 'visit=1000^1001^1004^1005'
      root INFO: Loading config overrride file '/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/obs_pfs/w.2022.42/config/reduceExposure.py'
      lsst.CameraMapper INFO: Loading exposure registry from /scratch/pprice/jenkins/weekly/2022-10-16/process/registry.sqlite3
      lsst.CameraMapper INFO: Loading calib registry from /scratch/pprice/jenkins/weekly/2022-10-16/process/CALIB/calibRegistry.sqlite3
      lsst.CameraMapper INFO: Loading calib registry from /scratch/pprice/jenkins/weekly/2022-10-16/process/CALIB/calibRegistry.sqlite3
      Traceback (most recent call last):
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/drp_stella/w.2022.42/bin/reduceExposure.py", line 25, in <module>
      ReduceExposureTask.parseAndRun()
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/cmdLineTask.py", line 682, in parseAndRun
      parsedCmd = argumentParser.parse_args(config=config, args=args, log=log, override=cls.applyOverrides)
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/argumentParser.py", line 788, in parse_args
      self._processDataIds(namespace)
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/argumentParser.py", line 901, in _processDataIds
      dataIdContainer.makeDataRefList(namespace)
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/argumentParser.py", line 203, in makeDataRefList
      refList = dafPersist.searchDataRefs(
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/butlerHelpers.py", line 57, in searchDataRefs
      return [dr for dr in refList if dataExists(dr)]
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/butlerHelpers.py", line 57, in <listcomp>
      return [dr for dr in refList if dataExists(dr)]
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/butlerHelpers.py", line 80, in dataExists
      return dataRef.datasetExists()
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/butlerSubset.py", line 313, in datasetExists
      return self.butlerSubset.butler.datasetExists(
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/butler.py", line 1261, in datasetExists
      locations = self._locate(datasetType, dataId, write=write)
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/butler.py", line 1347, in _locate
      bypass = bypass()
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/butler.py", line 1375, in <lambda>
      return lambda: bypassFunc(location.datasetType, pythonType, location, dataId)
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/obs_pfs/w.2022.42/python/lsst/obs/pfs/pfsMapper.py", line 260, in bypass_raw
      hasResetFrame = md["W_4FMTVR"] >= 3 # extra IMG/REF HDUs for the initial reset frame
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_base/gcc072456be+b6f9ac6643/python/lsst/daf/base/propertyContainer/propertyContainerContinued.py", line 727, in _getitem_
      return self.getScalar(name)
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_base/gcc072456be+b6f9ac6643/python/lsst/daf/base/propertyContainer/propertyContainerContinued.py", line 878, in getScalar
      return _propertyContainerGet(self, name, returnStyle=ReturnStyle.SCALAR)
      File "/scratch/pprice/jenkins/weekly/2022-10-16/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_base/gcc072456be+b6f9ac6643/python/lsst/daf/base/propertyContainer/propertyContainerContinued.py", line 215, in _propertyContainerGet
      raise KeyError(name + " not found")
      KeyError: 'W_4FMTVR not found'

      Investigate and fix.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                hassan hassan
                Reviewers:
                price
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: