Uploaded image for project: 'DRP 2-D Pipeline'
  1. DRP 2-D Pipeline
  2. PIPE2D-855

cannot construct fiberProfile from the recent dcb-21-fibers data

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done (View Workflow)
    • Priority: Normal
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Sprint:
      2DDRP-2021 A 6

      Description

      got this error constructing fiberProfile from the recent dcb data :

      CameraMapper INFO: Loading calib registry from /tigress/HSC/PFS/Subaru/CALIB-alefur-dcb21/calibRegistry.sqlite3                                               [8/1852]
      fiberProfiles INFO: Scatter combination                                                                                                                               
      fiberProfiles INFO: Combining 1 inputs {'arm': 'r', 'spectrograph': 1, 'ccd': 1, 'filter': None, 'calibTime': '2021-06-04T13:41:15.315000320', 'visit0': 59870, 'calib
      Date': '2021-06-04'} on tiger2-sumire.princeton.edu:245429       
      IndexError on tiger2-sumire.princeton.edu:245429 in reduce: map::at                                                                                                   
      Traceback (most recent call last):                                                 
        File "/tigress/HSC/PFS/stack/20190925/stack/miniconda3-4.5.12-1172c30/Linux64/ctrl_pool/18.1.0/python/lsst/ctrl/pool/pool.py", line 113, in wrapper
          return func(*args, **kwargs)
        File "/tigress/HSC/PFS/stack/20190925/stack/miniconda3-4.5.12-1172c30/Linux64/ctrl_pool/18.1.0/python/lsst/ctrl/pool/pool.py", line 240, in wrapper
          return func(*args, **kwargs)                                                   
        File "/tigress/HSC/PFS/stack/20190925/stack/miniconda3-4.5.12-1172c30/Linux64/ctrl_pool/18.1.0/python/lsst/ctrl/pool/pool.py", line 716, in reduce
          *args, **kwargs)
        File "/tigress/HSC/PFS/stack/20190925/stack/miniconda3-4.5.12-1172c30/Linux64/ctrl_pool/18.1.0/python/lsst/ctrl/pool/pool.py", line 573, in _reduceQueue
          resultList = [func(self._getCache(context, i), data, *args, **kwargs) for i, data in queue]
        File "/tigress/HSC/PFS/stack/20190925/stack/miniconda3-4.5.12-1172c30/Linux64/ctrl_pool/18.1.0/python/lsst/ctrl/pool/pool.py", line 573, in <listcomp>
          resultList = [func(self._getCache(context, i), data, *args, **kwargs) for i, data in queue]
        File "/home/afur/drp_stella/python/pfs/drp/stella/constructFiberProfilesTask.py", line 147, in combine
          traces = self.centroidTraces.run(exposure, detMap, pfsConfig)
        File "/home/afur/drp_stella/python/pfs/drp/stella/centroidTraces.py", line 59, in run
          traces = self.findTracePeaks(convolved, detectorMap, pfsConfig)
        File "/home/afur/drp_stella/python/pfs/drp/stella/centroidTraces.py", line 113, in findTracePeaks
          badBitMask, fiberId)
      IndexError: map::at
      fiberProfiles FATAL: Failed: map::at
      

      I'm using drp_stella master on top of w.2021.24.
      Here is the command history :

      constructPfsBias.py /tigress/HSC/PFS/Subaru --calib /tigress/HSC/PFS/Subaru/CALIB-alefur/ --rerun alefur/pipe2d-794 --id visit=55386..55400 --batch-type=none --clobber-versions
      
      mkdir CALIB-alefur-dcb21
      
      ingestPfsCalibs.py /tigress/HSC/PFS/Subaru/ --calib /tigress/HSC/PFS/Subaru/CALIB-alefur-dcb21/ --validity 1000 --mode=copy rerun/alefur/pipe2d-794/BIAS/pfsBias-2021-05-24-055386-* 
      
      constructPfsDark.py /tigress/HSC/PFS/Subaru --calib /tigress/HSC/PFS/Subaru/CALIB-alefur-dcb21/ --rerun alefur/pipe2d-794-dcb21 --id visit=55401..55415 --batch-type=none
      
      ingestPfsCalibs.py /tigress/HSC/PFS/Subaru/ --calib /tigress/HSC/PFS/Subaru/CALIB-alefur-dcb21/ --validity 1000 --mode=copy rerun/alefur/pipe2d-794-dcb21/DARK/pfsDark-2021-05-24-055401-* 
      
      ingestPfsCalibs.py /tigress/HSC/PFS/Subaru/ --calib /tigress/HSC/PFS/Subaru/CALIB-alefur-dcb21/ --validity 1000 --mode=copy $DRP_PFS_DATA_DIR/detectorMap/detectorMap-sim-*.fits 
      
      bootstrapDetectorMap.py /tigress/HSC/PFS/Subaru/ --calib /tigress/HSC/PFS/Subaru/CALIB-alefur-dcb21/ --rerun alefur/pipe2d-794-dcb21/ --flatId visit=59870 arm=r --arcId visit=59871 arm=r 
      
      ingestPfsCalibs.py /tigress/HSC/PFS/Subaru/ --calib /tigress/HSC/PFS/Subaru/CALIB-alefur-dcb21/ --validity 1000 --mode=copy rerun/alefur/pipe2d-794-dcb21/DETECTORMAP/pfsDetectorMap-059871-r1.fits 
      
      ingestPfsCalibs.py /tigress/HSC/PFS/Subaru/ --calib /tigress/HSC/PFS/Subaru/CALIB-alefur-dcb21/ --validity 1000 --mode=copy rerun/alefur/pipe2d-794/FLAT/pfsFlat-2020-09-11-025395-r1.fits 
      
      constructFiberProfiles.py /tigress/HSC/PFS/Subaru/ --calib /tigress/HSC/PFS/Subaru/CALIB-alefur-dcb21/ --rerun alefur/pipe2d-794-dcb21/ --id visit=59870 arm=r --batch-type=none
      

        Attachments

          Activity

            People

            • Assignee:
              price price
              Reporter:
              arnaud.lefur arnaud.lefur
              Reviewers:
              hassan
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: