Uploaded image for project: 'DRP 2-D Pipeline'
  1. DRP 2-D Pipeline
  2. PIPE2D-591

unable to ingest updated header images

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done (View Workflow)
    • Priority: Blocker
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Sprint:
      2DDRP-2021 A

      Description

      Was trying to ingest post software migration images, but it failed in various places:

      [pfs@shell2-ics drp]$ ingestPfsImages.py /data/drp/alefur --mode=link /data/raw/2020-05-27/sps/PFSA01774512.fits CameraMapper INFO: Loading exposure registry from /data/drp/alefur/registry.sqlite3 
      ingestPfs.parse WARN: Unable to find value for dataType (derived from IMAGETYP) 
      ingestPfs.parse WARN: Unable to find value for expTime (derived from EXPTIME) 
      ingestPfs.parse WARN: Unable to find value for dateObs (derived from DATE-OBS) 
      ingestPfs.parse WARN: Unable to find value for taiObs (derived from DATE-OBS) 
      ingestPfs.parse WARN: translate_field failed to translate field: 'NoneType' object has no attribute 'strip' 
      ingestPfs.parse WARN: No value set for pfsDesignId; using default (0x0000000000000000) 
      ingestPfs.parse WARN: translate_date failed to translate dateObs: 'DATE-OBS not found' 
      ingestPfs.parse WARN: translate_date failed to translate taiObs: 'DATE-OBS not found' 
      Traceback (most recent call last): 
       File "/software/drp-5.2/stack/miniconda3-4.5.12-1172c30/Linux64/obs_pfs/w.2020.21/python/lsst/obs/pfs/ingest.py", line 419, in runFile 
       hduInfoList = super().runFile(infile, registry, args) 
       File "/software/drp-5.2/stack/miniconda3-4.5.12-1172c30/Linux64/pipe_tasks/18.1.0/python/lsst/pipe/tasks/ingest.py", line 533, in runFile 
       outfile = self.parse.getDestination(args.butler, fileInfo, infile) 
       File "/software/drp-5.2/stack/miniconda3-4.5.12-1172c30/Linux64/pipe_tasks/18.1.0/python/lsst/pipe/tasks/ingest.py", line 189, in getDestination 
       raw = butler.get("raw_filename", info)[0] 
       File "/software/drp-5.2/stack/miniconda3-4.5.12-1172c30/Linux64/daf_persistence/18.1.0/python/lsst/daf/persistence/butler.py", line 1380, in get 
       raise NoResults("No locations for get:", datasetType, dataId) 
      lsst.daf.persistence.butlerExceptions.NoResults: No locations for get: datasetType:raw_filename dataId:DataId(initialdata={'site': 'S', 'category': 'A', 'visit': 17745, 'filter': 'r', 'arm': 'r', 'spectrograph': 1, 'ccd': 1, 'pfsDesignId': 0, 'slitOffset': 0.0, 'lamps': '', 'dither': -9999, 'shift': -9999, 'focus': -9999, 'attenuator': -9999, 'photodiode': -9999}, tag=set()) 
      ingestPfs WARN: Failed to ingest file /data/raw/2020-05-27/sps/PFSA01774512.fits: No locations for get: datasetType:raw_filename dataId:DataId(initialdata={'site': 'S', 'category': 'A', 'visit': 17745, 'filter': 'r', 'arm': 'r', 'spectrograph': 1, 'ccd': 1, 'pfsDesignId': 0, 'slitOffset': 0.0, 'lamps': '', 'dither': -9999, 'shift': -9999, 'focus': -9999, 'attenuator': -9999, 'photodiode': -9999}, tag=set()) 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                price price
                Reporter:
                arnaud.lefur arnaud.lefur
                Reviewers:
                hassan
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: