Uploaded image for project: 'DRP 2-D Pipeline'
  1. DRP 2-D Pipeline
  2. PIPE2D-916

Debug 2021-10-17 weekly

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done (View Workflow)
    • Priority: Normal
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      1
    • Sprint:
      2DDRP-2021 A 10, 2DDRP-2021 A11

      Description

      The weekly failed due to wavelength residuals being high:

      ======================================================================
      FAIL: testResiduals (__main__.ArcTestCase_brn_39) (arm='r', fiberId=165)
      Test that wavelength fit residuals are reasonable
      ----------------------------------------------------------------------
      Traceback (most recent call last):
       File "/scratch/pprice/jenkins/weekly/2021-10-17/build/stack/miniconda3-4.5.12-1172c30/Linux64/pfs_pipe2d/w.2021.42/python/pfs/pipe2d/weekly/test_weekly.py", line 136, in testResiduals
         self.assertFloatsAlmostEqual(median, 0.0, atol=atol)
       File "/scratch/pprice/jenkins/weekly/2021-10-17/build/stack/miniconda3-4.5.12-1172c30/Linux64/utils/18.1.0/python/lsst/utils/tests.py", line 735, in assertFloatsAlmostEqual
         testCase.assertFalse(failed, msg="\n".join(errMsg))
      AssertionError: True is not false : -0.0212058729346154 != 0.0; diff=0.0212058729346154/0.0212058729346154=1.0 with rtol=2.220446049250313e-16, atol=0.02
      

      I also noticed that the sky model fit has a non-finite chi^2:

      + mergeArms.py /scratch/pprice/jenkins/weekly/2021-10-17/process --calib=/scratch/pprice/jenkins/weekly/2021-10-17/process/CALIB --rerun=weekly/pipeline/bmn/pipeline --doraise -j10 --id 'visit=50^51^52^55^56^58'
      [...]
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=76238.614984 length=4172/4176 numSamples=120 numGood=494172 numBad=6583 numRejected=386
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=154280.445883 length=4172/4176 numSamples=120 numGood=494228 numBad=6239 numRejected=726
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=154219.982931 length=4172/4176 numSamples=120 numGood=494184 numBad=6317 numRejected=721
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4172/4176 numSamples=120 numGood=494141 numBad=6274 numRejected=740
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4172/4176 numSamples=120 numGood=494431 numBad=5957 numRejected=768
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4173/4176 numSamples=120 numGood=494298 numBad=6149 numRejected=754
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4095/4176 numSamples=120 numGood=477835 numBad=18264 numRejected=5624
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4105/4176 numSamples=120 numGood=459494 numBad=24426 numRejected=21165
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4104/4176 numSamples=120 numGood=421857 numBad=64460 numRejected=20467
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4096/4176 numSamples=120 numGood=459512 numBad=23583 numRejected=21346
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4104/4176 numSamples=120 numGood=374855 numBad=112364 numRejected=21396
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4104/4176 numSamples=120 numGood=425090 numBad=60247 numRejected=21474
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4149/4176 numSamples=120 numGood=487595 numBad=13488 numRejected=37
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4150/4176 numSamples=120 numGood=487177 numBad=12690 numRejected=1284
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4149/4176 numSamples=120 numGood=486650 numBad=13298 numRejected=1224
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4148/4176 numSamples=120 numGood=486955 numBad=13019 numRejected=1185
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4152/4176 numSamples=120 numGood=487169 numBad=12833 numRejected=1187
      mergeArms.fitSkyModel INFO: Fit focal plane function: chi^2=nan length=4152/4176 numSamples=120 numGood=487049 numBad=12926 numRejected=1249
      

        Attachments

          Activity

            People

            • Assignee:
              price price
              Reporter:
              price price
              Reviewers:
              hassan
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: