[PIPE2D-1265] n3 unable to measure aperture corrections using Ar spectra

Tue, 1 Aug 2023 19:28:44 +0000

the n3 DetectorMap still seems to have problems. The command

reduceExposure.py /work/drp --calib /work/drp/CALIB --rerun rhl/eng-2023-07 -c isr.doFlat=False isr.doFlatNir=False doAdjustDetectorMap=True doMeasureLines=True --id visit=96925 arm=n spectrograph=3

fails, although there are quite a few lines in this (Argon) spectrum.

The error is

reduceExposure.readLineList INFO: Filtered line lists, keeping species {'ArI'}.
reduceExposure.centroidLines INFO: Measured 15090 line centroids
reduceExposure.centroidTraces INFO: Measured 11457 centroids for 616 traces
reduceExposure.adjustDetectorMap INFO: Final fit: chi2=91050.655441 dof=6179 xRMS=0.179240 yRMS=0.231107 (0.018896 nm) xSoften=0.179387 ySoften=0.000000 from 5879/10337 lines
reduceExposure.adjustDetectorMap INFO: Fit quality from reserved lines: chi2=10495911.585279 xRMS=2.302150 yRMS=0.250867 (0.020512 nm) xSoften=nan ySoften=nan from 1149 lines (10.0%)
reduceExposure.adjustDetectorMap INFO: Softened fit: chi2=8046.568473 dof=6179 xRMS=0.190672 yRMS=0.231775 (0.018951 nm) xSoften=0.179025 ySoften=0.000000 from 1149 lines
reduceExposure.adjustDetectorMap INFO: Softened fit quality from reserved lines: chi2=2798182.905496 xRMS=1.850856 yRMS=0.252046 (0.020608 nm) xSoften=nan ySoften=nan from 1149 lines
reduceExposure.adjustDetectorMap INFO: Final fit: chi2=124552.676454 dof=7121 xRMS=0.190180 yRMS=0.238217 (0.019477 nm) xSoften=0.195424 ySoften=0.000000 from 6887/10337 lines
reduceExposure.adjustDetectorMap INFO: Fit quality from reserved lines: chi2=4083351.546211 xRMS=0.299657 yRMS=0.215840 (0.017648 nm) xSoften=0.584591 ySoften=nan from 1149 lines (10.0%)
reduceExposure.adjustDetectorMap INFO: Softened fit: chi2=8586.509074 dof=7121 xRMS=0.202688 yRMS=0.239126 (0.019552 nm) xSoften=0.193465 ySoften=0.000000 from 1149 lines
reduceExposure.adjustDetectorMap INFO: Softened fit quality from reserved lines: chi2=4222416.705908 xRMS=0.277735 yRMS=0.216072 (0.017667 nm) xSoften=0.532115 ySoften=nan from 1149 lines
reduceExposure.adjustDetectorMap INFO: Final result: chi2=134586.912645 dof=7121 xRMS=0.195130 yRMS=0.445191 xSoften=0.202842 ySoften=0.000000 from 6887 lines
reduceExposure.adjustDetectorMap INFO: Stats for ArI: chi2=7287.992431 dof=516 xRMS=0.270384 yRMS=0.445191 xSoften=0.174193 ySoften=0.297691 from 258 lines
reduceExposure.adjustDetectorMap INFO: Stats for Trace: chi2=127298.920213 dof=6629 xRMS=0.194281 yRMS=nan xSoften=0.204488 ySoften=0.000000 from 6629 lines
reduceExposure.adjustDetectorMap INFO: Stats for fiberId=1306: chi2=248.997118 dof=7 xRMS=0.292737 yRMS=nan xSoften=0.241155 ySoften=0.000000 from 7 lines (7 Trace)
reduceExposure.adjustDetectorMap INFO: Stats for fiberId=1442: chi2=228.998997 dof=16 xRMS=0.150777 yRMS=nan xSoften=0.143070 ySoften=0.000000 from 16 lines (16 Trace)
reduceExposure.adjustDetectorMap INFO: Stats for fiberId=1579: chi2=15.715469 dof=5 xRMS=0.089503 yRMS=nan xSoften=0.081027 ySoften=0.000000 from 5 lines (5 Trace)
reduceExposure.adjustDetectorMap INFO: Stats for fiberId=1800: chi2=390.167935 dof=18 xRMS=0.200247 yRMS=nan xSoften=0.210373 ySoften=0.000000 from 18 lines (18 Trace)
reduceExposure.adjustDetectorMap INFO: Stats for fiberId=1953: chi2=175.966506 dof=3 xRMS=0.521229 yRMS=nan xSoften=0.668233 ySoften=0.000000 from 3 lines (3 Trace)
reduceExposure FATAL: Failed on dataIds=[{'visit': 96925, 'arm': 'n', 'spectrograph': 3, 'dateObs': '2023-07-20', 'site': 'S', 'category': 'B', 'field': 'GE_EN1_P1_PA_90', 'ccd': 8, 'filter': 'n', 'expTime': 60.0, 'dataType': 'COMPARISON', 'taiObs': '2023-07-20T07:42:40.982', 'pfsDesignId': 1562097688427952981, 'slitOffset': 0.0}]: RuntimeError: No good points
Traceback (most recent call last):
  File "/work/stack_INFRA-312/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/cmdLineTask.py", line 436, in __call__
    result = self.runTask(task, dataRef, kwargs)
  File "/work/stack_INFRA-312/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/cmdLineTask.py", line 504, in runTask
    return task.runDataRef(dataRef, **kwargs)
  File "/home/rhl/PFS/drp/stella/python/pfs/drp/stella/reduceExposure.py", line 278, in runDataRef
    calibs = self.getSpectralCalibs(sensorRef, exposure, pfsConfig)
  File "/home/rhl/PFS/drp/stella/python/pfs/drp/stella/reduceExposure.py", line 580, in getSpectralCalibs
    phot = self.photometerLines.run(exposure, lines[notTrace], detectorMap, pfsConfig, fiberTraces)
  File "/home/rhl/PFS/drp/stella/python/pfs/drp/stella/photometerLines.py", line 99, in run
    phot = self.photometerLines(exposure, referenceLines, detectorMap, pfsConfig, fiberTraces)
  File "/home/rhl/PFS/drp/stella/python/pfs/drp/stella/photometerLines.py", line 176, in photometerLines
    apCorr = self.apertureCorrection.run(exposure, pfsConfig, detectorMap, lines)
  File "/home/rhl/PFS/drp/stella/python/pfs/drp/stella/apertureCorrections.py", line 125, in run
    apCorr = self.fit.run(corrections, pfsConfig, minWavelength=minWavelength,
  File "/home/rhl/PFS/drp/stella/python/pfs/drp/stella/fitFocalPlane.py", line 109, in run
    raise RuntimeError("No good points")
RuntimeError: No good points

If I don't try to update the DetectorMaps that n1 and n3 don't agree, which is probably a clue.

PFS-JIRA

[PIPE2D-1265] n3 unable to measure aperture corrections using Ar spectra