https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1129 DRP 2-D Pipeline <p>The <tt>DoubleDetectorMap</tt> currently models the x and y distortion separately. By modeling the distortion with dx, dy, scale and separate higher-order terms, we can link the two distortions, meaning that changes to the trace positions provide direct information to the change in the wavelength solution.</p> PIPE2D-1129

Convert detectorMap distortion model to fit for scale

Story Normal Done Done price price Mon, 12 Dec 2022 19:08:38 +0000 Thu, 21 Sep 2023 14:49:45 +0000 Thu, 21 Sep 2023 14:49:45 +0000 0 2 <p>Added <tt>MultipleDistortionsDetectorMap</tt>, which allows layering multiple distortions, and added the ability to <tt>DoubleDistortion</tt> to fit for common scale (in x and y, for both CCDs).</p> <p>Here's a plot of the atmospheric B band for a SuNSS imaging fiber close to the moon (visit=72045 fiberId=197), from an exposure with all fibers dominated by continuum and very few good strong sky lines. Before (red line), the spectrum is shifted relative to an example atmospheric transmission model (this one is zd=60, pwv=1, smoothed with sigma=2, and shifted; the zd and pwv are not appropriate for this data, but it provides a wavelength reference). The wavelength calibration after this ticket is much better.</p> <p><span class="image-wrap" style=""><img src="https://pfspipe.ipmu.jp/jira/secure/attachment/15487/15487_pipe2d-1129.png" style="border: 0px solid black" /></span></p> <p>I've revised the distortion fitting a bit, and am now using a model with translation, rotation and scale in x and y for the left and right CCDs. I found that using separate scale changes for the x and y axes gives a much better fit than using a common scale change. I'm guessing that these are due to small tilts of the CCDs, which slightly change the distance to focus (and therefore the plate scale) linearly across the CCD.<br/> Here's an example:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> With single scale: reduceExposure.adjustDetectorMap INFO: Final result: chi2=877669.365862 dof=1014415 xRMS=0.030667 yRMS=0.184465 xSoften=0.026625 ySoften=0.000000 from 1010950 lines reduceExposure.adjustDetectorMap INFO: Stats <span class="code-keyword">for</span> OH: chi2=32617.887679 dof=6954 xRMS=0.068013 yRMS=0.184465 xSoften=0.000000 ySoften=0.129661 from 3477 lines With separate x and y scales: reduceExposure.adjustDetectorMap INFO: Final result: chi2=840824.684295 dof=1014325 xRMS=0.030314 yRMS=0.116222 xSoften=0.026204 ySoften=0.000000 from 1010932 lines reduceExposure.adjustDetectorMap INFO: Stats <span class="code-keyword">for</span> OH: chi2=15031.568652 dof=6814 xRMS=0.067002 yRMS=0.116222 xSoften=0.000000 ySoften=0.059637 from 3407 lines </pre> </div></div> <p>What this means is that we need to have wavelength references in the exposure in order to get good wavelength solutions.</p> <p>Preparing to merge, and here's a high-level summary of the changes:</p> <ul> <li>Added reduceExposure output "subtracted", which is an extraction-subtracted image.</li> <li>Added MultipleDistortionsDetectorMap, which layers distortions on top of the model detectorMap.<br/> + I expect this to eventually replace all other types of distorted detectorMaps, since it's capable of doing what they do and more.<br/> + Allows us to support empirical pixel-based distortions (e.g., tree rings) in the future.</li> <li>Added support for using trace x positions to constrain distortions in y.<br/> + Distortion in y is observed as a addition distortion in x of a trace because the traces are sloped.</li> <li>Added RotScaleDistortion and DoubleRotScaleDistortion to fit a translation, rotation and common scale in x and y.</li> <li>Parallelised the fitting in reduceArc.</li> <li>Various optimisations.</li> </ul> <p>Merged to master.</p> Development Rank 0|02qph7:07fr Reviewers hassan Sprint 2DDRP-2023 A