https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1248 DRP 2-D Pipeline <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=arnaud.lefur" class="user-hover" rel="arnaud.lefur">arnaud.lefur</a> <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1242?focusedCommentId=33275&amp;page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-33275" class="external-link" rel="nofollow">pointed out</a> a possible bug in the conversion of pfsArm to pfsMerged fluxes (where we convert from electrons to electrons/nm, and resample to a common grid). Here I will reconsider and/or attempt to justify the current scaling and resampling.</p> <p>It's worth pointing out that <b>none</b> of this affects the final flux calibration of pfsSingle and pfsObject (because those have applied a separate scaling using standard stars), only the scaling of pfsMerged.</p> PIPE2D-1248

Reconsider the scaling of fluxes in pfsMerged, and the use of Jacobians in interpolation

Story Normal Done Done price price Fri, 7 Jul 2023 16:38:17 +0000 Thu, 13 Jul 2023 19:08:47 +0000 Thu, 13 Jul 2023 19:08:47 +0000 0 2 <p>I believe the current code treats the flux units of pfsMerged as "electrons per nm per pixel", rather than the desired "electrons per nm", because as the pixel size changes (when we interpolate) the code attempts to correct for it (through the application of the Jacobian). The error I reminds me of what <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=rhl" class="user-hover" rel="rhl">rhl</a> has said before in the context of imaging pixels: that the value of the image at a particular position is value of whatever measurement at the center of the pixel, not the integrated value over the pixel.</p> <p>So the flux shouldn't care how the sampling changes when we interpolate (because we only care about the value at the center of the pixel; the size of the pixel doesn't matter). Then I should remove the Jacobian correction in the interpolation (which is making a correction for how the size of the pixel changes). Dividing the pfsArm flux (in electrons) by the dispersion (nm per pixel) is sufficient to perform the desired conversion from electrons to electrons per nm, and that's all we need.</p> <p>Sorry to have messed up something so elementary.</p> <p>Here's a demonstration of the new scaling, with no Jacobians. The pfsMerged flux is boosted at red end of the blue (because the dispersion there hits 0.065 nm/pix), and suppressed at the blue end of the red (dispersion 0.088 nm/pix).</p> <p><span class="image-wrap" style=""><img src="https://pfspipe.ipmu.jp/jira/secure/attachment/16145/16145_pipe2d-1248.png" width="500" style="border: 0px solid black" /></span></p> <p>I noticed that we were hard-wiring the pfsMerged wavelength sampling to have a dispersion about 0.081 nm/pixel, while the blue dispersion varies between 0.065 and 0.070 and the red between 0.082 and 0.088. So we're losing data in the blue due to the interpolation. I've changed the merging and coadding to use the minimum dispersion for the entire range. That's demonstrated in this plot of the dispersions (the black line is lower than the bottom of the blue line because the blue line is just for a single fiber in the center, whereas the black line is generated from considering all fibers):</p> <p><span class="image-wrap" style=""><img src="https://pfspipe.ipmu.jp/jira/secure/attachment/16146/16146_pipe2d-1248-dispersion.png" width="500" style="border: 0px solid black" /></span></p> <p>RHL pointed out that a dispersion of 0.08 nm/pixel is called out in the datamodel, so removed that change (tucked it in branch <tt>tickets/<a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1248" title="Reconsider the scaling of fluxes in pfsMerged, and the use of Jacobians in interpolation" class="issue-link" data-issue-key="PIPE2D-1248"><del>PIPE2D-1248</del></a>-abandoned</tt> in case we ever need something like it).</p> <p>Merged to master.</p> Development Rank 0|zzsylj: