https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-509 DRP 2-D Pipeline <p>The task is to analyze and find how much defocus is needed in order to measure the realistic change of frd, in realistic conditions. This is to be done with our current knowledge about the system and with the 2d psf modeling code. </p> <p>The task includes (we might break this into finer additional tickets):</p> <ol> <li>determining what values of frd change we expect and what level do we need to measure (we might need to solicit some input from Jim on this)</li> <li>Determine defocus values that allow to measure these changes as a function of signal-noise and position on the detector (center, edges...)</li> </ol> <p>This is rehashing of <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-452" title="Develop methods to quickly estimate effective FRD from defocused images" class="issue-link" data-issue-key="PIPE2D-452"><del>PIPE2D-452</del></a> updated to signify updated constraints and the transfer of this work to Caltech</p> PIPE2D-509

How much do we need to defocus in order to measure change of effective frd

Task Normal Open Unresolved Brent Belland ncaplar Mon, 27 Jan 2020 14:32:42 +0000 Thu, 13 Jan 2022 14:40:20 +0000 0 5 <p>I have placed pandas dataframe describing the spots across the detector at [https://github.com/Subaru-PFS/dev_2ddrp/tree/master/2d_PSF_code/Data/results_of_fit_many_interpolation_HgAr_from_Dec04.pkl|https://github.com/Subaru-PFS/dev_2ddrp/tree/master/2d_PSF_code/Data/[results_of_fit_many_interpolation_HgAr_from_Dec04.pkl]. Brent you can load it by </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> <span class="code-keyword">import</span> pickle DATAFRAMES_FOLDER=<span class="code-quote">'/Users/nevencaplar/Documents/PFS/Fit_Results/Dec040119/'</span> with open(DATAFRAMES_FOLDER+<span class="code-quote">'results_of_fit_many_interpolation_HgAr_from_Dec04.pkl'</span>, <span class="code-quote">'rb'</span>) as f:     results_of_fit_many_interpolation_HgAr_from_Dec04=pickle.load(f)</pre> </div></div> <p>where you replace the path in `DATAFRAMES_FOLDER` to where you have placed the file. Then you can access the values for each defocus by specifying in the label e.g., </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> results_of_fit_many_interpolation_HgAr_from_Dec04[<span class="code-quote">'m1'</span>]</pre> </div></div> <p>would give the values of parameters at minus 1 mm of slit defocus at LAM. Other values are m45,m4,m35,m3,m25,m2,m15,m1,m05,0,p05,p1,p15,p2,p25,p3,p35,p4,p45. I recommend that at the start you use values for spot 1 (spot in the lower left corner of the detector ) and spot 55 (roughly in the center). To get values for these spots at a given defocus one would do something like</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> results_of_fit_many_interpolation_HgAr_from_Dec04[<span class="code-quote">'p35'</span>].loc[1]</pre> </div></div> <p>to get, for instance, values for spot 1, at plus 3.5 mm defocus of slit at LAM. </p> <p>As to work on part 1: Based on a report PFS-PFI-IPM000003-02_SuccessCriteriaCobraModuleFRDandRelativeThroughput I find that cable A has an expected average FRD of 10 mrad and Cable B has an expected average FRD of 17 mrad. Cable C has an average of 10 mrad; two ~10 mrad angular misalignments in connections between cables are introduced. Variations in Cobra angular error and nontelecentricity as well as uncertainties in Cable C FRD (standard deviation of 2 mrad) can be incorporated.</p> <p>An overall range of FRD in a single fiber with variation in angle. The </p> <p>In an very extreme minimum case, FRD^2 ~ 100+289+36+0+100 ~&gt; FRD of 20 mrad (no Cobra angular misalignment + perfect C cable)</p> <p>Then for the most variation in that fiber, FRD^2 ~ 100+289+36+312.5+100 ~&gt; FRD of 29 mrad (high end of Cobra angular misalignment)</p> <p>Notably, an extreme maximal case of FRD^2 ~ 100+289+196+312.5+100 ~&gt; FRD of 32 mrad. (max Cobra angular misalignment + high FRD C cable) if a stress were imposed on the cable. </p> <p> </p> <p>I'll post an image detailing how FRD and angle vary soon.</p> <p>As to part 2: I had an issue reading the files which was entirely on my end; python incompatibility. Updated my python but completing the upgrade will take a bit of time. I can access all of the data though and am starting to go through it.</p> <p> </p> <p>I've run tests to calculate the change in FRD. To calculate the change in profile, I took the residual of images generated in Neven’s 2D-DRP code at varying FRD values . Zernike coefficients provided by Neven from LAM data in the HgAr lamp on December 4th were used to accurately simulate the profile images.</p> <p>Variations in FRD were considered over a variety of defocus values (0-4 mm in steps of 0.5 mm) and signal to noise ratio. Noise was modeled as Poisson noise plus a read noise of ~6.5 counts (40 counts in variance), and signal was increased from scaling the brightest pixel in each image to a uniform value.</p> <p>For uniformity, initial FRD was taken to be the value from the FRD data. The corresponding value of sigma_FRD in the data is 0.0603; converting from this code value to a real value of FRD using the logic in <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-508" title="Find out translation from real frd to `frd_sigma` parameter 2d psf_model " class="issue-link" data-issue-key="PIPE2D-508"><del>PIPE2D-508</del></a> yields an effective FRD of 0.17857*sqrt(2)*0.0603/0.92 ~ 16.5 milliradians, assuming an input f/number of 2.8. Then, FRD was scaled up and down from this value: 0.8 times this FRD (13.2 milliradians) to 1.2 times this FRD (19.9 milliradians).</p> <p>Chi squared was selected as an appropriate metric to characterize the FRD image residuals as it could be meaningfully applied across images at varying defocus and did not depend on any local features in the pupil images. However, at larger defocus the residuals across FRD have a distinct structure that could be utilized in both distinguishing FRD from competing effects and approximating FRD changes in a linear approximation fashion. Work in this area is ongoing.</p> <p>Detectability was quantified by measuring the standard deviation of the averaged chi squared metric when just the noise data was considered. Only pixels brighter than a threshold of ~2% maximum brightness plus read noise were considered in the chi squared calculation, since the addition of pixels outside the image decreases the effective The detectability criterion was taken to be three times this standard deviation at every defocus. At smaller defocus, the standard deviation in chi squared is larger due to the lower number of pixels, which matches intuition that changes in the PSF are harder to detect at low defocus.</p> <p>Variations of Chi squared versus defocus at four signals are shown in FRD_Change_Detect_Center. Note that the Chi squared axis is logarithmic and not the same between plots. Error bars for a given FRD indicate the 16%-84% percentile of Chi squared variation at that combination of defocus, SNR, and FRD over 100 trials.</p> <p><span class="image-wrap" style=""><img src="https://pfspipe.ipmu.jp/jira/secure/attachment/12526/12526_image-2020-03-16-06-34-09-667.png" style="border: 0px solid black" /></span></p> <p>Even at brightest signal of 60000 counts (~90% of the saturation limit of 65k counts), a defocus of 1mm is required to reasonably confidently detect a change on the order of 1.5 mrad, but at lower signal a larger defocus is required.</p> <p>To visualize the residual variation with FRD change, Residuals_Analysis was also uploaded. This indicates the FRD images at 16.5 mrad FRD (top left), 31.0 mrad FRD (top right), noise residual (bottom left) and image residual (bottom right). While FRD change is more extreme than would be expected in the PFS, the structure of the residuals is very apparent. Smaller FRD changes have similar residuals at smaller magnitudes and are a promising avenue to speed up the analysis and robustly detect FRD variation.</p> <p><span class="image-wrap" style=""><a id="12533_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/12533/12533_FRD_Change_Detect_Corner.png" title="FRD_Change_Detect_Corner.png" file-preview-type="image" file-preview-id="12533" file-preview-title="FRD_Change_Detect_Corner.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/12527/_thumb_12527.png" style="border: 0px solid black" /></a></span></p> <p>A basic example of the masking used in the chi squared calculation is shown below in Masking_Simple. An image example spectrograph image is shown above, and the selected pixels for the analysis are shown below in yellow. Pixels on the order of brightness of the background are not considered in the analysis.</p> <p><span class="image-wrap" style=""><img src="https://pfspipe.ipmu.jp/jira/secure/attachment/12529/12529_image-2020-03-16-10-53-22-346.png" style="border: 0px solid black" /></span></p> <p>Below are plots that correspond to the FRD change detectability at a corner of the spectrograph. It seems like it's actually easier to detect changes near the edges, but I plan on investigating at other locations as well.</p> <p> </p> <p><span class="image-wrap" style=""><a id="12532_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/12532/12532_Residuals_Analysis_Corner.png" title="Residuals_Analysis_Corner.png" file-preview-type="image" file-preview-id="12532" file-preview-title="Residuals_Analysis_Corner.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/12533/_thumb_12533.png" style="border: 0px solid black" /></a></span></p> <p><span class="image-wrap" style=""><a id="12532_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/12532/12532_Residuals_Analysis_Corner.png" title="Residuals_Analysis_Corner.png" file-preview-type="image" file-preview-id="12532" file-preview-title="Residuals_Analysis_Corner.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/12532/_thumb_12532.png" style="border: 0px solid black" /></a></span></p> <p>Changes in FRD (even on the order of 1.5 mrad) are readily detectable at ~60000 counts at defocuses &gt;= 1mm. The amount of defocus needed to measure changes in FRD seems to be quantified to a degree that this purpose of the ticket is answered. </p> <p>However, from a conversation with Jim and Neven, the current focus of the investigation should be on FRD-induced variations on the PSF when the instrument is at or near focus (&lt; 1mm). This work relates to <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-285" title="Quantify the effect of FRD variations on the PSF" class="issue-link" data-issue-key="PIPE2D-285"><del>PIPE2D-285</del></a>, but this new work will have its own ticket.</p> <p>This ticket will be closed with future work added to upcoming tickets.</p> <p>You should be able to convert "readily detectable" into a quantitative statement about the in-focus PSFs given Neven's optical model, or possibly even a simple pupil model and perfect optics. Do you have any feeling for the size of the effect?</p> Relates PIPE2D-508 PIPE2D-574 PIPE2D-285 PIPE2D-452 Development Rank 0|02qpq3:r3s2r Sprint 2DDRP-2021 A Story Points 8.0