https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-354 DRP 2-D Pipeline <p>As discussed on the Monday morning meting (January 28, 2019, presentation here: <a href="https://github.com/nevencaplar/PFS_Work_In_Progress/blob/master/Presentations_And_Reports/MondayMorningJanuary282019.pdf" class="external-link" rel="nofollow">https://github.com/nevencaplar/PFS_Work_In_Progress/blob/master/Presentations_And_Reports/MondayMorningJanuary282019.pdf</a>), we identified the need to improve the fitting of defocused images. The defocused images (see example in CloseResiduals.png attached below) exhibit speckle behavior, with small scale residuals. This is probably due to insufficient modeling of the wavefront aberrations, i.e., not including high enough Zernike orders when describing the wavefront. Dependence of residuals could possibly be modeled with PCA analysis, but exact method needs to be investigated. </p> PIPE2D-354

Estimate high-order Zernike from defocused images

Task Normal Done Done ncaplar ncaplar Mon, 11 Feb 2019 16:09:35 +0000 Mon, 13 Apr 2020 15:09:37 +0000 Thu, 4 Apr 2019 14:48:35 +0000 6.0 0 2 <p>Short update - I have semi-implemented the algorithm described here (<a href="https://arxiv.org/abs/astro-ph/0606388" class="external-link" rel="nofollow">https://arxiv.org/abs/astro-ph/0606388</a>) and used by A. Roodman with Dark Eenrgy Camera (<a href="http://spie.org/Publications/Proceedings/Paper/10.1117/12.857680" class="external-link" rel="nofollow">http://spie.org/Publications/Proceedings/Paper/10.1117/12.857680</a>). In the plot <tt>MoreZernike.png</tt> I am showing 1. at the left, starting proposal going up to zernike 22, 2. in the middle, adding 56 more Zernike components, 3. on the right, how would perfect subtractions look like.</p> <p>What has not yet been done:<br/> 1. The algorithm only varies higher order Zernike, i.e., keeps the component up to z22 fixed, and varies higher order. I would need to implement possibility to vary all the orders.<br/> 2. The code tries to minimize the difference between the model and the science image in flux, not in chi**2.<br/> 3. The code is not integrated with the rest of the fitting routine. <br/> This code to determine wavefront is also very fast, so the whole fitting routine would probably stand to benefit from it.</p> <p>After discussion with Robert during the Monday meeting and after the plan is:<br/> 1. Use this newly developed method to fit all the residuals. Involves some work in extending the code so that it can run in parallel on the cluster.<br/> 2. Do PCA analysis on the residuals. This is to be done on the vectors containing Zernike coefficients which best describe the improvement in the residual images. <br/> 3. Use this prediction to predict high-order corrections when moving into focus</p> <p>I have implemented a version of this code. With the full understanding that is not particularly transparent, the current code is at <a href="https://github.com/nevencaplar/PFS_Work_In_Progress/blob/master/Direct_and_Interpolation_Analysis_Extra_Zernike_Mar2019.py" class="external-link" rel="nofollow">https://github.com/nevencaplar/PFS_Work_In_Progress/blob/master/Direct_and_Interpolation_Analysis_Extra_Zernike_Mar2019.py</a><br/> The second part, basically outlined in the March 11 comment above has not been yet implemented, as we started to worry more about wrong characterization of the lower order Zernike (<a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-393" title="Test if variation of Zernike coefficients for term i does itself have a pattern of the ith Zernike polynomial" class="issue-link" data-issue-key="PIPE2D-393"><del>PIPE2D-393</del></a>). </p> <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=hassan" class="user-hover" rel="hassan">hassan</a> I recommend that we close this ticket on this level (shows that it improves final results and we likely have to considered it in the future) and resurrect it in the future as one of the improvements to the PSF solution code.</p> <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=ncaplar" class="user-hover" rel="ncaplar">ncaplar</a> ok, but can you create a new ticket to track the extra work you proposed in your 11 March comment please?</p> <p>Closed following <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=ncaplar" class="user-hover" rel="ncaplar">ncaplar</a> recent comment - additional tickets will be created to track further work.</p> Blocks PIPE2D-553 Relates PIPE2D-555 PIPE2D-394 Development Rank 0|02qpt6:508yjj3i Reviewers hassan Sprint 2019 B 2DDRP-2019 C Story Points 10.0