https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1181 DRP 2-D Pipeline <p>We need to demonstrate that we're able to extract n arm spectra using the pipeline.<br/> For that purpose, we would use n2 DCB data, providing the camera is in reasonably good focus <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=fmadec" class="user-hover" rel="fmadec">fmadec</a> ?</p> <p>We need few quartz and krypton exposure, if we can interleave some darks as well, that'd be good to check persistence.</p> PIPE2D-1181

demonstrate spectra extraction on N2 LAM data.

Task Normal Done Done Unassigned arnaud.lefur EngRun Wed, 8 Mar 2023 01:18:09 +0000 Thu, 6 Apr 2023 18:34:09 +0000 Thu, 6 Apr 2023 15:17:52 +0000 0 2 <p>So to be more specific :</p> <ul> <li>dark exptime=20 duplicate=3</li> <li>scienceTrace halogen=4 duplicate=1</li> <li>dark exptime=20 duplicate=3</li> <li>scienceArc krypton=3 duplicate=1</li> <li>dark exptime=20 duplicate=3</li> <li>scienceArc argon=10 duplicate=1</li> <li>dark exptime=20 duplicate=3</li> <li>scienceArc xenon=3 duplicate=1</li> </ul> <p>repeat this 5 times.</p> <p> <span class="image-wrap" style=""><a id="15579_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/15579/15579_N2_dcb_krypton_46415_INTRP.png" title="N2_dcb_krypton_46415_INTRP.png" file-preview-type="image" file-preview-id="15579" file-preview-title="N2_dcb_krypton_46415_INTRP.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/15575/_thumb_15575.png" style="border: 0px solid black" /></a></span> <br/> So, I reduced a LAM krypton exposure, there is still quite a lot of bad features remaining in the spectra, depending on the fiber.<br/> The black curve is the clipped-mean spectra of all fibers.</p> <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=price" class="user-hover" rel="price">price</a> when I plot using pfsArm.mask, almost everything get masked, am I misusing something ?</p> <p>What mask planes do you have, and what are their counts? <a href="https://github.com/Subaru-PFS/datamodel/blob/master/python/pfs/datamodel/masks.py#L153-L167" class="external-link" rel="nofollow">This might help.</a></p> <p>Thanks, it definely helped, I've attached a file with the masks value and their occurence for each fiber.</p> <p>Just ignore only the <tt>(mask &amp; NO_DATA) != 0</tt> pixels, and you'll get a lot more spectral data.</p> <p>Thanks.<br/> I've also noticed that INTRP flag contains partly junk as well : </p> <p> <span class="image-wrap" style=""><a id="15581_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/15581/15581_N2_dcb_krypton_46415_NO_INTRP.png" title="N2_dcb_krypton_46415_NO_INTRP.png" file-preview-type="image" file-preview-id="15581" file-preview-title="N2_dcb_krypton_46415_NO_INTRP.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/15579/_thumb_15579.png" style="border: 0px solid black" /></a></span> <br/> <span class="image-wrap" style=""><a id="15581_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/15581/15581_N2_dcb_krypton_46415_NO_INTRP.png" title="N2_dcb_krypton_46415_NO_INTRP.png" file-preview-type="image" file-preview-id="15581" file-preview-title="N2_dcb_krypton_46415_NO_INTRP.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/15581/_thumb_15581.png" style="border: 0px solid black" /></a></span> </p> <p><tt>INTRP</tt> means we interpolated the pixel because it's bad (which makes the image looks nicer). Those pixels should be ignored during the extraction (not because of <tt>INTRP</tt>, but because of what caused <tt>INTRP</tt> to get set). If the spectra have bad pixels with <tt>INTRP</tt> set, it means that there are image pixels in the same row as the <tt>INTRP</tt> pixels that are also bad but we're not catching.</p> <p>The conclusion is that we're able to extract spectra, see figures from N2(sn1).<br/> But there are still some junk features in it, those are mostly flagged INTRP.<br/> If you ignore INTRP | NO_DATA, the spectra is cleaner but you lose quite a lot of data points.</p> Development Rank 0|02qpgo: Sprint 2DDRP-2023 A