https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-779 DRP 2-D Pipeline <p>After we resolve and merge <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-725" title="Cosmic ray detection/masking fails for SuNSS data" class="issue-link" data-issue-key="PIPE2D-725"><del>PIPE2D-725</del></a>, we still need to work on the CR algorithms. Most importantly we need to improve the fraction of detected CRs (although it's not bad already), but it's also worth thinking if we'd gain from better CR interpolation.</p> PIPE2D-779

Improve CR rejection in SuNSS

Story Normal Open Unresolved price rhl Fri, 12 Mar 2021 15:13:04 +0000 Thu, 13 Jan 2022 14:57:15 +0000 0 2 <p>Here's an amusing example, where we find the muon between the traces. <span class="image-wrap" style=""><a id="13433_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13433/13433_arcs-as-crs.png" title="arcs-as-crs.png" file-preview-type="image" file-preview-id="13433" file-preview-title="arcs-as-crs.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13413/_thumb_13413.png" style="border: 0px solid black" /></a></span> </p> <p><span class="image-wrap" style=""><a id="13435_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13435/13435_image+%287%29.png" title="image (7).png" file-preview-type="image" file-preview-id="13435" file-preview-title="image (7).png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13433/_thumb_13433.png" style="border: 0px solid black" /></a></span>  is an example of arc lines being labelled as CRs (this is using <tt>makeCRMosaic</tt> from <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-773" title="Make small improvements to utilities" class="issue-link" data-issue-key="PIPE2D-773"><del>PIPE2D-773</del></a>.  Each CR appears in two panels, raw on the left, calexp on the right.  The axis labels are in mosaic units, but the utility provides a mouse-over in calexp coordinates).  This is with <tt>repair.interp.modelPsf.defaultFwhm=2.5</tt>.  If I lower this to <tt>2.25</tt> the problem goes away, but we seem to miss real Cosmics</p> <p>Here's a rather worrying presumed-cosmic ray <span class="image-wrap" style=""><a id="13434_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13434/13434_image+%288%29.png" title="image (8).png" file-preview-type="image" file-preview-id="13434" file-preview-title="image (8).png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13435/_thumb_13435.png" style="border: 0px solid black" /></a></span> .  It's flagged as CR (green pixels at the bottom) (but that may just because it's so bright, and we "should" be labelling the sky lines too).  The cross-section is slightly <em>wider</em> than an arc line ( <span class="image-wrap" style=""><a id="13436_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13436/13436_missed-CRs.png" title="missed-CRs.png" file-preview-type="image" file-preview-id="13436" file-preview-title="missed-CRs.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13434/_thumb_13434.png" style="border: 0px solid black" /></a></span> ), so it's going to be hard to get things like this out of the data (although it's centroid isn't consistent with being on any fibre)</p> <p>I think combining multiple exposures is going to be an important part of our CR mitigation strategy, because we're not going to be able to find all of them based on morphology alone.</p> <p>I don't disagree with Paul, but we may not always have the luxury of CR splits.</p> <p>Here's an example of CRs we're missing with <tt>repair.interp.modelPsf.defaultFwhm=2.25</tt> <span class="image-wrap" style=""><a id="13521_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13521/13521_image+%289%29.png" title="image (9).png" file-preview-type="image" file-preview-id="13521" file-preview-title="image (9).png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13436/_thumb_13436.png" style="border: 0px solid black" /></a></span> </p> <p>And here's another fat trail <span class="image-wrap" style=""><a id="13522_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13522/13522_Untitled+40.png" title="Untitled 40.png" file-preview-type="image" file-preview-id="13522" file-preview-title="Untitled 40.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13521/_thumb_13521.png" style="border: 0px solid black" /></a></span> (note the muon tracks in the background). I'm beginning to worry if we're not fully depleting the CCD, as I don't remember things like this from HSC (or LSST, but it has thinner devices and smaller pixels).</p> <p>Here's another fascinating event: <span class="image-wrap" style=""><a id="13528_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13528/13528_Untitled+41.png" title="Untitled 41.png" file-preview-type="image" file-preview-id="13528" file-preview-title="Untitled 41.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13522/_thumb_13522.png" style="border: 0px solid black" /></a></span> </p> <p>Here's a case of a CR masquerading as part of an emission line. <span class="image-wrap" style=""><a id="13529_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13529/13529_Untitled+42.png" title="Untitled 42.png" file-preview-type="image" file-preview-id="13529" file-preview-title="Untitled 42.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13528/_thumb_13528.png" style="border: 0px solid black" /></a></span> <br/> Here we detected the CR, but there's flux in the extracted spectrum; here's <span class="image-wrap" style=""><a id="13538_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13538/13538_Untitled+8b.png" title="Untitled 8b.png" file-preview-type="image" file-preview-id="13538" file-preview-title="Untitled 8b.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13529/_thumb_13529.png" style="border: 0px solid black" /></a></span> the spectrum, but only the blue-side is labelled as a CR.</p> <p>Here are three of these fat events in one frame  <span class="image-wrap" style=""><a id="13540_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13540/13540_46475-CR-img.png" title="46475-CR-img.png" file-preview-type="image" file-preview-id="13540" file-preview-title="46475-CR-img.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13536/_thumb_13536.png" style="border: 0px solid black" /></a></span> <span class="image-wrap" style=""><a id="13539_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13539/13539_46475-CR-spec.png" title="46475-CR-spec.png" file-preview-type="image" file-preview-id="13539" file-preview-title="46475-CR-spec.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13538/_thumb_13538.png" style="border: 0px solid black" /></a></span> </p> <p>And here's a CR that's just to the left of the trace at the position of an emission line.  <span class="image-wrap" style=""><a id="13539_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13539/13539_46475-CR-spec.png" title="46475-CR-spec.png" file-preview-type="image" file-preview-id="13539" file-preview-title="46475-CR-spec.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13540/_thumb_13540.png" style="border: 0px solid black" /></a></span><span class="image-wrap" style=""><a id="13539_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/13539/13539_46475-CR-spec.png" title="46475-CR-spec.png" file-preview-type="image" file-preview-id="13539" file-preview-title="46475-CR-spec.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/13539/_thumb_13539.png" style="border: 0px solid black" /></a></span></p> <p>Do you have an algorithm in mind for finding these CRs, or is this a research project?</p> Development Rank 0|02qpq3:r3s00000001 Sprint 2DDRP-2021 A 8 Story Points 3.0