<!-- 
RSS generated by JIRA (8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b) at Sat Feb 10 16:02:56 JST 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>PFS-JIRA</title>
    <link>https://pfspipe.ipmu.jp/jira</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>8.3.4</version>
        <build-number>803005</build-number>
        <build-date>13-09-2019</build-date>
    </build-info>


<item>
            <title>[PIPE2D-1111] Extremely large wavelength difference of the detector map adjusted with few sky lines.</title>
                <link>https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1111</link>
                <project id="10002" key="PIPE2D">DRP 2-D Pipeline</project>
                    <description>&lt;p&gt;pfs_pipe2d version: w.2022.43&lt;/p&gt;

&lt;p&gt;The detector map adjusted with very few sky lines shows the large wavelength difference (&amp;gt;1 nm for arm &apos;b&apos; of the SuNSS data) from the wavelength solution in the original detector map before adjustment.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;An example of the SuNSS data (arm b of visit=80906 obtained in 2022-10-05) is shown below.&lt;/p&gt;

&lt;p&gt;Only a few sky lines are detected in the image of arm b. Especially, there is no sky lines seen in the blue side (lower side in the attached calExp image).&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://pfspipe.ipmu.jp/jira/secure/attachment/15431/15431_calExp_v80906_b1-2.png&quot; height=&quot;456&quot; width=&quot;547&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;When this image is reduced with reduceExposure.py using the reduced calibration data prepared in 2022-06-30, the wavelength solution in the adjusted detector map shows a very large difference from that of the original detector map. Below image shows the wavelength difference between the detector maps (the original wavelength solution was subtracted from the adjusted wavelength solution). The wavelength difference is larger than 1 nm in the red side of the detector.&#160;&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://pfspipe.ipmu.jp/jira/secure/attachment/15430/15430_detMap_dif_v80906_b1_v43-2.png&quot; height=&quot;399&quot; width=&quot;479&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;When these two detector maps are compared with the Ar lamp image (visit=79997 obtained in 2022-09-25), the original detector map matches well with the detected Ar line positions. In the below image, the positions of Ar lines in the detector map are plotted with dots (red: the detector map adjusted with SuNSS data, blue: the original detector map) over the calExp image of Ar lamp data shown with gray scale. Only bottom quarter of the image, where the wavelength difference is quite large, is shown here. Other three quarter images are attached to this ticket.&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://pfspipe.ipmu.jp/jira/secure/attachment/15429/15429_calExp_v79997_b1_wdmap_v43_x1_y1-3.png&quot; height=&quot;277&quot; width=&quot;926&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;Therefore, the adjustment of the detector map seems to fail in the region where very few or no sky lines are detected.&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</description>
                <environment></environment>
        <key id="23101">PIPE2D-1111</key>
            <summary>Extremely large wavelength difference of the detector map adjusted with few sky lines.</summary>
                <type id="1" iconUrl="https://pfspipe.ipmu.jp/jira/secure/viewavatar?size=xsmall&amp;avatarId=10503&amp;avatarType=issuetype">Bug</type>
                                            <priority id="10000" iconUrl="https://pfspipe.ipmu.jp/jira/images/icons/priorities/medium.svg">Normal</priority>
                        <status id="10002" iconUrl="https://pfspipe.ipmu.jp/jira/images/icons/statuses/generic.png" description="The issue is resolved, reviewed, and merged">Done</status>
                    <statusCategory id="3" key="done" colorName="green"/>
                                    <resolution id="10000">Done</resolution>
                                        <assignee username="price">price</assignee>
                                    <reporter username="shamano">Satoshi Hamano</reporter>
                        <labels>
                    </labels>
                <created>Mon, 7 Nov 2022 15:28:06 +0000</created>
                <updated>Tue, 29 Nov 2022 00:25:28 +0000</updated>
                            <resolved>Tue, 29 Nov 2022 00:25:28 +0000</resolved>
                                                                        <due></due>
                            <votes>0</votes>
                                    <watches>3</watches>
                                                                <comments>
                            <comment id="31771" author="price" created="Tue, 8 Nov 2022 18:30:26 +0000"  >&lt;p&gt;What version of the calibs are you using?&lt;/p&gt;</comment>
                            <comment id="31772" author="price" created="Tue, 8 Nov 2022 19:51:48 +0000"  >&lt;p&gt;Oh, it looks like you&apos;re using &lt;tt&gt;CALIB-20220630&lt;/tt&gt;.&lt;br/&gt;
I&apos;m looking into whether the detectorMap has somehow changed since that was created, or if our measurements are causing bad fits.&lt;/p&gt;</comment>
                            <comment id="31776" author="shamano" created="Wed, 9 Nov 2022 04:07:07 +0000"  >&lt;p&gt;Yes, I used &apos;CALIB-20220630&apos;.&lt;/p&gt;</comment>
                            <comment id="31777" author="price" created="Wed, 9 Nov 2022 20:10:11 +0000"  >&lt;p&gt;I&apos;ve made some fixes to obs&amp;#95;pfs and drp&amp;#95;stella that I think improve the measurement of the centroids and the fitting of the detectorMap adjustment. I&apos;d appreciate your evaluation of the results.&lt;/p&gt;

&lt;p&gt;Please keep in mind that while the size of the change to the detectorMap might be a hint to the quality of the adjustment, we are more interested in the accuracy with which the adjusted detectorMap reproduces the x,y positions. That&apos;s difficult to measure at the blue end of the blue arm with sky data, so maybe the size of the change is mostly all we have to work with. But knowing the changes is not useful without some idea of what they should be.&lt;/p&gt;</comment>
                            <comment id="31779" author="shamano" created="Thu, 10 Nov 2022 16:42:05 +0000"  >&lt;p&gt;Please ignore the two attached png files I uploaded about an hour ago. It&apos;s a mistake. I couldn&apos;t delete them.&lt;/p&gt;</comment>
                            <comment id="31780" author="shamano" created="Thu, 10 Nov 2022 16:45:43 +0000"  >&lt;p&gt;I checked the result of reduceExposure.py in the branch of &quot;tickets/&lt;a href=&quot;https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1111&quot; title=&quot;Extremely large wavelength difference of the detector map adjusted with few sky lines.&quot; class=&quot;issue-link&quot; data-issue-key=&quot;PIPE2D-1111&quot;&gt;&lt;del&gt;PIPE2D-1111&lt;/del&gt;&lt;/a&gt;&quot;, and confirmed the fitting results was improved. I could reproduce the figure attached by Paul.&lt;/p&gt;</comment>
                            <comment id="31824" author="price" created="Tue, 22 Nov 2022 19:12:20 +0000"  >&lt;p&gt;I finally reached a conclusion that I&apos;m satisfied with. The lack of CR masking before detectorMap adjustment was generating a lot of garbage trace centroids that were causing many of the good, solid measurements of sky lines to be rejected. With CR masking before detectorMap adjustment, we get much better fits, and a more uniform shift in both xCenter and wavelength.&lt;/p&gt;
&lt;div class=&quot;code panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;codeContent panelContent&quot;&gt;
&lt;pre class=&quot;code-java&quot;&gt;
reduceExposure.adjustDetectorMap INFO: Final result: chi2=4360.657959 dof=3723 xRMS=0.051719 yRMS=0.055085 xSoften=0.028748 ySoften=0.000000 from 2894 lines
reduceExposure.adjustDetectorMap INFO: Stats &lt;span class=&quot;code-keyword&quot;&gt;for&lt;/span&gt; NaI: chi2=733.738466 dof=872 xRMS=0.062353 yRMS=0.074312 xSoften=0.000000 ySoften=0.000000 from 436 lines
reduceExposure.adjustDetectorMap INFO: Stats &lt;span class=&quot;code-keyword&quot;&gt;for&lt;/span&gt; OH: chi2=0.000000 dof=0 xRMS=nan yRMS=nan xSoften=0.000000 ySoften=0.000000 from 0 lines
reduceExposure.adjustDetectorMap INFO: Stats &lt;span class=&quot;code-keyword&quot;&gt;for&lt;/span&gt; OI: chi2=629.056168 dof=834 xRMS=0.037867 yRMS=0.044958 xSoften=0.000000 ySoften=0.000000 from 417 lines
reduceExposure.adjustDetectorMap INFO: Stats &lt;span class=&quot;code-keyword&quot;&gt;for&lt;/span&gt; Trace: chi2=2997.863325 dof=2041 xRMS=0.052885 yRMS=nan xSoften=0.043437 ySoften=0.000000 from 2041 lines
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://pfspipe.ipmu.jp/jira/secure/attachment/15440/15440_pipe2d-1111-fix.jpg&quot; width=&quot;500&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;/p&gt;</comment>
                            <comment id="31825" author="hassan" created="Tue, 22 Nov 2022 22:27:12 +0000"  >&lt;p&gt;Changes look fine. Minor comment on refactoring added to pull request.&lt;/p&gt;</comment>
                            <comment id="31849" author="price" created="Tue, 29 Nov 2022 00:25:28 +0000"  >&lt;p&gt;Refactored as suggested, and merged.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="15429" name="calExp_v79997_b1_wdmap_v43_x1_y1-3.png" size="911129" author="shamano" created="Mon, 7 Nov 2022 15:14:47 +0000"/>
                            <attachment id="15426" name="calExp_v79997_b1_wdmap_v43_x1_y2-3.png" size="927819" author="shamano" created="Mon, 7 Nov 2022 15:22:55 +0000"/>
                            <attachment id="15427" name="calExp_v79997_b1_wdmap_v43_x1_y3-3.png" size="986481" author="shamano" created="Mon, 7 Nov 2022 15:22:54 +0000"/>
                            <attachment id="15428" name="calExp_v79997_b1_wdmap_v43_x1_y4-3.png" size="1032821" author="shamano" created="Mon, 7 Nov 2022 15:22:36 +0000"/>
                            <attachment id="15431" name="calExp_v80906_b1-2.png" size="770501" author="shamano" created="Mon, 7 Nov 2022 14:49:08 +0000"/>
                            <attachment id="15430" name="detMap_dif_v80906_b1_v43-2.png" size="189348" author="shamano" created="Mon, 7 Nov 2022 15:07:11 +0000"/>
                            <attachment id="15435" name="detMap_dif_v80906_b1_v45+1.png" size="167512" author="shamano" created="Thu, 10 Nov 2022 15:34:07 +0000"/>
                            <attachment id="15436" name="detMap_dif_v80906_b1_xc_v45+1.png" size="253456" author="shamano" created="Thu, 10 Nov 2022 15:34:07 +0000"/>
                            <attachment id="15440" name="pipe2d-1111-fix.jpg" size="176123" author="price" created="Tue, 22 Nov 2022 19:08:01 +0000"/>
                            <attachment id="15441" name="pipe2d-1111.ipynb" size="3724927" author="price" created="Tue, 22 Nov 2022 19:08:17 +0000"/>
                            <attachment id="15434" name="pipe2d-1111.jpg" size="214771" author="price" created="Wed, 9 Nov 2022 20:01:16 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10500" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                            <customfield id="customfield_10010" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>0|02qpjd:00r20060i3</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10100" key="com.atlassian.jira.plugin.system.customfieldtypes:userpicker">
                        <customfieldname>Reviewers</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>hassan</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                </customfields>
    </item>
</channel>
</rss>