<!-- 
RSS generated by JIRA (8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b) at Sat Feb 10 15:59:37 JST 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>PFS-JIRA</title>
    <link>https://pfspipe.ipmu.jp/jira</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>8.3.4</version>
        <build-number>803005</build-number>
        <build-date>13-09-2019</build-date>
    </build-info>


<item>
            <title>[PIPE2D-911] Compare flux in observatiosn of sky with SuNNs, PFI, and calib lamps</title>
                <link>https://pfspipe.ipmu.jp/jira/browse/PIPE2D-911</link>
                <project id="10002" key="PIPE2D">DRP 2-D Pipeline</project>
                    <description>&lt;p&gt;Compare the flux observed in&#160;&lt;/p&gt;

&lt;p&gt;a) sky observations&lt;/p&gt;

&lt;p&gt;b) SuNNs observations (matched to sky observations)&lt;br/&gt;
 c)calibration lamps&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Relevant notebook is on Tiger, at:&lt;/p&gt;
&lt;div class=&quot;code panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;codeContent panelContent&quot;&gt;
&lt;pre class=&quot;code-java&quot;&gt;
/home/ncaplar/Pipeline_notebooks/PIPE2D-911 (Compare flux sky_PFI_SuNNS and calib).ipynb&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;</description>
                <environment></environment>
        <key id="17214">PIPE2D-911</key>
            <summary>Compare flux in observatiosn of sky with SuNNs, PFI, and calib lamps</summary>
                <type id="3" iconUrl="https://pfspipe.ipmu.jp/jira/secure/viewavatar?size=xsmall&amp;avatarId=10518&amp;avatarType=issuetype">Task</type>
                                            <priority id="10000" iconUrl="https://pfspipe.ipmu.jp/jira/images/icons/priorities/medium.svg">Normal</priority>
                        <status id="10002" iconUrl="https://pfspipe.ipmu.jp/jira/images/icons/statuses/generic.png" description="The issue is resolved, reviewed, and merged">Done</status>
                    <statusCategory id="3" key="done" colorName="green"/>
                                    <resolution id="10000">Done</resolution>
                                        <assignee username="ncaplar">ncaplar</assignee>
                                    <reporter username="ncaplar">ncaplar</reporter>
                        <labels>
                    </labels>
                <created>Fri, 1 Oct 2021 18:26:17 +0000</created>
                <updated>Sun, 21 Nov 2021 07:02:30 +0000</updated>
                            <resolved>Sun, 21 Nov 2021 07:02:25 +0000</resolved>
                                                                        <due></due>
                            <votes>0</votes>
                                    <watches>2</watches>
                                                                <comments>
                            <comment id="22254" author="ncaplar" created="Tue, 5 Oct 2021 15:31:23 +0000"  >&lt;p&gt;I have measured the flux in PFI and SuNNs exposures and compared the value.&lt;/p&gt;

&lt;p&gt;I have taken detrended images and, using the detectormap, extracted 7x60 region around each available fiber (7 pixels in x direction, 60 pixels in y direction) at 800 nm.&#160; I have then taken the median value of all extracted fibers to be a representative measurement of flux in that particular visit.&lt;/p&gt;

&lt;p&gt;I have used the data taken by SuNNs in March and April 2021. For PFI I have used exposures with visit_id 68878, 68879 and 68881.&lt;/p&gt;

&lt;p&gt;In&#160;comparison_of_flux_PFI_SuNNs.png I have plotted the mean measured flux as a function of time during the night, relative to midnight Hawaii time. This is because I can cleary see the dependence of flux as a function of time during night (comparison_of_flux_PFI_SuNNs_via_visit_id.png). I have also overploted very naive fit to the SuNNs data - but please note many outliers and spread, which makes this extremely unreliable measurement.&lt;/p&gt;

&lt;p&gt;We see that PFI exposures are of comparable brightness to a darker set of SuNNs exposures. They might be dimmer than expected given the time of the night (but also note the largest difference in seasons when PFI and SuNNs data have been taken; and different observations configurations. I did very simple of analysis of moon phase during SuNNs observations, but I see no dependence).&lt;/p&gt;

&lt;p&gt;The initial investigation was promoted by my observation that PFI exposures&#160; reach up to 4k flux in the brightest pixels, while &lt;a href=&quot;https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=rhl&quot; class=&quot;user-hover&quot; rel=&quot;rhl&quot;&gt;rhl&lt;/a&gt;&#160;seemed to remember that SuNNs observation tended to saturate the detector - which would indicate large discrepancy in the flux levels. On the other hand, the vast majority of SuNNs exposures that I have looked at have comparable levels of flux, and I do not see any saturations. &lt;a href=&quot;https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=rhl&quot; class=&quot;user-hover&quot; rel=&quot;rhl&quot;&gt;rhl&lt;/a&gt;&#160;is it possible that your observations that SuNNs observations are often saturated is from earlier data (and I should look at them), or perhaps from some sort of dedicated observations? At the moment, I am a bit confused by this discrepancy between your statement and the data that I am looking at.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="25173" author="ncaplar" created="Sun, 21 Nov 2021 07:02:25 +0000"  >&lt;p&gt;There is no code to review, I just wanted to make sure you are informed that I think I am seeing some weird arcLines.flux measurements in SuNNS data. That is probably not surprising given that Paul only recently implement this code for such a difficult problem, but just confirming, we might need to look into that more. Lets keep that in the back of our heads.&lt;/p&gt;</comment>
                            <comment id="25174" author="ncaplar" created="Sun, 21 Nov 2021 07:02:30 +0000"  >&lt;p&gt;I have redone the analysis in a `proper` fashion, using the pipeline, with the addition of more early data and SuNNS data taken in October. My main results stay unchanged.&#160;&lt;/p&gt;

&lt;p&gt;I have analyzed the flux in a line at&#160;882.952 nm - well-behaved singular and isolated line. The Figure shows the amount of flux in a line in a second for different observations with SuNNS (dots) - I am showing the flux from SuNNS with a dashed black line. As we can see, PFI observation is consistent with SuNNS observations.&#160; &lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;a id=&quot;14494_thumb&quot; href=&quot;https://pfspipe.ipmu.jp/jira/secure/attachment/14494/14494_example_spectrum_PFI_brighter.png&quot; title=&quot;example_spectrum_PFI_brighter.png&quot; file-preview-type=&quot;image&quot; file-preview-id=&quot;14494&quot; file-preview-title=&quot;example_spectrum_PFI_brighter.png&quot;&gt;&lt;img src=&quot;https://pfspipe.ipmu.jp/jira/secure/thumbnail/14491/_thumb_14491.png&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/a&gt;&lt;/span&gt; . I am also adding two examples, in one of which SuNNS observation is brighter, and one where SuNNS observation is dimmer than PFI.  &lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;a id=&quot;14495_thumb&quot; href=&quot;https://pfspipe.ipmu.jp/jira/secure/attachment/14495/14495_example_spectrum_SuNNS_brighter.png&quot; title=&quot;example_spectrum_SuNNS_brighter.png&quot; file-preview-type=&quot;image&quot; file-preview-id=&quot;14495&quot; file-preview-title=&quot;example_spectrum_SuNNS_brighter.png&quot;&gt;&lt;img src=&quot;https://pfspipe.ipmu.jp/jira/secure/thumbnail/14494/_thumb_14494.png&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/a&gt;&lt;/span&gt;   &lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;a id=&quot;14495_thumb&quot; href=&quot;https://pfspipe.ipmu.jp/jira/secure/attachment/14495/14495_example_spectrum_SuNNS_brighter.png&quot; title=&quot;example_spectrum_SuNNS_brighter.png&quot; file-preview-type=&quot;image&quot; file-preview-id=&quot;14495&quot; file-preview-title=&quot;example_spectrum_SuNNS_brighter.png&quot;&gt;&lt;img src=&quot;https://pfspipe.ipmu.jp/jira/secure/thumbnail/14495/_thumb_14495.png&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/a&gt;&lt;/span&gt; &lt;br/&gt;
I believe that RHL earlier suggestion that sometimes SuNNS observations are saturated is somewhat true, as there are observations where the continuum is super strong, almost to the point of saturating the instrument.&lt;br/&gt;
I have also noted some discrepancy between the arcLine fluxes being reported for SuNNS a and PFI data being different by a factor of 2, even though the flux in the line is the same in both exposures. As such, I have done this analysis by using the pfsArm&lt;span class=&quot;error&quot;&gt;&amp;#91;flux&amp;#93;&lt;/span&gt; measurements in a small region around the line, rather than the values reported in arcLines object. This might need to be investigated further. &lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10003">
                    <name>Relates</name>
                                            <outwardlinks description="relates to">
                                        <issuelink>
            <issuekey id="17053">PIPE2D-902</issuekey>
        </issuelink>
                            </outwardlinks>
                                                                <inwardlinks description="relates to">
                                        <issuelink>
            <issuekey id="18270">PIPE2D-918</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="14124" name="comparison_of_flux_PFI_SuNNs.png" size="68669" author="ncaplar" created="Tue, 5 Oct 2021 14:59:25 +0000"/>
                            <attachment id="14491" name="comparison_of_flux_PFI_SuNNs_via_pipeline.png" size="45818" author="ncaplar" created="Sun, 21 Nov 2021 06:54:12 +0000"/>
                            <attachment id="14125" name="comparison_of_flux_PFI_SuNNs_via_visit_id.png" size="33959" author="ncaplar" created="Tue, 5 Oct 2021 15:09:27 +0000"/>
                            <attachment id="14494" name="example_spectrum_PFI_brighter.png" size="105514" author="ncaplar" created="Sun, 21 Nov 2021 06:57:00 +0000"/>
                            <attachment id="14493" name="example_spectrum_PFI_brighter.png" size="105514" author="ncaplar" created="Sun, 21 Nov 2021 06:56:32 +0000"/>
                            <attachment id="14492" name="example_spectrum_PFI_brighter.png" size="105514" author="ncaplar" created="Sun, 21 Nov 2021 06:56:22 +0000"/>
                            <attachment id="14495" name="example_spectrum_SuNNS_brighter.png" size="94485" author="ncaplar" created="Sun, 21 Nov 2021 06:57:09 +0000"/>
                            <attachment id="14490" name="image-2021-11-20-20-53-43-531.png" size="45818" author="ncaplar" created="Sun, 21 Nov 2021 06:53:44 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10500" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                            <customfield id="customfield_10010" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>0|zzs9um:c</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10100" key="com.atlassian.jira.plugin.system.customfieldtypes:userpicker">
                        <customfieldname>Reviewers</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>hassan</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10005" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="122">2DDRP-2021 A 10</customfieldvalue>
    <customfieldvalue id="125">2DDRP-2021 A11</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10002" key="com.atlassian.jira.plugin.system.customfieldtypes:float">
                        <customfieldname>Story Points</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                        </customfields>
    </item>
</channel>
</rss>