https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-918 DRP 2-D Pipeline <p>In the email from October 18, JEG asked me to provide him with the following data:</p> <p>1. rates (electrons/sec or ADU/sec and an assumed gain at a small set of<br/> wavelengths for the continuum lamp. I know these data exist,<br/> because you showed them during the commissioning phonecons.</p> <p>2. The same for the line lamps; rates for an identified line or, if<br/> possible, a small set of identified lines.</p> <p>3. This one may be harder. For the best (highest but not saturated)<br/> exposure for each of the line lamps, could you send me an ASCII spectrum? Just wavelength and counts (ADU or electrons) for blue and red? Only the bias removed if you can do that</p> <p>-------</p> <p>Notebook at:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">  /home/ncaplar/Pipeline_notebooks/PIPE2D-918 (flux question from JEG).ipynb</pre> </div></div> PIPE2D-918

Provide flux data for calibration lamps and PFI for JEG

Task Normal Done Done ncaplar ncaplar Thu, 21 Oct 2021 17:46:39 +0000 Mon, 6 Dec 2021 02:02:48 +0000 Tue, 30 Nov 2021 19:39:59 +0000 Wed, 1 Dec 2021 00:00:00 +0900 0 2 <p>For all of these figures and data, I have extracted data from 15 seconds exposure taken during the September run. The analysis has been done by extracting data from fiber 73. This fiber has been chosen for being on 90th percentile of brightness out of all fibers - so we are talking about one of the brightest fibers available. Note that these all results are in counts. For electron conversion, gain for the instrument is approx 1.22.</p> <p>1. Requested data is specified in <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/14455/14455_Continuum_red_spectrum.csv" title="Continuum_red_spectrum.csv attached to PIPE2D-918">Continuum_red_spectrum.csv^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span> and <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/14456/14456_Continuum_blue_spectrum.csv" title="Continuum_blue_spectrum.csv attached to PIPE2D-918">Continuum_blue_spectrum.csv^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span> . It gives the full spectrum of continuum lamp, separately for blue and red lamp. The rates are given per pixel, per second - i.e., I have taken fluxes at a given wavelength as given by the pipeline and divided them by 3.22. Continuum reduction is currently not working very well - detectorMap is not adjusted for continuum observations. I have looked at the traces that the pipeline is using ( <span class="image-wrap" style=""><a id="14445_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/14445/14445_Argon_red.png" title="Argon_red.png" file-preview-type="image" file-preview-id="14445" file-preview-title="Argon_red.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/14446/_thumb_14446.png" style="border: 0px solid black" /></a></span> ) and those are not perfect, but reasonable.</p> <p>2. <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/14451/14451_bright_measured_lines_Argon_red.csv" title="bright_measured_lines_Argon_red.csv attached to PIPE2D-918">bright_measured_lines_Argon_red.csv^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span>, <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/14454/14454_bright_measured_lines_Neon_red.csv" title="bright_measured_lines_Neon_red.csv attached to PIPE2D-918">bright_measured_lines_Neon_red.csv^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span>, <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/14452/14452_bright_measured_lines_Krypton_red.csv" title="bright_measured_lines_Krypton_red.csv attached to PIPE2D-918">bright_measured_lines_Krypton_red.csv^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span> and <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/14453/14453_bright_measured_lines_Neon_blue.csv" title="bright_measured_lines_Neon_blue.csv attached to PIPE2D-918">bright_measured_lines_Neon_blue.csv^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span> give 12 brightest lines as measured in the data. The flux values are amount of counts in the full psf, in a single second (NOT IN A SINGLE PIXEL).</p> <p>3. <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/14460/14460_Argon_red_spectrum.csv" title="Argon_red_spectrum.csv attached to PIPE2D-918">Argon_red_spectrum.csv^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span>, <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/14459/14459_Argon_blue_spectrum.csv" title="Argon_blue_spectrum.csv attached to PIPE2D-918">Argon_blue_spectrum.csv^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span>, <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/14464/14464_Neon_red_spectrum.csv" title="Neon_red_spectrum.csv attached to PIPE2D-918">Neon_red_spectrum.csv^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span>, <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/14462/14462_Neon_blue_spectrum.csv" title="Neon_blue_spectrum.csv attached to PIPE2D-918">Neon_blue_spectrum.csv^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span> and<span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/14457/14457_Krypton_red_spectrum.csv" title="Krypton_red_spectrum.csv attached to PIPE2D-918">Krypton_red_spectrum.csv^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span> give spectrum per physical pixel in 1 second - i.e., the fluxes from the pipeline at a given wavelength have been divided by 3.22. Krypton_blue_spectrum.csv in unavailable at the moment (<a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-941" title="Krypton data blue failure" class="issue-link" data-issue-key="PIPE2D-941"><del>PIPE2D-941</del></a>)</p> <p>With the pipeline running on PFI data, I have revisited the question about the difference of flux between predictions and seen results (<a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-902" title="Measure the flux of calibration lamps and compare explicitly with prediction from Jim &amp; Erin" class="issue-link" data-issue-key="PIPE2D-902"><del>PIPE2D-902</del></a>). <br/> The other large difference from results as given in <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-902" title="Measure the flux of calibration lamps and compare explicitly with prediction from Jim &amp; Erin" class="issue-link" data-issue-key="PIPE2D-902"><del>PIPE2D-902</del></a> is that I made a mistake when extracting data from tables given by Erin, and extracted the wrong column (amplitude instead of lfux). In short, the end result of this mistakes is that the new results decreases the offset between the prediction and seen results for noble gas lamps by a factor of approximately 2.</p> <p>In order to deduce the average offset between the predicted and seen flux, I have followed the following procedure:</p> <p>1. Select 12 brightest lines from the table provided by Erin for the specific lamp and arm<br/> 2. Select 12 brightest lines in the data for the specific lamp and arm<br/> 3. Find lines which are in both tables <br/> 4. Deduce median multiplicative offset between the predicted and seen fluxes from lines identified in step 3.</p> <p>For continuum, I compare median fluxes between the predicted and seen fluxes in the area where we have data</p> <p>Using this procedure, I am finding median offset to be (rounded to the closest integer, which I believe is reasonable given the uncertainties):</p> <p>Neon, red: 3<br/> Neon, blue: 6<br/> Argon, red: 11<br/> Krypton, red: 6<br/> Continuum (Erin), red: 56<br/> Continuum (Erin), blue: 114</p> <p>The difference between results in red and blue is probably indicative of the same problem as discussed in <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-942" title="Do we see bright blue spots at double their original wavelength, i.e., in red" class="issue-link" data-issue-key="PIPE2D-942"><del>PIPE2D-942</del></a> and <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-943" title="Blue/red drop in SM2?" class="issue-link" data-issue-key="PIPE2D-943"><del>PIPE2D-943</del></a>.</p> <p>The figures attached to this ticket show:<br/> Black dots - data predicted by Erin, scaled to be consistent with the flux within a single wavelength element (summed over x direction)<br/> Gray dashed line - wavelength at which Erin predictions are available<br/> Blue line - Original spectrum<br/> Red line - Original spectrum multiplied with the appropriate multiplicative factor, as specified above. </p> <p><span class="image-wrap" style=""><a id="14449_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/14449/14449_Neon_blue.png" title="Neon_blue.png" file-preview-type="image" file-preview-id="14449" file-preview-title="Neon_blue.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/14445/_thumb_14445.png" style="border: 0px solid black" /></a></span><span class="image-wrap" style=""><a id="14448_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/14448/14448_Krypton_red.png" title="Krypton_red.png" file-preview-type="image" file-preview-id="14448" file-preview-title="Krypton_red.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/14449/_thumb_14449.png" style="border: 0px solid black" /></a></span><span class="image-wrap" style=""><a id="14450_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/14450/14450_Neon_red.png" title="Neon_red.png" file-preview-type="image" file-preview-id="14450" file-preview-title="Neon_red.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/14448/_thumb_14448.png" style="border: 0px solid black" /></a></span><span class="image-wrap" style=""><a id="14447_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/14447/14447_continuum.png" title="continuum.png" file-preview-type="image" file-preview-id="14447" file-preview-title="continuum.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/14450/_thumb_14450.png" style="border: 0px solid black" /></a></span><span class="image-wrap" style=""><a id="14447_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/14447/14447_continuum.png" title="continuum.png" file-preview-type="image" file-preview-id="14447" file-preview-title="continuum.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/14447/_thumb_14447.png" style="border: 0px solid black" /></a></span></p> <p> </p> <p>I also need to compare the continuum data with a prediction from JEG, that he circulated in an email on November 8, 2021, and that differs from a prediction produced by Erin.</p> <p>I have talked with Erin yesterday (Nov 29). As part of that discussion I promised to close this ticket by Dec 01 by<br/> a) comparing the prediction for continuum from JEG with the data<br/> b) double checking that the fluxes that come from the pipeline (arcLines object) are actually corresponding to the real flux seen in the data.</p> <p>I find that the Jim prediction for continuum that he shared is around 3x times brighter than real data. This is assuming that the flux is linearly proportional to the power supplied (as his prediction is done with 100 W, and 50 W was installed). 3x factor is consistent with Jim has claimed.</p> <p>Erin has modified her predicted after finding an error on December 2, 2021. After that fix her prediction is around 6x too bright in red, around 11,12 times too bright in blue.</p> <p>I have double checked, and the results coming from the pipeline seem reasonable. </p> <p> <span class="image-wrap" style=""><a id="14502_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/14502/14502_Continuum_Jim_ErinDec2_data.png" title="Continuum_Jim_ErinDec2_data.png" file-preview-type="image" file-preview-id="14502" file-preview-title="Continuum_Jim_ErinDec2_data.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/14502/_thumb_14502.png" style="border: 0px solid black" /></a></span> </p> <p>Erin will write an email to Robert to inquire about further actions and plan to meet with Jim soon.</p> Blocks PIPE2D-924 PIPE2D-933 Relates INSTRM-1438 PIPE2D-902 PIPE2D-911 INSTRM-1470 Development Rank 0|zzsh25: Sprint 2DDRP-2021 A12 Story Points 2.0