https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/INSTRM-1976 Instrument control development <p>The obsproc working group would like to suggest that we measure the photometric zero-point in each AG exposure.  This will allow us to measure the median zero-point and rms during an PFS exposure, which will be very useful for us to do an initial quality assessment at the summit in real-time.  We consider this functionality crucial for the future PFS science operation.  The color-term to translate the Gaia photometry into the AG system needs to be estimated.</p> INSTRM-1976

photometric zero-point from AG

Task Normal In Progress Unresolved karr Masayuki Tanaka EngRun Thu, 11 May 2023 07:57:40 +0000 Tue, 30 Jan 2024 00:10:03 +0000 ics_agccActor 0 4 <p>(for recording) Jennifer will work on after she improved conversion formula using the 2023 April/May run.</p> <p>I'm working on the colour-term from GAIA to the AG cameras, and have the sample code from Arnaud for the calculation. </p> <p>Have any standard stars been systematically observed with the AG?  If so, what are the stars/visit IDs. Otherwise, I can run through the observed stars looking for appropriate candidates and observing conditions. </p> <p>If we do not care too much about the absolute zero-point of the AG, then<br/> 1 - select visits with clear skies<br/> 2 - identify Gaia stars in those visits<br/> 3 - retrieve G, Bp, and Rp photometry of the stars from the gaiaDB<br/> 4 - plot AG_mag - G against Bp - Rp, where AG_mag = 2.5log(AG_flux) + zero-point  (you might want to worry about the vignetting in AG_flux)<br/> 5 - fit a curve<br/> 6 - set the AG zero-point so that AG_mag - G =0 at Bp - Rp = 0<br/> You end up with AG_mag = G + f(Bp - Rp) and I think this is what we want.</p> <p>Thanks, that matches what I was planning if there weren't systematic calibration observations. </p> <p>Filtering the data by seeing (using the spot size), flux (eliminating faint sources), and sources near the edge of the detector (via the flags), gives sets of reasonably well behaved fluxes/colours. Fitting each set of sources using a linear fit with outlier rejection to derive the colour term and a zero point  produces generally consistent values, with some scatter. Looking at the fits, in some fields, particularly those with a small number of sources, the outlier rejection obviously needs to be fine-tuned. </p> <p>Could you share a few plots? I think we want a higher order function to fit the data. Probably 2nd or 3rd order polynomials. As Jim mentioned the other day, we can estimate the color term using the response functions and a stellar library. I can do that and you can compare it with yours, if that is useful.</p> <p>For the plots below</p> <ul> <li>Data filtered by magnitude (GAIA g &lt; 18.5)</li> <li>Seeing (via median FWHM in frame, excluding camera 2)</li> <li>sources near edge of image removed</li> <li>linear fit with outlier rejection</li> <li>each exposure was fit separately, as there's enough variation in transparency over the observations to make the fitting </li> <li>the derived parameters of the fits plotted in a histogram</li> </ul> <p>for the plot of AGmag - Gaia G vs GAIA rp - GAIA bp the best slope and intercept  are -0.30 and -30.45 (with a bin size of 0.01).</p> <p>The first two figures show the histograms; the results are consistent within the bin size for small changes in limiting magnitude;  increasing the limiting magnitude, lowering the seeing threshold or combining images produces a larger scatter. </p> <p>The next two pairs of plots show example colour and magnitude plots for two fields, one with a small number of sources, one with a large. </p> <p>Higher order fits will, I think, need to be left for systematically taken measurements of standard stars in photometric conditions. </p> <p><span class="image-wrap" style=""><img src="https://pfspipe.ipmu.jp/jira/secure/attachment/16367/16367_a_2.5_18.5_a.png" style="border: 0px solid black" /></span></p> <p>In your mag_AG - G vs. Bp - Rp plots, I see stars have Bp-Rp ~ -2. This is too blue. See, e.g.,</p> <p> <a href="https://sci.esa.int/web/gaia/-/60198-gaia-hertzsprung-russell-diagram" class="external-link" rel="nofollow">https://sci.esa.int/web/gaia/-/60198-gaia-hertzsprung-russell-diagram</a></p> <p><span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/16520/16520_agCam.pdf" title="agCam.pdf attached to INSTRM-1976">agCam.pdf^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span></p> <p>The PDF attached above has notes about the AG calibration and validation of measured results. </p> <p>I'm assuming that this ticket is where the analysis for <a href="https://pfspipe.ipmu.jp/jira/browse/INSTRM-2073" title="Verify AG photometry calculations" class="issue-link" data-issue-key="INSTRM-2073">INSTRM-2073</a> is being done.</p> <ol> <li>Why are you fitting for the slope of the fit to Gaia? The only reason for that would be concerns about non-linearity. Are we worried about non-linearity in the AG chips? If so, what data do we have? And should we take some more, e.g. photometry as a function of sky background. I don't think this is likely to be a first order problem (a percent or so at worst?) so for now please set the slope to be 1.0 and only fit the offsets. Is this the cause of the non-linearity you report below c. 19.5; in particular, is this onset independent of the sky brightness? In a similar way, we should be fitting the slope of the colour correction once and for all for GAIA v. PFS, unless you have evidence that it's different for the different AGs (possible, but unlikely).</li> <li>What is causing the outliers in the plots v. GAIA? When you look at them, does something jump out? What is the RMS to the fit after clipping? Is it consistent with the expected errors in the photometry (both GAIA and PFS)?</li> <li>If you don't have enough GAIA stars, have you looked at the match to SDSS or PanSTARRS? If you haven't done this, and don't have the tooling setup to do it, ignore this for now. If you <em>do</em> have more catalogue matches available, though, it'll be easier to understand our photometry.</li> <li>Please remake all the mag v. mag plots as plots with the <em>residual</em> on the y-axis (e.g. <tt>AGMag - G</tt> v. <tt>G</tt>). Please make these <em>after</em> as well as before the colour correction derived from GAIA <tt>BP - RP</tt>.</li> <li>Is your photometry independent of seeing? If not, what aperture would you have to use to make it seeing independent (for bright stars, of course)?</li> <li>How well can you tie the photometry from the different AGs together? E.g. what's the mean scatter, both raw and after you've solved for the side-to-side and chip-to-chip offsets (possibly as a function of seeing)</li> <li>How consistent are the zero points from standard catalogues derived from bright and faint stars (after a colour cut to restrict the fits to reasonable coloured objects, e.g. the ones that you think will have g-r of c. 0.0? How about the other cut into red and blue samples? You'll probably want to do this once you've established that each AG chip is on the same system.</li> <li>How much do the fluxes of individual stars vary during an exposure? How do these correlate between stars and between AG chips? If you take out the average variability, how consistent are the fluxes? Can you find nights when there doesn't seem to be any transparency variation?</li> <li>Once you've taken out transparency variations, is the scatter in the flux of each star consistent with your quoted errors?</li> </ol> <p>(This is for recording) Jennifer will work on 1. and 4. first. Some items may be addressed in the new tickets.</p> <p>An updated report is attached. </p> <p><span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/16563/16563_agCamNew.pdf" title="agCamNew.pdf attached to INSTRM-1976">agCamNew.pdf^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span></p> <p>(Recapping activities in the last a few months)</p> <ul> <li>For photometry itself, Jennifer <ul> <li>applied bias and flat-fielding, but the resultant scattering didn't change</li> <li>changed parameter for sep, but  the resultant scattering didn't change</li> </ul> </li> <li>For fitting of mag(GP) vs mag(AG), <ul> <li>She filtered objects with bad seeing, as well as objects flagged as non-MS in gaia catalogue.</li> </ul> </li> <li>Applying the fitting to each half region of each camera separately, variation gets small (0.05mag), and residual deviates from linear at fainter sources</li> <li>She will upload the latest version of the slides that she explained at ICS/PFI telecon in November/December 2023 by the end of this week, in order to see if the current formula is good enough or not</li> <li>I also requested to use the following visits where the same stars were observed in different AGs, to check her fitting <ul> <li>visit = 98353 &#8211; 98360 (ngc6633, PA=90)</li> </ul> </li> </ul> <ul> <li> <ul> <li>visit = 98371 &#8211; 98378 (ngc6633, PA=-90)</li> </ul> </li> </ul> <p> </p> <p>Report is attached. <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/17094/17094_report.pdf" title="report.pdf attached to INSTRM-1976">report.pdf^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span></p> Blocks INSTRM-2072 Relates INSTRM-2073 Development Rank 0|zzt0xa:r Sprint Eng13Oct PreEngRun15Mar