https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/INFRA-246 Software Development Infrastructure <p>In order to address <a href="https://pfspipe.ipmu.jp/jira/browse/SIM2D-113" title="Provide F-star spectra " class="issue-link" data-issue-key="SIM2D-113"><del>SIM2D-113</del></a>, a physical location to store and share F-star data needs to be discussed and agreed between the PFS Project Office and Princeton. </p> <p>The total size of that data is still TBC, but can vary between 30 and 300 GB. <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=takuji.yamashita" class="user-hover" rel="takuji.yamashita">Takuji Yamashita</a> to confirm.</p> INFRA-246

Location for F-star template data

Story Normal Won't Fix Won't Fix yuki.moritani hassan Fri, 5 Apr 2019 16:27:57 +0000 Fri, 12 Apr 2019 17:21:34 +0000 Fri, 12 Apr 2019 17:20:58 +0000 newitem 0 6 <p>Depending on how this data is used in the pipelines it may need to be visible as a path relative to the root of the raw data.  This isn't a problem (as we can use symbolic links), but we should be aware.  We will also need to make this data available at all PFS sites, and handle versioning it as our knowledge evolves.</p> <p>Those data volumes seem high to me, and I suspect that we can design a much more efficient format if necessary.</p> <p>Here is a revised estimate.  If we store only the flux, each file (including extrapolation) will be about 4Mbytes in the fits format.  The spectral sampling is 0.01A/pix, which is a very fine sampling and we do not need that.  If we bin the spectra to, e.g., 0.1A/pix, which is still fine enough for our purpose, the data volume will be 1/10.  We have not decided yet which type of stars to use, but if we limit ourselves to 5500&lt;Teff<span class="error">&#91;K&#93;</span>&lt;8000K, which roughly corresponds to mid-G to early-A, there are ~6000 spectra.  So, 4Mbytes * 0.1 * 6000 = 2.4Gbytes in total.</p> <p>Following the 2D DRP technical telecon 2019-04-12: The total volume of the data is now relatively small. As these data need to be available at all locations where the pipeline is being run, we should only specify where in the Butler path these data are located. </p> <p>I will therefore close this ticket and create a new one for the Butler location.</p> <p>Work will now be addressed under <a href="https://pfspipe.ipmu.jp/jira/browse/DAMD-51" title="Theoretical spectra for flux calibration: location relative to Butler" class="issue-link" data-issue-key="DAMD-51">DAMD-51</a>.</p> Blocks SIM2D-113 Relates INFRA-247 DAMD-51 Development Rank 0|zx0060: Story Points 2.0