https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/INFRA-247 Software Development Infrastructure <p>As well as a storage location for the derived F-star template data (<a href="https://pfspipe.ipmu.jp/jira/browse/INFRA-246" title="Location for F-star template data" class="issue-link" data-issue-key="INFRA-246"><del>INFRA-246</del></a>), a storage location for the AMBRE ‘Warm’ library for relatively hot stars, which is the source of the template data, needs to be agreed on. Accessing these data from the original providers is not straightforward (the library author needs to be contacted).</p> <p>The uncompressed volume of these data is about 430 GB. A subset of these data are needed for the generation of the template data, so in practice a few hundred GBs of data are required, uncompressed. </p> <p>An alternative possibility is for NOAJ to store these raw data locally, in which case this issue is not longer relevant. <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=msyktnk" class="user-hover" rel="msyktnk">Masayuki Tanaka</a> to comment.</p> <p>Reference AMBRE paper: <a href="https://arxiv.org/pdf/1205.2270.pdf" class="external-link" rel="nofollow">https://arxiv.org/pdf/1205.2270.pdf</a></p> INFRA-247

Location for raw AMBRE data for F-stars

Story Normal Done Done rhl hassan Wed, 10 Apr 2019 17:59:40 +0000 Thu, 11 Apr 2019 13:52:29 +0000 Thu, 11 Apr 2019 13:52:07 +0000 0 3 <p>Why do we need both in operations?</p> <p> </p> <p>We do not need the raw storage of AMBRE data for actual operations. If it is more appropriate, these data could be stored internally at NOAJ. Then this issue can be closed with no further action. <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=msyktnk" class="user-hover" rel="msyktnk">Masayuki Tanaka</a> to comment.</p> <p>The original estimate of 430Gbytes was incorrect, sorry.  Each spectrum is 11Mbytes in the fits format.  There are 10575 spectra in the 'warm' (Teff&gt;4000K) library that we have at NAOJ and the total volume is 107Gbytes.  If we restrict ourselves to 5500&lt;Teff&lt;8000K, for instance, the total will be about 65Gbytes.</p> <p>The 2d pipeline does not need these 'raw' spectra.  If needed, I can put a compressed tarball with all the spectra somewhere accessible from anyone (likely an HSC machine).  Let me know.</p> <p>Following 2D DRP technical telecon today: agreed to close this ticket based on <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=msyktnk" class="user-hover" rel="msyktnk">Masayuki Tanaka</a> 's proposal of storing the raw data locally at NAOJ.</p> Relates INFRA-246 Development Rank 0|zx007s: