https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/INSTRM-1078 Instrument control development <p>Following discussions in the last ICS/PFI telecon (<a href="https://sumire.pbworks.com/w/page/141309765/ICS-PFI-MCS%20telecon%20on%20Sep%2018%202020)" class="external-link" rel="nofollow">https://sumire.pbworks.com/w/page/141309765/ICS-PFI-MCS%20telecon%20on%20Sep%2018%202020)</a> we should have a local installation of the Gaia DR2 catalogue at Subaru. This would be a useful for guide stars, for fiber allocation software (<a href="https://pfspipe.ipmu.jp/jira/browse/FIBERALLOC-33" title="How to deal with manually provided/cached catalogues for guide star selection?" class="issue-link" data-issue-key="FIBERALLOC-33">FIBERALLOC-33</a>) etc.</p> <p>Having a local copy would preclude problems accessing guide stars due to external network issues.</p> <p>The catalogue should be queryable, so ingested into a postgres or equivalent database instance.</p> <p>The size of the Gaia DR2 in CSV format is 550 GB. If the size is an issue, it may be possible to store a only subset of fields. But this needs to be discussed further.</p> INSTRM-1078

Install Gaia DR2 Catalogue at Subaru

Story Normal Done Done eric hassan Tue, 29 Sep 2020 20:09:50 +0000 Fri, 13 Aug 2021 10:57:27 +0000 Fri, 13 Aug 2021 10:57:27 +0000 0 4 <p>The Gaia Archives team were contacted to confirm that the contents of the Gaia DR2 CSV files are consistent with that in the Gaia Archive. They have confirmed that.</p> <p>Re-assigned ticket to Eric Jeschke, as he will be the responsible for ingesting the downloaded CSV files to the postgres database.</p> <p>The Gaia CSV files were ingested into the Subaru Gen2 "star_catalog" Postgres database as table "gaia".  I have attached the schema.  The table has been clustered and an index made using the Q3C Postgres extension to allow very fast searches on RA/DEC/radius coordinates (all in degrees).  The table contains the entirety of the CSV files.</p> <p>Here is an example SQL query:<br/> psql (11.2)<br/> Type "help" for help.</p> <p>star_catalog=# SELECT source_id, ra, dec, phot_rp_mean_mag, parallax, pmra, pmdec  FROM gaia WHERE q3c_radial_query(ra, dec, 10.3, 0.4, 0.076);<br/>       source_id      |        ra        |        dec        | phot_rp_mean_mag |<br/>       parallax       |        pmra        |        pmdec        <br/> --------------------<del><ins></del>----------------<del></ins></del>-----------------<del><ins></del>-----------------</ins><br/> --------------------<del><ins></del>------------------<del></ins></del>--------------------<br/>  2543114289888915712 | 10.3237413085593 | 0.330040149611898 |          14.7414 |<br/>     1.57129893515104 |   2.50609492529233 |   -10.8380693317631<br/>  2543302920556836096 | 10.2431758026912 | 0.354154114747787 |          17.2081 |<br/>    0.327389891246227 |  -2.21040371907556 |   -1.80819707672227<br/>  2543115251960840960 | 10.2655912179137 | 0.347096406226759 |          10.0711 |<br/>      3.4463085813933 |  -37.6061949980034 |   -27.3090372266146<br/>  2543302924852598016 | 10.2546094351212 | 0.358317143282865 |          15.9077 |<br/>     2.76051410620393 |  -4.91943190679037 |   -43.7051987345144<br/> ...<br/> ...<br/>  <br/> The q3c_radial_query requires you to specify the words "ra, "dec" then ra, dec, radius (in degrees).<br/>  <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/13224/13224_gaia_schema.sql" title="gaia_schema.sql attached to INSTRM-1078">gaia_schema.sql^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span></p> <p>Installed in Dec 2020.</p> Relates FIBERALLOC-33 INSTRM-1081 Development Rank 0|zzs2s0: Story Points 4.0