https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/INSTRM-29 Instrument control development <p>note: This is epic for initiate development archive storage service. File ticket for each individual task or issue.</p> <ul> <li><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=fmadec" class="user-hover" rel="fmadec">fmadec</a> develop possible (or desirable) way to push FITS files from LAM local storage</li> <li><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=cloomis" class="user-hover" rel="cloomis">cloomis</a> develop possible way to push FITS files from JHU test facility</li> <li>define file distribution procedure, e.g. sync all files by periodical rsync, on-demand download by URI</li> </ul> INSTRM-29

Define development archive storage operation and workflow

Epic Major Done Done yuki.moritani shimono Tue, 6 Dec 2016 20:40:28 +0000 Sat, 18 Mar 2023 04:53:54 +0000 Sat, 18 Mar 2023 04:53:54 +0000 0 2 <p>According to the update from Atsuhsi it seems that IPMU have some constrains on ssh access.</p> <p>So that LAM propose that the synchronisation comes from IPMU or PU to LAM and not from LAM to external site.<br/> This access will only be using ssh and will be restricted to ideally only to the server that will pull the data.</p> <p>We should agree on the frequency of the sync (ideally that could be done once a week during week-end)</p> <p>What do you think?</p> <p>Restriction from outside-IPMU to global network (by means which has non-RFC1918 addresses) in IPMU is somehow messy thing now and its coordination/operation could be changed in short time scale. Web access (80/443) is relatively less restricted than ssh (22), so one "reliable" possibility is webdav-rsync if we want to push from outside-IPMU. For getting from this archive, there would be bunch of ways from pick one file by one via web, etc.</p> <p>Also if instrument development sites (like LAM, PU, ASIAA) are easily accessible from outside, ssh-rsync from IPMU archive server is one possibility. This will require some configuration at development sites, that ssh gateway is possible to reach local data storage at lab (or local archive?). How difficult depends on configurations at each site, so it is required to be checked site by site.</p> <p>For frequency, I think once a week at weekend could work. For immediate data transfer from LAM to PU for short time analysis, we could do/plan transfer on demand as now we are doing.</p> <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=yuki.moritani" class="user-hover" rel="yuki.moritani">yuki.moritani</a> do you want to keep this open ? or shall we close it .</p> <p>Since LAM data have been archiving, I close this ticket. Archiving JHU (or other institute) data will be handled under a new ticket, if we decide to do so. </p> Development Epic Color ghx-label-1 Epic Name devarch Epic Status Rank 0|ii015z: