https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/INSTRM-1424 Instrument control development <p>Can we sort out permissions on <tt>/data/drp/repo/rerun</tt>?  I can't write to it, as we mounted the entire file system R/O (which is reasonable).  I think we need to replace that <tt>rerun</tt> directory with a symbolic link on <em>both</em> the summit and in Hilo, and make the Hilo one point to a writeable file system (e.g. <tt>/work/rerun</tt>).</p> <p>The issue is that running the pipelines with a <tt>-rerun a/b/c</tt> option is extremely useful, and this expands to the directory <tt>/data/drp/repo/rerun/a/b/c</tt> so the user code needs to be able to write to <tt>/data/drp/repo/rerun</tt>. I don't think that it need be the same directory as on the summit (although that would be nice), so probably the easiest solution is to make it a symbolic link in both places, pointing to local disk.</p> INSTRM-1424

Make rerun directories writeable on the Hilo PFS cluster

Story Normal Done Done Kiyoto Yabe rhl EngRun Thu, 28 Oct 2021 13:52:58 +0000 Wed, 7 Dec 2022 02:53:02 +0000 Wed, 7 Dec 2022 02:53:01 +0000 0 3 <p>Maybe I don't fully understand the demand, but why do we need a symbolic link at summit?</p> <p>Without changing the configuration at summit, I think there are two options:</p> <ul> <li>simply make only /data/drp/repo/rerun (perhaps /data/drp/sm1-5.2/rerun) writable</li> <li>mount that directory as writable on /work/drp/repo (currently there is Arnaud's directory which is different from the summit one)</li> </ul> <p>Does either option solve the problem? </p> <p>If you can make <tt>/data/drp/repo/rerun</tt> writeable that'd be great, but I assumed that you mounted the <tt>/data/drp/repo</tt> filesystem read-only. My proposal was to get around that limit, but if we don't need to, that'd be better.</p> <p>It was not obvious when we started using the Hilo machines how much could be NFS-shared between the two sites, and how useful the summit DRP machines would be. Experience suggests that we generally should not share: the performance hit from the link is real, and the summit machines are too slow to be interesting.</p> <p>On the Hilo side, since we must read all images at least once before getting <b>anything</b> from DRP, we might as well do that on ingest. Make the entire /data/drp local to Hilo, run <tt>ingestPfsImages --mode=copy</tt>, then operate independently. </p> <p>So I vote for making the entire /data/drp Hilo-local and writable there. Sadly we might still need/want summit reductions for operational reasons, but I think for now splitting Hilo from the summit is the sensible move.</p> <p>In Sep. run, we actually operated /work/drp as a locally isolated DRP directory, which mounting /data/drp as RO. Is it OK to have the same mechanism in Nov. run? Or should we rename the local directory to /data/drp and remove the RO mount?</p> <p>I think you should choose any mechanism that works for you (<a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=cloomis" class="user-hover" rel="cloomis">cloomis</a> may have helpful thoughts);  all I care about is that the path is the same in the two places and that I can write to a reruns directory.  The reruns needn't be shared with the summit</p> <p>In the Nov. run, we finally operated the rerun directory independently at summit (/data/drp/repo/rerun) and Hilo (/work/drp/rerun). I think we should sort out again the location before the next run. Can we use only Hilo location or do we still need to use the summit location in the next run?</p> <p>If we use the single location in future, how do we merge the previous data into the new location? Is it OK to just mv/copy (or making symbolic links) or do we need to take a special care of it in terms of DRP (e.g. registry consistency)?</p> <p>I think we are still using `/data/drp/sm1-5.2/rerun` but mostly and actively using the Hilo location `/work/drp/rerun` and I don't think we see any problem for a while. So, can we close this ticket and file another if needed, or should this be still open? <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=cloomis" class="user-hover" rel="cloomis">cloomis</a>? <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=rhl" class="user-hover" rel="rhl">rhl</a>?</p> <p>I close this and file another if necessary.</p> Development Rank 0|02qpjd:00r3001c Sprint PreEngRun4 Story Points 1.0