https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-317 DRP 2-D Pipeline <p>An external check performed by IPMU and NAOJ people should be done to check that the 2D DRP pipeline runs as expected. </p> <p>This check would involve the:</p> <ul class="alternate" type="square"> <li>installation and</li> <li>running of the integration test script</li> </ul> <p>at the local institution.</p> PIPE2D-317

Check DRP 5.0 installation works at IPMU/NAOJ

Task Normal Done Done Kiyoto Yabe hassan 2DDRP-V5 Fri, 25 Jan 2019 20:10:17 +0000 Fri, 29 Mar 2019 15:36:51 +0000 Thu, 28 Mar 2019 20:37:24 +0000 6.0 0 6 <p>See docs on <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-312" title="User documentation needed" class="issue-link" data-issue-key="PIPE2D-312"><del>PIPE2D-312</del></a>.</p> <p>This work is checking that the installation works at IPMU/NAOJ.  We need a separate set of stories for validating the <b>performance</b> of the pipeline (e.g. quality of wavelength solutions)</p> <p><b>Installation &amp; test environment:</b><br/>  <br/> Currently, the following persons are trying to install the package on their own environment. In the subsequent comments below, the current situation on the installation and the integration test is described for each method. The comments will be updated once the situation changes.<br/>  <br/> <b><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=kiyoto.yabe" class="user-hover" rel="kiyoto.yabe">Kiyoto Yabe</a> (IPMU)</b> <br/> OS: MacOSX 10.11<br/>  <br/> <b><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=naoki.yasuda" class="user-hover" rel="naoki.yasuda">naoki.yasuda</a> (gfarm@IPMU)</b> <br/> OS: CentOS 6<br/>  <br/> <b><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=naka.keigo" class="user-hover" rel="naka.keigo">Keigo Nakamura</a> (IPMU)</b><br/> OS: macOS 10.14<br/>  <br/> <b><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=sogo.mineo" class="user-hover" rel="sogo.mineo">sogo.mineo</a> (NAOJ)</b><br/> OS: CentOS 7<br/>  </p> <p><b>Docker installation for PIPE2D:</b><br/>  <br/> (Kiyoto Yabe)<br/>  <br/> Installation seems OK, but errors occurred during integration test (see attachment)<br/>  <br/> <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/11805/11805_pipe2d_docker_installation_yabe.log" title="pipe2d_docker_installation_yabe.log attached to PIPE2D-317">pipe2d_docker_installation_yabe.log^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span><br/>  <br/> (Naoki Yasuda)<br/>  <br/> Permission problem occurred (see PFS-drp:00430)<br/>  <br/> (Keigo Nakamura)<br/>  <br/> Installation OK and integration test passed<br/>  <br/> (Sogo Mineo)<br/>  <br/> TBC</p> <p><b>Script installation (LSST+PFS) for PIPE2D:</b><br/>  <br/> (Kiyoto Yabe)<br/>  <br/> Installation failed (maybe PYTHONPATH problem? see attachment)<br/>  <br/> <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/11806/11806_pipe2d_script1_installation_yabe.log" title="pipe2d_script1_installation_yabe.log attached to PIPE2D-317">pipe2d_script1_installation_yabe.log^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span><br/>  <br/> (Naoki Yasuda)<br/>  <br/> Errors occurred during LSST installation (but error messages lost ...)<br/>  <br/> (Keigo Nakamura)<br/>  <br/> Errors occurred during LSST installation (see following error message)<br/>  </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> # bash auto-completionif [ X$BASH_COMPLETION != X -a -f <span class="code-quote">"$EUPS_DIR/etc/bash_completion.d/eups"</span> ]; then    source <span class="code-quote">"$EUPS_DIR/etc/bash_completion.d/eups"</span>fi export -f setupexport -f unsetup export EUPS_PKGROOT=${EUPS_PKGROOT:-https:<span class="code-comment">//eups.lsst.codes/stack/osx/10.9/clang-800.0.42.1/miniconda3-4.3.21-10a4fa6|https://eups.lsst.codes/stack/src}Installing <span class="code-keyword">package</span> pipe_drivers: eups distrib install pipe_drivers -t <span class="code-quote">"v16_0"</span> --no-server-tagseups distrib: [Errno 13] Permission denied: '/Users/naka.keigo/.eups/_caches_/Users/naka.keigo/Desktop/PFS/stack/miniconda3-4.3.21-10a4fa6/DarwinX86.pickleDB1_3_0’</span> </pre> </div></div> <p>(Sogo Mineo)<br/>  <br/> Installation OK and integration test passed but</p> <ul> <li>need to make the patch for install_pfs.sh (see the following attachment)</li> <li>need to re-run pfs_integration_test.sh after git lfs install<br/>  <br/> <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/11807/11807_do-install.sh" title="do-install.sh attached to PIPE2D-317">do-install.sh^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span><br/> <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/11808/11808_create-chroot-environ.sh" title="create-chroot-environ.sh attached to PIPE2D-317">create-chroot-environ.sh^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span><br/>  </li> </ul> <p><b>Script installation (PFS on LSST stack) for PIPE2D:</b><br/>  <br/> (Kiyoto Yabe)<br/>  <br/> LSST installation failed (see error messages below)<br/>  <br/> bash-3.2$ source loadLSST.bash<br/> Traceback (most recent call last):<br/>   File "/work/PFS/drp/2d-drp/installation_test/pipe2d/script2/lsst_stack/eups/2.1.4/bin/eups_setup", line 28, in &lt;module&gt;<br/>     import eups.setupcmd<br/> ModuleNotFoundError: No module named 'eups.setupcmd'<br/> During handling of the above exception, another exception occurred:<br/> Traceback (most recent call last):<br/>   File "/work/PFS/drp/2d-drp/installation_test/pipe2d/script2/lsst_stack/eups/2.1.4/bin/eups_setup", line 42, in &lt;module&gt;<br/>     import eups.setupcmd<br/> ModuleNotFoundError: No module named 'eups.setupcmd'<br/> bash: export: setup: not a function<br/> bash: export: unsetup: not a function<br/>  <br/> (Naoki Yasuda)<br/>  <br/> Installation OK and integration test passed<br/>  <br/> (Keigo Nakamura)<br/>  <br/> Errors occurred during LSST installation (error messages lost ...)<br/>  <br/> (Sogo Mineo)<br/>  <br/> TBC<br/>  </p> <p><b>Manual installation for PIPE2D:</b><br/>  <br/> (Kiyoto Yabe)<br/>  <br/> TBC<br/>  <br/> (Naoki Yasuda)<br/>  <br/> TBC<br/>  <br/> (Keigo Nakamura)<br/>  <br/> TBC<br/>  <br/> (Sogo Mineo)<br/>  <br/> TBC<br/>  </p> <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=hassan" class="user-hover" rel="hassan">hassan</a> Can you file tickets for each independent failure mode identified, and link them to this ticket?</p> <p>Update: I just successfully installed both PIPE2D and SIM2D on a Cent OS 7 server. I also patched as Mineo-san suggested.</p> <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=kiyoto.yabe" class="user-hover" rel="kiyoto.yabe">Kiyoto Yabe</a>: is all the feedback IPMU would like to provide complete? I will then close this ticket and raise tickets specific to each problem.</p> <p>I'm trying to install them on another server at IPMU (OS=debian 9.8). A the first round, I failed, but I think I'm doing something wrong, so could you give me more time?</p> <p>Separate tickets can be raised if further problems have been found.</p> Blocks PIPE2D-312 Development Rank 0|02qpt6:508yjj42 Sprint 2019 B 2DDRP-2019 C Story Points 1.0