[PIPE2D-317] Check DRP 5.0 installation works at IPMU/NAOJ Created: 26/Jan/19  Updated: 30/Mar/19  Resolved: 29/Mar/19

Status: Done
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: 6.0

Type: Task Priority: Normal
Reporter: hassan Assignee: Kiyoto Yabe
Resolution: Done Votes: 0
Labels: 2DDRP-V5
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: File create-chroot-environ.sh     File do-install.sh     Text File pipe2d_docker_installation_yabe.log     Text File pipe2d_script1_installation_yabe.log    
Issue Links:
Blocks
is blocked by PIPE2D-312 User documentation needed Done
Story Points: 1
Sprint: 2019 B, 2DDRP-2019 C

 Description   

An external check performed by IPMU and NAOJ people should be done to check that the 2D DRP pipeline runs as expected.

This check would involve the:

  • installation and
  • running of the integration test script

at the local institution.



 Comments   
Comment by price [ 26/Jan/19 ]

See docs on PIPE2D-312.

Comment by rhl [ 31/Jan/19 ]

This work is checking that the installation works at IPMU/NAOJ.  We need a separate set of stories for validating the performance of the pipeline (e.g. quality of wavelength solutions)

Comment by Kiyoto Yabe [ 12/Feb/19 ]

Installation & test environment:
 
Currently, the following persons are trying to install the package on their own environment. In the subsequent comments below, the current situation on the installation and the integration test is described for each method. The comments will be updated once the situation changes.
 
Kiyoto Yabe (IPMU) 
OS: MacOSX 10.11
 
naoki.yasuda (gfarm@IPMU) 
OS: CentOS 6
 
Keigo Nakamura (IPMU)
OS: macOS 10.14
 
sogo.mineo (NAOJ)
OS: CentOS 7
 

Comment by Kiyoto Yabe [ 12/Feb/19 ]

Docker installation for PIPE2D:
 
(Kiyoto Yabe)
 
Installation seems OK, but errors occurred during integration test (see attachment)
 
pipe2d_docker_installation_yabe.log
 
(Naoki Yasuda)
 
Permission problem occurred (see PFS-drp:00430)
 
(Keigo Nakamura)
 
Installation OK and integration test passed
 
(Sogo Mineo)
 
TBC

Comment by Kiyoto Yabe [ 12/Feb/19 ]

Script installation (LSST+PFS) for PIPE2D:
 
(Kiyoto Yabe)
 
Installation failed (maybe PYTHONPATH problem? see attachment)
 
pipe2d_script1_installation_yabe.log
 
(Naoki Yasuda)
 
Errors occurred during LSST installation (but error messages lost ...)
 
(Keigo Nakamura)
 
Errors occurred during LSST installation (see following error message)
 

# bash auto-completionif [ X$BASH_COMPLETION != X -a -f "$EUPS_DIR/etc/bash_completion.d/eups" ]; then    source "$EUPS_DIR/etc/bash_completion.d/eups"fi
export -f setupexport -f unsetup
export EUPS_PKGROOT=${EUPS_PKGROOT:-https://eups.lsst.codes/stack/osx/10.9/clang-800.0.42.1/miniconda3-4.3.21-10a4fa6|https://eups.lsst.codes/stack/src}Installing package pipe_drivers: eups distrib install pipe_drivers -t "v16_0" --no-server-tagseups distrib: [Errno 13] Permission denied: '/Users/naka.keigo/.eups/_caches_/Users/naka.keigo/Desktop/PFS/stack/miniconda3-4.3.21-10a4fa6/DarwinX86.pickleDB1_3_0’

(Sogo Mineo)
 
Installation OK and integration test passed but

Comment by Kiyoto Yabe [ 12/Feb/19 ]

Script installation (PFS on LSST stack) for PIPE2D:
 
(Kiyoto Yabe)
 
LSST installation failed (see error messages below)
 
bash-3.2$ source loadLSST.bash
Traceback (most recent call last):
  File "/work/PFS/drp/2d-drp/installation_test/pipe2d/script2/lsst_stack/eups/2.1.4/bin/eups_setup", line 28, in <module>
    import eups.setupcmd
ModuleNotFoundError: No module named 'eups.setupcmd'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/work/PFS/drp/2d-drp/installation_test/pipe2d/script2/lsst_stack/eups/2.1.4/bin/eups_setup", line 42, in <module>
    import eups.setupcmd
ModuleNotFoundError: No module named 'eups.setupcmd'
bash: export: setup: not a function
bash: export: unsetup: not a function
 
(Naoki Yasuda)
 
Installation OK and integration test passed
 
(Keigo Nakamura)
 
Errors occurred during LSST installation (error messages lost ...)
 
(Sogo Mineo)
 
TBC
 

Comment by Kiyoto Yabe [ 12/Feb/19 ]

Manual installation for PIPE2D:
 
(Kiyoto Yabe)
 
TBC
 
(Naoki Yasuda)
 
TBC
 
(Keigo Nakamura)
 
TBC
 
(Sogo Mineo)
 
TBC
 

Comment by rhl [ 14/Feb/19 ]

hassan Can you file tickets for each independent failure mode identified, and link them to this ticket?

Comment by Kiyoto Yabe [ 22/Feb/19 ]

Update: I just successfully installed both PIPE2D and SIM2D on a Cent OS 7 server. I also patched as Mineo-san suggested.

Comment by hassan [ 07/Mar/19 ]

Kiyoto Yabe: is all the feedback IPMU would like to provide complete? I will then close this ticket and raise tickets specific to each problem.

Comment by Kiyoto Yabe [ 08/Mar/19 ]

I'm trying to install them on another server at IPMU (OS=debian 9.8). A the first round, I failed, but I think I'm doing something wrong, so could you give me more time?

Comment by hassan [ 29/Mar/19 ]

Separate tickets can be raised if further problems have been found.

Generated at Sat Feb 10 15:50:57 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.