[INSTRM-786] ccd_r1 wipe failed Created: 30/Sep/19  Updated: 08/Dec/21  Resolved: 08/Dec/21

Status: Won't Fix
Project: Instrument control development
Component/s: ics_ccdActor
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Normal
Reporter: fmadec Assignee: cloomis
Resolution: Won't Fix Votes: 0
Labels: SPS
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
is duplicated by INSTRM-1282 Possible command timeouts from FEE Won't Fix
Relates
relates to INSTRM-1284 Handle FEE mode errors individually Done
relates to INSTRM-1282 Possible command timeouts from FEE Won't Fix
Story Points: 4
Sprint: SM1-2019 O, SM1PD-2021 A 12, SM1PD-2021 A 13, SM1PD-2021 A 14, SM1PD-2021 A 15, SM1PD-2021 A16

 Description   
13:17:16.728109  spsait i subcommand=1388,1,"sps expose arc exptime=10.00 cams=r1",1,"text='command failed: RuntimeError('Exposure has failed',) in expose() at /software/mhs/products/Linux64/ics_spsActor/0.0.2/python/spsActor/Controllers/expose.py:58'"
13:17:16.728667  spsait i status=100.00,0
13:17:16.729094  spsait w text="ccd_r1 wipe failed: RuntimeError(\"command echo mismatch. sent :'~lp,idle
': rcvd :'~rt,all':\",) in sendCommandStr() at /software/mhs/products/Linux64/ics_xcu_fpga/70.4.7/python/xcu_fpga/fee/feeControl.py:837"


 Comments   
Comment by fmadec [ 07/Jun/21 ]

similar error on R2 at LAM:

2021-06-07 09:46:26 iic w text="ccd_r2 wipe failed: RuntimeError(\"command echo mismatch. sent :'~lp,wipe ': rcvd :'SUCCESS':\") in sendCommandStr() at /software/mhs/products/Linux64/ics_xcu_fpga/82.2.0/python/xcu_fpga/fee/feeControl.py:916" 
2021-06-07 09:46:26 iic w text="command failed: RuntimeError('exposure failed...') in process() at /software/mhs/products/Linux64/ics_spsActor/1.0.7/python/spsActor/Commands/ExposeCmd.py:90" 
Comment by cloomis [ 07/Jun/21 ]

OK, there really was no echo of the command.

Good:

2021-06-07 09:45:09.073Z root             10 feeControl.py:962 received :~lp,idle:
2021-06-07 09:45:09.209Z root             10 feeControl.py:962 received :SUCCESS:
2021-06-07 09:45:10.210Z root             10 feeControl.py:904 sending command :'~lp,erase\n':
2021-06-07 09:45:10.215Z root             10 feeControl.py:962 received :~lp,erase:
2021-06-07 09:45:10.354Z root             10 feeControl.py:962 received :SUCCESS:
2021-06-07 09:45:11.356Z root             10 feeControl.py:904 sending command :'~lp,wipe\n':
2021-06-07 09:45:11.360Z root             10 feeControl.py:962 received :~lp,wipe:
2021-06-07 09:45:11.500Z root             10 feeControl.py:962 received :SUCCESS:

Bad:

2021-06-07 09:46:23.963Z root             10 feeControl.py:904 sending command :'~lp,idle\n':
2021-06-07 09:46:23.967Z root             10 feeControl.py:962 received :~lp,idle:
2021-06-07 09:46:24.108Z root             10 feeControl.py:962 received :SUCCESS:
2021-06-07 09:46:25.109Z root             10 feeControl.py:904 sending command :'~lp,erase\n':
2021-06-07 09:46:25.113Z root             10 feeControl.py:962 received :~lp,erase:
2021-06-07 09:46:25.253Z root             10 feeControl.py:962 received :SUCCESS:
2021-06-07 09:46:26.255Z root             10 feeControl.py:904 sending command :'~lp,wipe\n':
2021-06-07 09:46:26.255Z root             10 feeControl.py:962 received :SUCCESS:

Interestingly, there had been a failure just before that, setting up the read for the previous exposure (27115):

2021-06-07 09:45:29.882Z root             10 feeControl.py:904 sending command :'~lp,read\n':
2021-06-07 09:45:29.886Z root             10 feeControl.py:962 received :~lp,read:
2021-06-07 09:45:31.888Z root             30 feeControl.py:953 pyserial device read(1) timed out
2021-06-07 09:45:31.889Z root             10 feeControl.py:962 received ::

And that image looks like the voltages really were not changed from integration to readout.

I'll discuss with Hope.

Comment by cloomis [ 07/Jun/21 ]

See INSTRM-1282 – that has some stats and is not confused with a command collision problem. Should probably have kept that one and closed this one.....

Comment by hassan [ 08/Dec/21 ]

Superseded by INSTRM-1284

Generated at Sat Feb 10 16:28:38 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.