[INSTRM-1282] Possible command timeouts from FEE

Duplicate — Mon, 7 Jun 2021 11:15:07 +0000

The ccd actor sometimes fails to get a response from a FEE command. Cannot tell which side is the problem. Almost always the same command.

Cannot trivially distinguish between cases where the FEE/link misbehaved and when it might have been disconnected or otherwise worked on, so the logs at LAM and (especially) JHU are hard to make use of.

At Subaru, looks like ~4 real instances for r1 and ~4 for b1 since 2020-01-01.

Here is an example of one good, one failed command from this morning. Both the most command command to fail on (by far): a mode change, which switches voltages levels for all the clocks and bias voltages. Usually takes ~0.1s, so 2s is awry.

2021-05-21 03:55:50.684Z root             10 feeControl.py:904 sending command :'~lp,idle\n':
2021-05-21 03:55:50.688Z root             10 feeControl.py:962 received :~lp,idle:
2021-05-21 03:55:50.745Z root             10 feeControl.py:962 received :SUCCESS:
2021-05-21 03:56:03.487Z cmds             20 Actor.py:507 new cmd: wipe
2021-05-21 03:56:03.488Z root             10 feeControl.py:904 sending command :'~lp,idle\n':
2021-05-21 03:56:03.492Z root             10 feeControl.py:962 received :~lp,idle:
2021-05-21 03:56:05.494Z root             30 feeControl.py:953 pyserial device read(1) timed out
2021-05-21 03:56:05.495Z root             10 feeControl.py:962 received ::

PFS-JIRA

[INSTRM-1282] Possible command timeouts from FEE