https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/INSTRM-1019 Instrument control development <p>Hexapod sequence stop because of the error: failed to get a visit in 10s</p> <p> </p> <p>IIC or sequencePanel seems blocked, the switch off of the HgAr lamp has  not been done</p> <p> one sequence is in light blue but nothing happen</p> INSTRM-1019

Failed to get a visit in 10s

Bug Blocker Done Done fmadec fmadec SM1 SPS Fri, 19 Jun 2020 09:57:13 +0000 Wed, 5 Aug 2020 12:56:18 +0000 Tue, 30 Jun 2020 17:13:34 +0000 0 2 <p>it happened again on Friday night</p> <p> </p> <p>2020-06-19 11:46:23 iic f text="command failed: RuntimeError('Sub-command has failed.. sequence aborted..',) in processSubCmd() at /software/mhs/products/Linux64/ics_iicActor/1.1.2/python/ics/iicActor/utils/sequencing.py:263"</p> <p> </p> <p>so HgAr lamp remained ON for nothing during all the week-end...</p> <p> </p> <p>The <tt>reqframes</tt> RPC call by the g2cam library did take too long a few times, confirmed by the timestamps on the Subaru side. </p> <p>The Gen2 simulator we have been using runs on a shared machine in Hilo; they are installing a PFS-only Gen2 simulator on a summit machine. We will need to see what effect that has on performance.</p> <p>FWIW, here are all instances of <tt>reqframes</tt> delays over 6s since 2019-12-16:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>2020-06-19 06:13:43.504 6.988 2020-06-11 10:39:04.736 8.48 2020-06-24 09:16:51,372 13.815 2020-06-19 08:15:40.965 18.792 2020-06-19 08:55:19.056 20.096 2020-06-19 11:45:59,894 38.717 2020-06-19 08:53:04,728 154.415 </pre> </div></div> <p>And for the record, with the current server the minimum time to allocate a new set of frames is about 1.25s</p> <p>The Gen2 simulator for PFS was changed to a dedicated summit machine. After that we took 300 frames. The minimum time was 0.25s (vs. 1.25s), and the outliers above 0.4s were:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>2020-06-26 12:57:21,592 1 0.413 2020-06-29 18:21:27,974 1 0.445 2020-06-29 14:52:27,392 1 0.456 2020-06-29 19:54:59,409 1 0.473 2020-06-29 19:19:26,529 1 0.482 2020-06-29 18:53:15,866 1 0.496 2020-06-29 20:28:40,353 1 0.512 2020-06-26 12:49:27,097 1 0.599 2020-06-29 13:23:39,601 1 0.675 2020-06-29 17:45:56,221 1 0.7 </pre> </div></div> <p>vs. the list above.</p> Relates INSTRM-560 Development Rank 0|zzs1mg:1 Sprint SM1PD-2020 G