Uploaded image for project: 'Instrument control development'
  1. Instrument control development
  2. INSTRM-2598

improve agc_match insertion

    XMLWordPrintable

    Details

      Description

      On crowded fields (frameid=755735, say, with ~850 objects), the agc_match insert takes ~10s. The ag.py loop calls data_utils.py:write_agc_match(), which builds a numpy array which is then passed down to agActor/opdb.py:insert_agc_match() which iterates over the rows and inserts them one-by-one with the regular obdb.insert(). Replace those with some bulk insert. Umm, build a pandas DataFrame and pass that to the same opdb.insert()? That is OK, and is used elsewhere.

      For most fields this is not a big issue.

        Attachments

          Issue Links

          blocks

          Task - A task that needs to be done. INSTRM-2635 Check on the computation time for getting guide offsets

          • Normal - Normal priorities
          • Open
          relates to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. INSTRM-2632 Move all common database interactions into pfs_utils and optimize

          • Normal - Normal priorities
          • Open

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. PIPE2D-1749 Move all common database interactions into pfs_utils and optimize

          • Normal - Normal priorities
          • Won't Fix

            Activity

              People

              • Assignee:
                wtgee Wilfred Gee
                Reporter:
                cloomis cloomis
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: