Uploaded image for project: 'DRP 2-D Pipeline'
  1. DRP 2-D Pipeline
  2. PIPE2D-1168

fitPfsReferenceFlux breaks Tiger

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done (View Workflow)
    • Priority: Normal
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Running fitPfsReferenceFlux on our Tiger head node trashes the machine. I am reducing the new weekly:

      fitPfsReferenceFlux.py /scratch/pprice/sim2d-151/test --calib=/scratch/pprice/sim2d-151/test/CALIB --rerun=weekly/pipeline/brn/pipeline --doraise -j10 --no-versions --clobber-config --id 'visit=47^48^49^53^54^57' 'arm=b^r^n'

      I suspect that the fluxmodeldata is being accessed within a tight loop, which causes a huge load on the disk.

        Attachments

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. SIM2D-151 Incorporate simulated flux standard spectra

          • Normal - Normal priorities
          • Done
          relates to

          Task - A task that needs to be done. PIPE2D-1208 Make fitPfsFluxReference even faster

          • Normal - Normal priorities
          • Done

          Task - A task that needs to be done. PIPE2D-1231 Reduce memory usage of fitPfsReferenceFlux

          • Normal - Normal priorities
          • Done

          Task - A task that needs to be done. PIPE2D-1238 fitPfsFluxReference should not brute-force the model fitting

          • Normal - Normal priorities
          • Done

            Activity

              People

              • Assignee:
                price price
                Reporter:
                price price
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: