price@price-laptop:~/pfs/pipe2d-618 $ sqlite3 obslog.sqlite3
sqlite> .mode csv
sqlite> .import PIPE2D-618.csv obslog
sqlite> .schema
CREATE TABLE obslog(
  "cmd_str" TEXT,
  "pfs_visit_id" TEXT,
  "visit_set_id" TEXT,
  "exp_type" TEXT,
  "time_exp_start" TEXT,
  "notes" TEXT,
  "data_flag" TEXT,
  "comments" TEXT,
  "name" TEXT,
  "status" TEXT,
  "sequence_type" TEXT,
  "sps_module_id" TEXT,
  "arm" TEXT,
  "sps_camera_id" TEXT
);
sqlite> select count(*) from obslog;
2596
sqlite> select min(pfs_visit_id), max(pfs_visit_id) from obslog;
18218,19555


Need to:
* Generate suitable bias (18218..18227), dark (18188..18202), flat (17839..17982).
* Bootstrap a detectorMap (flat: 18231, arc: 18232)
* For each set:
  + Process flats as a fiberTrace
  + Process each arc independently


(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-618 $ generateCommands.py /projects/HSC/PFS/Subaru/ --calib /projects/HSC/PFS/Subaru/CALIB-price --rerun price/pipe2d-618 --blocks=pipe2d_618 -j 20 pipe2d-618.yaml calibs.sh 
(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-618 $ ./calibs.sh 

Bootstrap r:
bootstrap INFO: Median difference from detectorMap: -1.251848,-1.112205 pixels
bootstrap INFO: Fit 116/141 points, rms: x=0.713381 y=0.189416 total=0.458008 pixels
bootstrap INFO: Updating detectorMap...
bootstrap INFO: Median difference from detectorMap: 0.685743,-1.230428 pixels
bootstrap INFO: Fit 77/96 points, rms: x=0.349973 y=0.116337 total=0.121325 pixels

Bootstrap b:
bootstrap INFO: Median difference from detectorMap: 0.244493,-0.289952 pixels
bootstrap INFO: Fit 8/12 points, rms: x=0.088476 y=0.142863 total=0.089313 pixels
bootstrap INFO: Updating detectorMap...
bootstrap INFO: Median difference from detectorMap: 1.236342,-0.364347 pixels
bootstrap INFO: Fit 7/7 points, rms: x=0.258951 y=0.009806 total=0.178473 pixels


generateCommands isn't going to work for the main processing, since we want to
run reduceArc on each arc individually (to detect any short timescale motion).
--> fiberTrace.sh

(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-618 $ ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/projects/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy --config clobber=True register.ignore=True -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-618/fiberTrace/FIBERTRACE/*.fits

The problem now is that the butler doesn't recognise visit0 (can only have a single fiberTrace per day).
So we'll hack the calibRegistry when we want to turn the fiberTrace over.
--> arcs.sh