IPP Progress Report for the week YYYY.MM.DD - YYYY.MM.DD

(Up to IPP Progress Reports)

Eugene Magnier

Serge Chastel

• ppMops fix
• ippMonitor move to ippdb01 (clusterMonitor, db replication status)
• False Positive zoology with Heather and Roy

Heather Flewelling

Roy Henderson

• ippToPsps
  • found minor bug in queuing: now using batch-type in query to determine what has, and hasn't, been processed
  • added code to reject chips with bad astrometric solutions, the source of the duplicate object IDs in P2 batches (see last week's report)
  • investigated duplicates in stacks: some with NULL flux, some with negative flux. Simply rejecting duplicates, i.e. taking the first one only
  • attempts to use the DXLayer web-service to delete batches. Help from Gavin.
  • now logging to the database when loading to datastore fails (eg no network), and...
  • wrote code to queue batches that didn't load to the datastore
  • continued to load new LAP data (400 so far)

• Support
  • more discussions with Kent Wood regarding his Fermi sources
  • pulled detections from the 3PI DVO database for Kent, with lots of help from Heather

• Tiger team
  • lots of discussions and meetings
  • worked on a program to run a set of cuts against all filters for all tables. Fully configurable
  • helped write-up results on wiki

• Other
  • attended, and made a short presentation, at Conrad's MOPS workshop on Wednesday afternoon. Prep included some minor tweaks to PSVO.
  • set up a new ps1sc mailing list

Mark Huber

• moved office
• MD reference stacks:
  • push through remaining MD01, verify mostly complete and distributed.
  • working through cleanup process for MD01, MD10 chips, warps, WSdiffims. tracking diskspace used for MD runs.
• Looking into reasons for increased difference image detections in some exposures stalling in publish/ppMops.
• Czar Thursday, Friday

Bill Sweeney

Chris Waters

• LAP:
  • Updated planning wiki page (​http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/LAP_Science_Scheduling).
  • Fixed warp-stack diff creation, as the diffs were not being queued. This also explains why some exposures were not being published to DVO (without a diff, no magic could be performed).
  • Identified bug in magic's handling of multiple diffs using the same exposure in the same label. Working on a fix.
• Diskspace: Reran disk usage scripts to get a current snapshot of disk usage. Wrote various accounting scripts to attempt to measure how much disk space any given processing job will consume. With these usage rates understood, we can calculate the expected disk usage based simply on a database query of the number of runs in each state. This appears to work reasonably well and give reasonably believable results.
• ROC: Continued running repairs. This is somewhat hindered by the disk swaps happening at the same time.
• Other:
  • Made new mask for OTA66 to remove cells that were causing large numbers of detections.
  • Processed STD exposures for John Tonry, using new constant weighted photometry reduction class.
  • Identified possible source of warp-stage slowness: The returned METADATA was formatted incorrectly, which meant only one label at a time would be processed by pantasks.