IPP Progress Report for the week YYYY.MM.DD - YYYY.MM.DD

(Up to IPP Progress Reports)

Eugene Magnier

Serge Chastel

• deneb-locate.py: find files on the cluster (limited to the /export/<node>.<disk>/nebulous directories)
• float and double in C/MS SQL/MySQL explanation to Heather and Conrad
• added the '-size' option to deneb-locate.py for Mark
• added the ippb and the stsci nodes to the 'who's using the cluster' page
• czar on friday

Heather Flewelling

• ipptopsps
  • discovered why OB has duplicate objids: the regions in skytable.fits overlap
    • updated ipptopsps to cull objects that lie outside of a ra/dec region
    • copied over the older skytable.fits that does not have overlaps
    • redoing all SA_7 Batches for psps (easier to do this than for them to remove bad batches, and SAS is small)
  • ipptopsps proposed schema changes (see bold items in ​http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/ippToPsps_Object)
    • investigations with Gene/Conrad/Serge about size of ra/dec columns. Discovered that DOUBLE in mysql/C/python = FLOAT in ms sql server.
  • new SA7 load
    • problems with ipptopsps: if doing testing (to psps_test) and doing actual (to psps_jhu) at the same time from the same dvo, will run into problems (do not do this).
    • 2 failed with out of bounds obj id
    • rest loaded and became mergeworthy (after conrad restarted some stuff)
• dvo
  • ThreePi.V3.2012.Q2 died a painful death:
    • perl script ran out of memory (?) 18 times, and retried the same dvomerge 18 times
    • verified that in the dvodb (in images.dat and in the dvo itself) that there are 18 instances of that minidvodb
    • added (with help of gene) macros in pantasks.pro to not requeue tasks that have unknown_err (the merges did)
    • moved old ThreePi.V3.2012.Q2 -> moved old ThreePi.V3.2012.Q2.broken
    • requeued ThreePi.V3.2012.Q2 and restarted
    • it died the same painful death: one of the minidvodbs is hosed.
  • SAS_v8 started
    • staticsky queued for staticskystage
    • cam stage being built as SAS.20120720
• ipp
  • found bugs/fixes related to mac compile but not checked in:
    • one in psThread.c - one of the functions wants something returned
    • one in glueforge - reverting to older (r 34079) fixed it

Mark Huber

Bill Sweeney

Chris Waters

• Launched SAS_v8 processing.
• LAP: Added a far-too-large area to cover the Kepler field, and set up queue for the RA 10hr stripe.
• Tracked down ppVizPSF to confusion about how it reads command line options. Attempted to resolve this, but ran into trouble with segfaults.
• Read up on Rauscher, B.J. et al. noise correction algorithm. I'm doubtful we can easily adapt this to our data, and I don't believe it can be applied to historical data.
• Wrote more on detrend paper.