Log

Czar supervision

• SC: extracted the name of the failed items from summitcopy log file:

  grep "Nebulous can't " pantasks.stdout.log | grep 20100921 | sed 's/\s/\|/g' | cut -f5 -d'|' > blah
  

• SC: neb-moved each entry/key from the blah file to a .bak key, e.g:

  neb-mv neb://ipp020.0/gpc1/20100921/o5460g0391o/o5460g0391o.ota40.fits neb://ipp020.0/gpc1/20100921/o5460g0391o/o5460g0391o.ota40.fits.bak
  

• SC: followed instructions from Czar page to restart summitcopy server:

ssh ipp051 as ipp user and so on... -> The status command in summitcopy pantasks_client shows decreasing summit_copy Nrun (no Nfail) and activity for pz* scripts.

• SC: Started registration server (from Czar page again)

-> Bill's script shows how things evolve in terms of exposures:

~bills/bin/checkexp- -v | grep exposures

The number of exposures copied but not registered should (slowly) decrease, e.g:

ipp@ipp004:/home/panstarrs/ipp>date ; ~bills/bin//checkexp- -v | grep exposures
Tue Sep 21 11:13:40 HST 2010
676 summit exposures since 2010-09-21
244 exposures copied but not registered

and sometimes later:

Tue Sep 21 11:16:51 HST 2010
676 summit exposures since 2010-09-21
230 exposures copied but not registered

Czartool shows also that registered items are slowly changing.

• CZW: set ipp020 to repair mode:

  neb-host ipp020 repair
  

just in case it still has issues when/if it comes back online

• SC: The 'neb-moved each entry/key from the blah file to a .bak key' was a bit ambitious... I had to restore some (i.e. 17) keys, e.g.:

neb-mv neb://ipp014.0/gpc1/20100921/o5460g0593o/o5460g0593o.ota24.fits.bak neb://ipp014.0/gpc1/20100921/o5460g0593o/o5460g0593o.ota24.fits

• SC: Started stdscience. Added date manually (ns.add.date 2010-09-21) From Gene: when pantasks server is stopped/restarted, the date has to be set manually. Shceduler takes care of adding new date from one day to another.

• WS: pstamp and update servers restarted

• SC: Ran manually:

warptool -revertwarped -warp_id 107395 -skycell_id skycell.056 -dbname gpc1 (generated fits file was corrupted according to log)

• SC: Restarted all servers

• SC: modified ~ipp/stdscience/sweetspot/oss.20100918.chip.again to run Larry's SweetSpot OSS again.

Other

• MD11 tesselations:

Requests from CZW: Make the MD11 tesselations:

The instructions are here:
http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/PS1_Tessellations
and the center is going to be (ra,dec) = (270.000000, 66.560722).
There might already be an MD11 tessellation that exists, which needs
to be moved out of the way and replaced with this one.  We want the
name to be MD11.V2 to use the overlapping skycells.

I ran:

ipp@ipp004:/home/panstarrs/ipp>skycells -mode LOCAL -scale 0.2 -nx 12 -ny 12 -size 4 4 -fix-ns -center 270.000000 66.560722 -D CATDIR MD11.V2 -overlap 60 60
no data in db MD11.V2/Photcodes.dat
directory MD11.V2 does not exist, creating...

TODO

• SC: <blink>I'll restart stdscience only when registration is completed</blink> that is likely around 12:30.

• Larry's reprocessing?