PS1 IPP Czar Logs for the week 2012-02-20 - 2012-02-26

(Up to PS1 IPP Czar Logs)

Monday : 2012-02-20

Tuesday : 2012-02-21

Serge is czar: no observation. No LAP because of new tag.

  • New tag cancelled

Wednesday : 2012-02-22

Serge is czar

Thursday : 2012-02-23

Roy is czar

  • 08:40 Roy: no data, no LAP
  • 08:58 Serge: fixed replication on ippdb03 see details here
  • 12:04 Bill: restarted deepstack pantasks. Reverted LAP runs with faults 1, 2, and 5
  • 12:45 Roy: attempt to change the tag:
check_system.sh stop

waited for Nrun in pantasks_client to drop to 0, then

check_system.sh shutdown

edited ~ipp/.tcshrc, changed from

psconfig ipp-20111222

to

psconfig ipp-20120216

edited ~ipp/.ptolemyrc, changed:

CONFDIR                 /home/panstarrs/ipp/psconfig/ipp-20111222.lin64/share/ippconfig

to

CONFDIR                 /home/panstarrs/ipp/psconfig/ipp-20120216.lin64/share/ippconfig

copied nebulous.site.pro to new location:

cp psconfig/ipp-20111222.lin64/share/pantasks/modules/nebulous.site.pro psconfig/ipp-20120216.lin64/share/pantasks/modules/

restarted all pantasks:

check_system.sh start.server
check_system.sh setup
check_system.sh run
  • 13:45 Bill stopped everything in order to merge in the remaining changes from the trunk into the tag. They look safe and some are needed for dqueries
  • 13:49 back on. Bill will restart deepstack once the last running skycell finishes.
  • 16:30 New tag build didn't have the magic programs installed. This raised havoc with distribution and the postage stamp server. (The scripts still expect the programs to exist even if they aren't run.) Chris fixed the build and Bill arranged for the postage stamp failures to be repaired.

Friday : 2012-02-24

  • 08:30 Mark: paused the remaining download of ~50 stare observations to get nightly science started (as ipp in gpc1 on ippdb01)
    update pzDownloadExp set state ='wait' where state = 'run' and exp_name like '%a';
    
  • 14:10 Mark: MDs stacks done, tweaking SSdiffs to run again @1420
  • 14:30 darks finished, reversed what did earlier the morning to set the stares to finish downloading
    update pzDownloadExp set state ='run' where state = 'wait' and exp_name like '%a';
    
  • 14:50 MD SSdiffs finished, tweak'n back to normal setting 10am HST time
  • 16:40 CZW: stdscience is running a bit slow, so I'm restarting it.

Saturday : 2012-02-25

Sunday : 2012-02-26