== PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2018.02.26 ===
 * MEH: rebuild ippitc+ippqub ops tag ipp-20170121 to include the REFCAT keyword for warp+diff+ppmops now

=== Tuesday : 2018.02.27 ===
 * MEH: more chip update faults from missing .mdc files  (specifically in SAS set -- i.e., o5249g0202o,XY65,62358)
 * MEH: odd fault 3 cases last night for a specific skycell -- 
{{{
Exp Name 	Exp ID 	Chip ID 	Cam ID 	Fake ID 	Warp ID 	Skycell ID 	State 	Label 	Fault
o8176g0089o 	1376738 	2054573 	2021048 	1990697 	1997298 	skycell.0931.013 	new 	OSS.nightlyscience 	3 	
o8176g0105o 	1376754 	2054589 	2021064 	1990713 	1997314 	skycell.0931.013 	new 	OSS.nightlyscience 	3 
o8176g0135o 	1376784 	2054618 	2021093 	1990740 	1997341 	skycell.2585.086 	new 	ThreePi.nightlyscience 	3
}}}
=== Wednesday : 2018.02.28 ===
 * MEH: good number of exposure warps had to be manually fixed -- 
{{{
        Exp Name 	Exp ID 	Chip ID 	Cam ID 	Fake ID 	Warp ID 	Skycell ID 	State 	Label 	Fault
	o8177g0101o 	1376918 	2054650 	2021125 	1990770 	1997371 	skycell.2324.013 	new 	OSS.nightlyscience 	2 
	o8177g0114o 	1376931 	2054663 	2021138 	1990782 	1997383 	skycell.2264.015 	new 	OSS.nightlyscience 	3
	o8177g0118o 	1376935 	2054667 	2021142 	1990786 	1997387 	skycell.2326.092 	new 	OSS.nightlyscience 	3
	o8177g0118o 	1376935 	2054667 	2021142 	1990786 	1997387 	skycell.2383.001 	new 	OSS.nightlyscience 	2
	o8177g0118o 	1376935 	2054667 	2021142 	1990786 	1997387 	skycell.2383.002 	new 	OSS.nightlyscience 	2
	o8177g0124o 	1376941 	2054673 	2021148 	1990793 	1997394 	skycell.2263.016 	new 	OSS.nightlyscience 	3
	o8177g0139o 	1376956 	2054688 	2021162 	1990806 	1997407 	skycell.2383.011 	new 	OSS.nightlyscience 	3
	o8177g0139o 	1376956 	2054688 	2021162 	1990806 	1997407 	skycell.2383.054 	new 	OSS.nightlyscience 	2
	o8177g0139o 	1376956 	2054688 	2021162 	1990806 	1997407 	skycell.2383.055 	new 	OSS.nightlyscience 	2
	o8177g0144o 	1376961 	2054693 	2021168 	1990811 	1997412 	skycell.2263.062 	new 	OSS.nightlyscience 	2
	o8177g0144o 	1376961 	2054693 	2021168 	1990811 	1997412 	skycell.2263.063 	new 	OSS.nightlyscience 	2
	o8177g0144o 	1376961 	2054693 	2021168 	1990811 	1997412 	skycell.2263.064 	new 	OSS.nightlyscience 	2 
}}}
 * MEH: ippc72 back online (new power supply) -- re-enabling in ~ipp/ippconfig/nebservers.csh, ~ippitc/ippconfig/nebservers.csh and keeping an eye on
 * MEH: update crontabs to deal with new bright time z-band

=== Thursday : 2018.03.01 ===
 * MEH: running MOPS test chunk on nightly and data nodes in ~ippmops/stdscience

=== Friday : 2018.03.02 ===
 * MEH: more fault 3 and fault 2 warps from PSREFCAT code issues -- many more fault 3 were auto quality faulted to 42 by cronjob and in email to ps-ipp-ops@IfA.hawaii.edu
{{{
        Exp Name 	Exp ID 	Chip ID 	Cam ID 	Fake ID 	Warp ID 	Skycell ID 	State 	Label 	Fault
 	o8179g0137o 	1377175 	2054857 	2021332 	1990977 	1997578 	skycell.2425.075 	new 	OSS.nightlyscience 	3
	o8179g0139o 	1377177 	2054859 	2021334 	1990979 	1997580 	skycell.2474.038 	new 	OSS.nightlyscience 	3
	o8179g0146o 	1377184 	2054866 	2021341 	1990983 	1997584 	skycell.2553.051 	new 	OSS.nightlyscience 	3
	o8179g0151o 	1377189 	2054871 	2021346 	1990990 	1997591 	skycell.2583.051 	new 	OSS.nightlyscience 	3
	o8179g0151o 	1377189 	2054871 	2021346 	1990990 	1997591 	skycell.2583.087 	new 	OSS.nightlyscience 	3
	o8179g0153o 	1377191 	2054873 	2021348 	1990992 	1997593 	skycell.2608.089 	new 	OSS.nightlyscience 	3
	o8179g0156o 	1377194 	2054876 	2021351 	1990996 	1997597 	skycell.2626.059 	new 	OSS.nightlyscience 	3
	o8179g0156o 	1377194 	2054876 	2021351 	1990996 	1997597 	skycell.2637.010 	new 	OSS.nightlyscience 	3
	o8179g0156o 	1377194 	2054876 	2021351 	1990996 	1997597 	skycell.2637.020 	new 	OSS.nightlyscience 	3
	o8179g0156o 	1377194 	2054876 	2021351 	1990996 	1997597 	skycell.2638.010 	new 	OSS.nightlyscience 	3 

 	o8179g0129o 	1377167 	2054850 	2021325 	1990969 	1997570 	skycell.2312.043 	new 	SNIa.nightlyscience 	2
	o8179g0129o 	1377167 	2054850 	2021325 	1990969 	1997570 	skycell.2312.053 	new 	SNIa.nightlyscience 	2 
 	o8179g0473o 	1377511 	2055192 	2021667 	1991311 	1997912 	skycell.0938.021 	new 	OSS.nightlyscience 	2
	o8179g0473o 	1377511 	2055192 	2021667 	1991311 	1997912 	skycell.0938.031 	new 	OSS.nightlyscience 	2 
}}}
 * MEH: Curt updating the NAT system @1000 -- keep eye out for any issues
 * MEH: update settings for new BRIGHT time observing processing -- new label 


=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===