PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD

(Up to PS1 IPP Czar Logs)

Monday : 2018.05.28

• MEH: continue working on cleaning up broken issues for MOPS getting warp stamps -- make no changes to system without discussing with me first
  • re-queue MOPS request as mehtest to run under WEB.BIG and look at other failure issues -- FIXNS/RINGS.V0 older data not reprocessed due to FWHM cut about <12 pixels in ecliptic.rp and will need a new config to do so now, this may be silently not giving data to MOPS reporting PSTAMP_NO_OVERLAP
  • oddly broken .psf file o6864g0429o.770967/o6864g0429o.770967.ch.1329113.XY60.psf -- had to manuall neb-mv to .bad for it to update with the recent code mods
  • additional reprocessing of old, broken ecliptic.rp under label/data_group PSNSC.wfix.20180525/PSNSC.wfix.20180525.<orig data_group>, moving broken update files to label ps_ud_MOPSeclip
  • additional reprocessing of broken LAP.PV3 files under label/data_group mopsfix/mops.fixbrokenLAP.20180323
  • continue re-queue MOPS pstamp requests looking at missing/broken file update fault cases from the stsci shuffle and clearing as needed -- will only continue to re-queue the remaining MOPS requests, will not be fixing any more broken files after today
  • MOPS request names that seem to have all requested exposures based on the re-queue test -- ~60 exposures to fix/reprocess and complete the remaining 23 requests in the _120-_179 set in the ps_ud_WEB.UP label

    web_639232.fits weryk_5B063D9F_00
    web_639233.fits weryk_5B063D9F_179
    web_639234.fits weryk_5B063D9F_178 
    web_639237.fits weryk_5B063D9F_175 
    web_639238.fits weryk_5B063D9F_174
    web_639240.fits weryk_5B063D9F_173
    web_639241.fits weryk_5B063D9F_172
    web_639244.fits weryk_5B063D9F_169 
    web_639245.fits weryk_5B063D9F_168
    web_639247.fits weryk_5B063D9F_166 
    web_639248.fits weryk_5B063D9F_165
    web_639250.fits weryk_5B063D9F_163
    web_639251.fits weryk_5B063D9F_162
    web_639252.fits weryk_5B063D9F_161
    web_639253.fits weryk_5B063D9F_160
    web_639254.fits weryk_5B063D9F_159
    web_639255.fits weryk_5B063D9F_158
    web_639258.fits weryk_5B063D9F_155
    web_639259.fits weryk_5B063D9F_154 
    web_639260.fits weryk_5B063D9F_153
    web_639261.fits weryk_5B063D9F_152
    web_639263.fits weryk_5B063D9F_150 
    web_639266.fits weryk_5B063D9F_147 
    web_639267.fits weryk_5B063D9F_146
    web_639268.fits weryk_5B063D9F_145
    web_639269.fits weryk_5B063D9F_144
    web_639270.fits weryk_5B063D9F_143
    web_639271.fits weryk_5B063D9F_142
    web_639272.fits weryk_5B063D9F_141
    web_639273.fits weryk_5B063D9F_140
    web_639275.fits weryk_5B063D9F_138 
    web_639278.fits weryk_5B063D9F_135 
    web_639280.fits weryk_5B063D9F_133 
    web_639281.fits weryk_5B063D9F_132 
    web_639282.fits weryk_5B063D9F_131
    web_639285.fits weryk_5B063D9F_128 
    web_639286.fits weryk_5B063D9F_127
    

Tuesday : 2018.05.29

• MEH: running PS2-WSdiff for MOPS in ~ippps2/stscience

Wednesday : YYYY.MM.DD

Thursday : YYYY.MM.DD

• 08:45 EAM : one exposure was stuck at cam. psastro was hung waiting for a reply from nebulous for an input file. the input file exists (manual requests for the file succeeded). checking the psastro stack, the code was waiting for a response from nebclient via soap. My best guess: a hiccup in the apache server. psastro stack trace:

  #0  0x00007f9b09e37bd5 in recv () from /lib/libpthread.so.0
  #1  0x00007f9b0dd6885d in frecv (soap=0x484ea70, s=0x4854b98 "POST /nebulous HTTP/1.1\r\nHost: ippc75\r\nUser-Agent: gSOAP/2.7\r\nContent-Type: text/xml; charset=utf-8\r\nContent-Length: 605\r\nConnection: close\r\nSOAPAction: \"urn:Nebulous/Server/SOAP#find_instances\"\r\n\r\n<?"..., n=65536) at stdsoap2.c:955
  #2  0x00007f9b0dd59e88 in soap_recv_raw (soap=0x7) at stdsoap2.c:1201
  #3  0x00007f9b0dd5a1d6 in soap_recv (soap=0x484ea70) at stdsoap2.c:1318
  #4  0x00007f9b0dd5a335 in soap_getchar (soap=0x7) at stdsoap2.c:1335
  #5  0x00007f9b0dd67246 in soap_begin_recv (soap=0x484ea70) at stdsoap2.c:12925
  #6  0x00007f9b0dd57109 in soap_call_ns1__find_USCOREinstances (soap=0x484ea70, soap_endpoint=0x3d093e0 "http://ippc75/nebulous", soap_action=0x7f9b0dd715d0 "urn:Nebulous/Server/SOAP#find_instances", key=<value optimized out>, volume=<value optimized out>, _param_3=0x7fff867cba10) at soapClient.c:684
  #7  0x00007f9b0dd4715f in nebFindInstances (server=0x14692e0, key=0xfffffffffffffe00 <Address 0xfffffffffffffe00 out of bounds>, volume=<value optimized out>) at nebclient.c:480
  #8  0x00007f9b0dd47667 in nebFind (server=0x14692e0, key=0x3d43040 "neb://ipp117.0/gpc1/OSS.nt/2018/05/31//o8269g0257o.1392342/o8269g0257o.1392342.ch.2074968.XY11.cmf") at nebclient.c:548
  #9  0x00007f9b0dfaba15 in pmConfigConvertFilename (filename=0x3d43040 "neb://ipp117.0/gpc1/OSS.nt/2018/05/31//o8269g0257o.1392342/o8269g0257o.1392342.ch.2074968.XY11.cmf", config=0x624760, create=false, trunc=false) at pmConfig.c:1828
  #10 0x00007f9b0dfe713f in readPHUfromFilename (filename=0x7 <Address 0x7 out of bounds>, config=0x4854b98) at pmFPAfileDefine.c:458
  #11 0x00007f9b0dfe8cd7 in fpaFileDefineFromArray (outConfig=<value optimized out>, sysConfig=0x4775ad0, bind=0x0, name=0x403f91 "PSASTRO.INPUT", filenames=0x3d42640) at pmFPAfileDefine.c:645
  #12 0x00007f9b0dfe9be0 in pmFPAfileDefineFromArgs (success=0x7fff867cbe7f, config=0x624760, filename=0x403f91 "PSASTRO.INPUT", argname=0x403f99 "INPUT") at pmFPAfileDefine.c:741
  #13 0x00000000004028df in psastroParseCamera (config=0x624760) at psastroParseCamera.c:20
  #14 0x0000000000401fe5 in main (argc=22, argv=<value optimized out>) at psastro.c:39
  

Friday : YYYY.MM.DD

Saturday : YYYY.MM.DD

Sunday : YYYY.MM.DD