IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 69 and Version 70 of STS.refstack.20120510


Ignore:
Timestamp:
Jun 21, 2012, 1:33:56 PM (14 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • STS.refstack.20120510

    v69 v70  
    10811081}}}
    10821082
    1083  * right, don't want bothways since it is a WS -- is there a way to skip those? no, publish runs directly off diffRun settings, need to clean and rerun..
    1084   * this true of other WS runs? OSS is also not bothways, MD same.. so need to rerun and set previous pub to drop and clean diffRun
     1083 * right, don't want bothways since it is a WS -- is there a way to skip those made and just publish the .pos. files? doesn't appear to be so, need to clean up and rerun.
     1084  * this true of other WS runs? OSS is also not bothways, MD same.. so need to rerun and set previous pub_id to drop and clean diffRun
    10851085{{{
    10861086difftool -updaterun -set_state goto_cleaned -set_label goto_cleaned -label STS.mopsdiff.mehtest -dbname gpc1
    … …  
    10891089difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiff.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_label STS.mopsdiffredo.mehtest -set_workdir neb://@HOST@.0/meh/STS.mopsdiffredo.mehtest -set_data_group STS.mopsdiffredo.mehtest -set_reduction WARPSTACK -simple -rerun -pretend
    10901090
    1091 --> data_group not set right.. set to date
    1092 --> -rerun needed? use -pretend to see -- yes need -rerun - and says 164 now, why double?? since only 1 way should be the 43 as the number of warps?
    1093 --> 16+16+11 exposures
    1094 --> warp_id 258031 has 94 skycells
    1095 --> but reports skycell_count 162
    1096 --> using -skycell_id to limit it is 2 per exposure, how.. what are they?
     1091--> -rerun needed?  yes and says 164 now, why double?? since only 1 way should be the 43 as the number of warps? 16+16+11 exposures
     1092--> warp_id 258031 has 94 skycells, but reports skycell_count 162
     1093--> using -skycell_id to test limit, it is 2 per exposure, how.. what are they?
     1094}}}
     1095  * why is difftool -rerun seem to be producing double the runs now? the sql query for the -definewarpstack
     1096{{{
    10971097SELECT
    10981098    exp_id,
    … …  
    11351135    -- diff where hook
    11361136GROUP BY exp_id, warp_id DESC;
    1137 
    1138 --> try single skycell again, -pretend outputs lines but nothing actually queued..
     1137}}}
     1138  * try single skycell again, -pretend outputs lines but nothing actually queued..
     1139{{{
    11391140difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiff.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_label STS.mopsdiffredo.mehtest -set_workdir neb://@HOST@.0/meh/STS.mopsdiffredo.mehtest -set_data_group STS.mopsdiffredo.mehtest -set_reduction WARPSTACK -skycell_id skycell.1.03 -simple -rerun -pretend
     1141
    11401142--> retry again using -bothways
    11411143difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiff.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_label STS.mopsdiffredo.mehtest -set_workdir neb://@HOST@.0/meh/STS.mopsdiffredo.mehtest -set_data_group STS.mopsdiffredo.mehtest -set_reduction WARPSTACK -skycell_id skycell.1.03 -simple -rerun -bothways -pretend
    11421144--> nope.. can redo only be done on full runs and not cleaned ones then?
    1143 
     1145}}}
     1146  * look at specific diffim and update (since these were cleaned earlier)
     1147{{{
    11441148difftool -dbname gpc1 -setskyfiletoupdate -set_label STS.mopsdiff.mehtest  -diff_id 242223
    11451149
    11461150difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiff.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_label STS.mopsdiffredo.mehtest -set_workdir neb://@HOST@.0/meh/STS.mopsdiffredo.mehtest -set_data_group STS.mopsdiffredo.mehtest -set_reduction WARPSTACK -skycell_id skycell.1.03 -simple -rerun -pretend
    11471151--> nope..
     1152
    11481153difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiff.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_label STS.mopsdiff.mehtest -set_workdir neb://@HOST@.0/meh/STS.mopsdiff.mehtest -set_data_group STS.mopsdiff.mehtest -set_reduction WARPSTACK -skycell_id skycell.1.03 -simple -rerun
    1149 --> need to go through this explicitly..
    1150 
    1151 *** suspect that wont redo for 1 skycell because diff_id same for all and need to do all and should be able to do just for diff_id to rerun? would need to update all of them then
    1152 
     1154--> need to go through this in more detail
     1155}}}
     1156
     1157  * suspect that won't redo for 1 skycell because diff_id same for all and need to do all and should be able to do just for diff_id to rerun? would need to update all of them then
     1158{{{
    11531159difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiff.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_label STS.mopsdiffredo.mehtest -set_workdir neb://@HOST@.0/meh/STS.mopsdiffredo.mehtest -set_data_group STS.mopsdiffredo.mehtest -set_reduction WARPSTACK  -simple -rerun -pretend
    11541160
    11551161difftool -dbname gpc1 -setskyfiletoupdate -set_label STS.mopsdiff.mehtest  -diff_id 242223
     1162
    11561163select * from diffRun where data_group like "STS.2012%";
     1164--> yes all cleaned
    11571165
    11581166mysql -hippdb01 -uippuser -pxxxx gpc1 -B -e 'select diff_id,state,data_group from diffRun where data_group like "STS.2012%" and state="cleaned";' | grep -v diff_id | awk '{print "difftool -dbname gpc1 -setskyfiletoupdate -set_label STS.mopsdiff.mehtest  -diff_id  "$1}' > ~/updatediff_sts.mopsdiff.mehtest.bat
    11591167
    1160 --> ipp017 ram overuse
     1168--> ipp017 RAM overloaded again now in updating diffims -- manually kill off few and revert
    11611169difftool -revertdiffskyfile -fault 4 -label STS.mopsdiff.mehtest -dbname gpc1
    11621170
    … …  
    11641172difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiff.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_label STS.mopsdiffredo.mehtest -set_workdir neb://@HOST@.0/meh/STS.mopsdiffredo.mehtest -set_data_group STS.mopsdiffredo.mehtest -set_reduction WARPSTACK  -simple -rerun -pretend
    11651173
    1166 --> needs workdir, label and data_group optional
    1167 difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiff.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_workdir neb://@HOST@.0/meh/STS.mopsdiffredo.mehtest -set_reduction WARPSTACK  -simple -rerun -pretend
     1174--> needs workdir, label and data_group seem optional unless want to change
     1175difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiff.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_workdir neb://@HOST@.0/meh/STS.mopsdiffredo.mehtest -set_reduction WARPSTACK  -simple -rerun
     1176
     1177--> nope, still missing something.. queue up a new test..
     1178
    11681179}}}
    11691180== Diffim sample 2 (published) ==