I created a script that, given an exp_name, traces through all the stages (chip/cam/warp/stack/(diffs)/dist) in order to check that all the exposures were going through all the steps.

This output is the result of that script, for a few nights. For chip/cam/warp, the numbers in () indicate, roughly how many times they were distributed. 2 is okay for MDs. For stack/diff, the () indicates the number of skycells distributed. There are 3 types of diffs in my scheme:

WS is a WarpStack Diff, with the W linked from that exp_name (stack2 is a refstack).

WW1 is a WarpWarp Diff, with warp1 linked from that exp_name.

WW2 is a WarpWarp Diff, with warp2 linked from that exp_name.

SS is a StackStack Diff, with stack1 linked from that exp_name (stack2 is a refstack)

all, unless obvious test exposures, should go through warp

MDs should have Stacks, WS, and SS.

3Pi and it's friends should have no stacks, but should have entries for WW1 or WW2 (depending on if that exposure was used for warp2 or warp1 in a diff).

I have discovered (!?) some oddities (these are subsets of the nights)

2011-01-12

exp_name filter comment rawExp chip(#) cam(#) fake warp (#) stack (#) WS (#) WW1 (#) WW2 (#) SS (#)
o5573g0044o z.00000 135.3PI.z.W-8 ps1_11_2824 visit 1 full full (1) full(1) full full (1) 0 () () 84(84) () ()
o5573g0045o z.00000 135.3PI.z.W-8 ps1_11_2975 visit 1 full full (1) full(1) full full (1) 0 () () 86(86) () ()
o5573g0046o z.00000 135.3PI.z.W-8 ps1_11_2974 visit 1 full full (1) full(1) full full (1) 0 () () 81(81) () ()
o5573g0047o z.00000 135.3PI.z.W-8 ps1_11_2812 visit 1 full full (1) full(1) full full (1) 0 () () 87(87) () ()
o5573g0048o z.00000 135.3PI.z.W-8 ps1_11_2951 visit 1 full full (1) full(1) full full (1) 0 () () 86(86) () ()
o5573g0049o z.00000 135.3PI.z.W-8 ps1_11_2972 visit 1 full full (1) full(1) full full (1) 0 () () 85(85) () ()
o5573g0050o z.00000 135.3PI.z.W-8 ps1_11_2973 visit 1 full full (1) full(1) full full (1) 0 () () 79(79) () ()
o5573g0052o z.00000 135.3PI.z.W-8 ps1_11_2824 visit 1 full full (1) full(1) full full (1) 0 () () () 84(84) ()
o5573g0053o z.00000 135.3PI.z.W-8 ps1_11_2975 visit 1 full full (1) full(1) full full (1) 0 () () () 86(86) ()
o5573g0054o z.00000 135.3PI.z.W-8 ps1_11_2974 visit 1 full full (1) full(1) full full (1) 0 () () () 81(81) ()
o5573g0055o z.00000 135.3PI.z.W-8 ps1_11_2812 visit 1 full full (1) full(1) full full (1) 0 () () () 87(87) ()
o5573g0056o z.00000 135.3PI.z.W-8 ps1_11_2951 visit 1 full full (1) full(1) full full (1) 0 () () () 86(86) ()
o5573g0057o z.00000 135.3PI.z.W-8 ps1_11_2972 visit 1 full full (1) full(1) full full (1) 0 () () () 85(85) ()
o5573g0058o z.00000 135.3PI.z.W-8 ps1_11_2973 visit 1 full full (1) full(1) full full (1) 0 () () () 79(79) ()
o5573g0059o z.00000 135.3PI.z.W-8 ps1_11_2998 visit 1 full full () full() full full () 0 () () () () ()
o5573g0060o z.00000 135.3PI.z.W-8 ps1_11_2999 visit 1 full full () full() full full () 0 () () () () () <--- these have no corresponding visit2s, so no diffs were made (as one would expect)
o5573g0061o z.00000 135.3PI.z.W-8 ps1_11_2823 visit 1 full full () full() full full () 0 () () () () ()
o5573g0062o z.00000 135.3PI.z.W-8 ps1_11_2996 visit 1 full full () full() full full () 0 () () () () ()
o5573g0063o z.00000 135.3PI.z.W-8 ps1_11_2997 visit 1 full full () full() full full () 0 () () () () ()
o5573g0064o z.00000 135.3PI.z.W-8 ps1_11_2822 visit 1 full full () full() full full () 0 () () () () ()
o5573g0065o z.00000 135.3PI.z.W-8 ps1_11_2995 visit 1 full full () full() full full () 0 () () () () ()
o5573g0068o r.00000 135.3PI.r.W-7 ps1_11_3053 visit 1 full full (1) full(1) full full (1) 0 () () 83(83) () ()
o5573g0069o r.00000 135.3PI.r.W-7 ps1_11_3159 visit 1 full full (1) full(1) full full (1) 0 () () 82(82) () ()
o5573g0070o r.00000 135.3PI.r.W-7 ps1_11_3158 visit 1 full full (1) full(1) full full (1) 0 () () 83(83) () ()
o5573g0071o r.00000 135.3PI.r.W-7 ps1_11_3046 visit 1 full full (1) full(1) full full (1) 0 () () 86(86) () ()
o5573g0072o r.00000 135.3PI.r.W-7 ps1_11_3145 visit 1 full full (1) full(1) full full (1) 0 () () 77(77) () ()
o5573g0073o r.00000 135.3PI.r.W-7 ps1_11_3156 visit 1 full full (1) full(1) full full (1) 0 () () 82(82) () ()
o5573g0074o r.00000 135.3PI.r.W-7 ps1_11_3157 visit 1 full full (1) full(1) full full (1) 0 () () 84(84) () ()
o5573g0075o r.00000 135.3PI.r.W-7 ps1_11_3172 visit 1 full full (1) full(1) full full (1) 0 () () 84(84) () ()
o5573g0076o r.00000 135.3PI.r.W-7 ps1_11_3052 visit 1 full full (1) full(1) full full (1) 0 () () 85(85) () ()

2011-01-11

exp_name filter comment rawExp chip(#) cam(#) fake warp (#) stack (#) WS (#) WW1 (#) WW2 (#) SS (#)
o5572g0294o z.00000 135.3PI.z.E+5 ps1_11_1940 visit 1 full full () full() full full () 0 () () () () ()
o5572g0295o z.00000 135.3PI.z.E+5 ps1_11_2039 visit 1 full full () full() full full () 0 () () () () ()
o5572g0296o z.00000 135.3PI.z.E+5 ps1_11_2050 visit 1 full full () full() full full () 0 () () () () ()
o5572g0297o z.00000 135.3PI.z.E+5 ps1_11_5693 visit 1 full full () full() full full () 0 () () () () ()
o5572g0298o z.00000 135.3PI.z.E+5 ps1_11_2064 visit 1 full full () full() full full () 0 () () () () ()
o5572g0299o z.00000 135.3PI.z.E+5 ps1_11_2051 visit 1 full full () full() full full () 0 () () () () ()
o5572g0300o z.00000 135.3PI.z.E+5 ps1_11_1945 visit 1 full full () full() full full () 0 () () () () ()
o5572g0301o z.00000 135.3PI.z.E+5 ps1_11_2066 visit 1 full full () full() full full () 0 () () () () () <--- this one has huge chunks of 3 pi not processed
o5572g0302o z.00000 135.3PI.z.E+5 ps1_11_2053 visit 1 full full () full() full full () 0 () () () () () same thing happens on most nights
o5572g0303o z.00000 135.3PI.z.E+5 ps1_11_1952 visit 1 full full () full() full full () 0 () () () () ()
o5572g0304o z.00000 135.3PI.z.E+5 ps1_11_2067 visit 1 full full () full() full full () 0 () () () () ()
o5572g0305o z.00000 135.3PI.z.E+5 ps1_11_1940 visit 2 full full () full() full full () 0 () () () () ()
o5572g0306o z.00000 135.3PI.z.E+5 ps1_11_2039 visit 2 full full () full() full full () 0 () () () () ()
o5572g0307o z.00000 135.3PI.z.E+5 ps1_11_2050 visit 2 full full () full() full full () 0 () () () () ()
o5572g0308o z.00000 135.3PI.z.E+5 ps1_11_5693 visit 2 full full () full() full full () 0 () () () () ()
o5572g0309o z.00000 135.3PI.z.E+5 ps1_11_2064 visit 2 full full () full() full full () 0 () () () () ()
o5572g0310o z.00000 135.3PI.z.E+5 ps1_11_2051 visit 2 full full () full() full full () 0 () () () () ()
o5572g0311o z.00000 135.3PI.z.E+5 ps1_11_1945 visit 2 full full () full() full full () 0 () () () () ()
o5572g0312o z.00000 135.3PI.z.E+5 ps1_11_2066 visit 2 full full () full() full full () 0 () () () () ()
o5572g0313o z.00000 135.3PI.z.E+5 ps1_11_2053 visit 2 full full () full() full full () 0 () () () () ()
o5572g0314o z.00000 135.3PI.z.E+5 ps1_11_1952 visit 2 full full () full() full full () 0 () () () () ()
o5572g0315o z.00000 135.3PI.z.E+5 ps1_11_2067 visit 2 full full () full() full full () 0 () () () () ()

2011-01-09

exp_name filter comment rawExp chip(#) cam(#) fake warp (#) stack (#) WS (#) WW1 (#) WW2 (#) SS (#)
o5570g0409o w.00000 135.MSS.N2.A1.w ps1_10_3454 visit 1 full full () full() full full () 0 () () 82(82) () ()
o5570g0410o w.00000 135.MSS.N2.A1.w ps1_10_3455 visit 1 full full () full() full full () 0 () () 80(80) () ()
o5570g0411o w.00000 135.MSS.N2.A1.w ps1_10_3474 visit 1 full full () full() full full () 0 () () 83(83) () ()
o5570g0412o w.00000 135.MSS.N2.A1.w ps1_10_3330 visit 1 full full () full() full full () 0 () () 84(84) () ()
o5570g0413o w.00000 135.MSS.N2.A1.w ps1_10_3439 visit 1 full full () full() full full () 0 () () 81(81) () ()
o5570g0414o w.00000 135.MSS.N2.A1.w ps1_10_3438 visit 1 full full () full() full full () 0 () () 85(85) () ()
o5570g0415o w.00000 135.MSS.N2.A1.w ps1_10_3323 visit 1 full full () full() full full () 0 () () 84(84) () ()
o5570g0416o w.00000 135.MSS.N2.A1.w ps1_10_3454 visit 2 full full () full() full full () 0 () () () 82(82) ()
o5570g0417o w.00000 135.MSS.N2.A1.w ps1_10_3455 visit 2 full full () full() full full () 0 () () () 80(80) ()
o5570g0418o w.00000 135.MSS.N2.A1.w ps1_10_3474 visit 2 full full () full() full full () 0 () () () 83(83) ()
o5570g0419o w.00000 135.MSS.N2.A1.w ps1_10_3330 visit 2 full full () full() full full () 0 () () 85(85) 84(84) () <-- this is diffed twice (once as warp1, once as warp2)
o5570g0420o w.00000 135.MSS.N2.A1.w ps1_10_3439 visit 2 full full () full() full full () 0 () () () 81(81) ()
o5570g0421o w.00000 135.MSS.N2.A1.w ps1_10_3438 visit 2 full full () full() full full () 0 () () () 85(85) ()
o5570g0422o w.00000 135.MSS.N2.A1.w ps1_10_3323 visit 2 full full () full() full full () 0 () () 84(84) 84(84) ()
o5570g0423o w.00000 135.MSS.N2.A2.w ps1_10_3454 visit 1 full full () full() full full () 0 () () 82(82) () ()
o5570g0424o w.00000 135.MSS.N2.A2.w ps1_10_3455 visit 1 full full () full() full full () 0 () () 79(79) () ()
o5570g0425o w.00000 135.MSS.N2.A2.w ps1_10_3474 visit 1 full full () full() full full () 0 () () 84(84) () ()
o5570g0426o w.00000 135.MSS.N2.A2.w ps1_10_3330 visit 1 full full () full() full full () 0 () () () 85(85) ()
o5570g0427o w.00000 135.MSS.N2.A2.w ps1_10_3439 visit 1 full full () full() full full () 0 () () 80(80) () ()
o5570g0428o w.00000 135.MSS.N2.A2.w ps1_10_3438 visit 1 full full () full() full full () 0 () () 84(84) () ()
o5570g0429o w.00000 135.MSS.N2.A2.w ps1_10_3323 visit 1 full full () full() full full () 0 () () () 84(84) ()
o5570g0430o w.00000 135.MSS.N2.A2.w ps1_10_3454 visit 2 full full () full() full full () 0 () () () 82(82) ()
o5570g0431o w.00000 135.MSS.N2.A2.w ps1_10_3455 visit 2 full full () full() full full () 0 () () () 79(79) ()
o5570g0432o w.00000 135.MSS.N2.A2.w ps1_10_3474 visit 2 full full () full() full full () 0 () () () 84(84) ()
o5570g0433o w.00000 135.MSS.N2.A2.w ps1_10_3330 visit 2 full full () full() full full () 0 () () () () () <--- this is not diffed
o5570g0434o w.00000 135.MSS.N2.A2.w ps1_10_3439 visit 2 full full () full() full full () 0 () () () 80(80) ()
o5570g0435o w.00000 135.MSS.N2.A2.w ps1_10_3438 visit 2 full full () full() full full () 0 () () () 84(84) ()
o5570g0436o w.00000 135.MSS.N2.A2.w ps1_10_3323 visit 2 full full () full() full full () 0 () () () () ()

2011-01-02

o5563g0425o g.00000 135.3PI.g.W-7 ps1_11_3155 visit 2 full full (1) full(1) full cleaned (1) 0 () () 63(63) 63(63) () <-- diffed twice
o5563g0426o g.00000 135.3PI.g.W-7 ps1_11_3155 visit 2 full full (1) full(1) full cleaned (1) 0 () () 63(63) () ()
o5563g0427o g.00000 135.3PI.g.W-7 ps1_11_3168 visit 2 full full (1) full(1) full cleaned (1) 0 () () 75(75) () ()
o5563g0428o g.00000 135.3PI.g.W-7 ps1_11_3051 visit 2 full full (1) full(1) full cleaned (1) 0 () () 77(77) () ()
o5563g0430o g.00000 135.3PI.g.W-6 ps1_11_5653 visit 1 full full (1) full(1) full cleaned (1) 0 () () () 76(76) ()
o5563g0431o g.00000 135.3PI.g.W-6 ps1_11_1650 visit 1 full full (1) full(1) full cleaned (1) 0 () () () 72(72) ()
o5563g0432o g.00000 135.3PI.g.W-6 ps1_11_1633 visit 1 full full (1) full(1) full cleaned (1) 0 () () () 144(144) () <-- diffed twice
o5563g0433o g.00000 135.3PI.g.W-6 ps1_11_1633 visit 1 full full (1) full(1) full cleaned (1) 0 () () 74(74) () ()
o5563g0434o g.00000 135.3PI.g.W-6 ps1_11_5652 visit 1 full full (1) full(1) full cleaned (1) 0 () () () 78(78) ()