# # ChangeLog for trunk/ippToPsps # # Generated by Trac 1.6 # Jul 19, 2026, 9:04:58 PM Fri, 10 Feb 2012 23:42:23 GMT rhenders [33236] * trunk/ippToPsps/jython/scratchdb.py (modified) got rid of dvoMeta table - now only use dvoImages table; changes to ... Fri, 10 Feb 2012 23:40:18 GMT rhenders [33235] * trunk/ippToPsps/jython/batch.py (modified) * trunk/ippToPsps/jython/detectionbatch.py (modified) * trunk/ippToPsps/jython/initbatch.py (modified) * trunk/ippToPsps/jython/stackbatch.py (modified) got rid of dvoMeta table - now only use dvoImages table; whether we ... Fri, 10 Feb 2012 23:37:43 GMT rhenders [33234] * trunk/ippToPsps/jython/dvo.py (modified) lots of changes: now, a region is first defined using setSkyArea() ... Thu, 02 Feb 2012 00:33:35 GMT rhenders [33194] * trunk/ippToPsps/jython/regionTest.py (added) test program for DVO region loading Thu, 02 Feb 2012 00:32:57 GMT rhenders [33193] * trunk/ippToPsps/jython/dvo.py (modified) improvements to auditing of regions; some convenience methods for ... Thu, 02 Feb 2012 00:31:37 GMT rhenders [33192] * trunk/ippToPsps/jython/pslogger.py (modified) now formatting log entries when going to stdout Thu, 02 Feb 2012 00:31:08 GMT rhenders [33191] * trunk/ippToPsps/jython/load.py (modified) * trunk/ippToPsps/jython/metrics.py (modified) better way of setting default RA/Dec limits if none specified in config Thu, 02 Feb 2012 00:30:27 GMT rhenders [33190] * trunk/ippToPsps/jython/configs/oldthreepiTest.xml (added) test config for old 3PI Wed, 01 Feb 2012 21:36:03 GMT rhenders [33189] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) more sensible Dec limits Wed, 01 Feb 2012 02:29:02 GMT rhenders [33187] * trunk/ippToPsps/jars/stilts.jar (modified) new version of stilts - Oct 2011 Wed, 01 Feb 2012 02:28:37 GMT rhenders [33186] * trunk/ippToPsps/jython/gpc1db.py (modified) added convenience method to define search box by center and side length Wed, 01 Feb 2012 02:27:16 GMT rhenders [33185] * trunk/ippToPsps/jython/scratchdb.py (modified) now dropping SkyTable and Images tables when resetting DVO tables; ... Wed, 01 Feb 2012 02:22:51 GMT rhenders [33184] * trunk/ippToPsps/jython/dvo.py (modified) more measures to make safer when switching DVO databases; some ... Tue, 31 Jan 2012 19:57:07 GMT rhenders [33183] * trunk/ippToPsps/jython/dvo.py (modified) more stats for what is and isn't ingested; improvments when resetting ... Tue, 31 Jan 2012 19:52:33 GMT rhenders [33182] * trunk/ippToPsps/jython/scratchdb.py (modified) after purging detections, we now OPTIMIZE the detections table Tue, 31 Jan 2012 19:51:10 GMT rhenders [33181] * trunk/ippToPsps/jython/mysql.py (modified) added method to OPTIMIZE a table; added method to get Db friendly ... Sat, 28 Jan 2012 02:33:05 GMT rhenders [33177] * trunk/ippToPsps/jython/dvo.py (modified) * trunk/ippToPsps/jython/scratchdb.py (modified) changes to keep track of, and purge, ingested-but-out-of-date regions Sat, 28 Jan 2012 01:48:57 GMT rhenders [33176] * trunk/ippToPsps/jython/dvo.py (modified) now figuring out which currently ingested regions can be deleted; if ... Sat, 28 Jan 2012 01:46:15 GMT rhenders [33175] * trunk/ippToPsps/jython/scratchdb.py (modified) added new columns to dvoDone table and dvoDetectionFull so that each ... Fri, 27 Jan 2012 22:31:28 GMT rhenders [33170] * trunk/ippToPsps/jython/dvo.py (modified) using more meaningful name of 'region' as opposed to 'file' to refer ... Fri, 27 Jan 2012 02:05:27 GMT rhenders [33164] * trunk/ippToPsps/jython/scratchdb.py (modified) method to drop all DVO detections from database, but not Images and ... Fri, 27 Jan 2012 02:04:35 GMT rhenders [33163] * trunk/ippToPsps/jython/dvo.py (modified) slight method name change Thu, 26 Jan 2012 23:58:06 GMT rhenders [33162] * trunk/ippToPsps/jython/dvo.py (modified) new method to reset only detections from scratch Db Thu, 26 Jan 2012 22:25:36 GMT rhenders [33161] * trunk/ippToPsps/jython/dvo.py (modified) now doesn't re-ingest cpm file if previous attempt was aborted after ... Thu, 26 Jan 2012 22:23:08 GMT rhenders [33160] * trunk/ippToPsps/jython/scratchdb.py (modified) method to check we are ingesting the correct DVO; method to calculate ... Thu, 26 Jan 2012 03:10:25 GMT rhenders [33155] * trunk/ippToPsps/jython/dvo.py (modified) * trunk/ippToPsps/jython/scratchdb.py (modified) now storing size and modified date of each file ingested from DVO Thu, 26 Jan 2012 01:15:34 GMT rhenders [33154] * trunk/ippToPsps/jython/dvo.py (added) first commit of new Dvo class Wed, 25 Jan 2012 23:46:34 GMT rhenders [33153] * trunk/ippToPsps/jython/configs/newsas.xml (modified) deleting local copies Wed, 25 Jan 2012 23:45:58 GMT rhenders [33152] * trunk/ippToPsps/jython/configs/newmd4.xml (modified) deleting local copies Wed, 25 Jan 2012 23:44:59 GMT rhenders [33151] * trunk/ippToPsps/jython/configs/oldthreepi2.xml (added) * trunk/ippToPsps/jython/configs/oldthreepi3.xml (added) extra OLD configs Wed, 25 Jan 2012 23:44:23 GMT rhenders [33150] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) final RA range for OLD loading Wed, 25 Jan 2012 23:43:24 GMT rhenders [33149] * trunk/ippToPsps/jython/configs/lap20110809_2.xml (added) * trunk/ippToPsps/jython/configs/lap20110809_3.xml (added) more LAP configs Wed, 25 Jan 2012 23:42:58 GMT rhenders [33148] * trunk/ippToPsps/jython/configs/lap20110809.xml (modified) stop queuing stacks Wed, 25 Jan 2012 23:42:07 GMT rhenders [33147] * trunk/ippToPsps/jython/scratchdb.py (modified) new method to get DVO region files from SkyTable given an RA/Dec box Wed, 25 Jan 2012 23:40:31 GMT rhenders [33146] * trunk/ippToPsps/jython/stackbatch.py (modified) change to the way we call method to get cmf; more fields populated, ... Wed, 25 Jan 2012 23:31:20 GMT rhenders [33145] * trunk/ippToPsps/jython/gpc1db.py (modified) removing debug... Wed, 25 Jan 2012 23:30:33 GMT rhenders [33144] * trunk/ippToPsps/jython/gpc1db.py (modified) Big changes to SQL for getting both camera and stack stage files Tue, 13 Dec 2011 20:50:46 GMT rhenders [32934] * trunk/ippToPsps/jython/dxlayer.py (modified) return code not being set on failure to call dxlayer Tue, 13 Dec 2011 20:49:13 GMT rhenders [32933] * trunk/ippToPsps/jython/mysql.py (modified) more verbose debug message Tue, 13 Dec 2011 20:47:59 GMT rhenders [32932] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) resetting merge and merge_worthy to 0 when resetting batches Tue, 13 Dec 2011 20:41:37 GMT rhenders [32931] * trunk/ippToPsps/jython/odm.py (modified) arg to Popen close files Tue, 13 Dec 2011 03:09:28 GMT rhenders [32930] * trunk/ippToPsps/perl/deleteFromDXLayer.pl (modified) name -> Name Sun, 04 Dec 2011 05:07:13 GMT rhenders [32866] * trunk/ippToPsps/jython/configs/newmd4.xml (added) Config for load of new MD4, using ready-made DVO -> MySQL database Sat, 03 Dec 2011 04:58:38 GMT rhenders [32864] * trunk/ippToPsps/jython/configs/newsas.xml (modified) Using a new DVO Db. This is the version used to load to PSPS on ... Fri, 02 Dec 2011 00:40:15 GMT rhenders [32847] * trunk/ippToPsps/jython/configs/newsas.xml (modified) Production-ready Wed, 30 Nov 2011 21:12:42 GMT rhenders [32838] * trunk/ippToPsps/jython/republishbatch.py (modified) Added some comments Wed, 30 Nov 2011 21:09:34 GMT rhenders [32837] * trunk/ippToPsps/jython/republishbatch.py (modified) Using new ippToPspsDb method to reset the batch prior to republishing Wed, 30 Nov 2011 21:08:44 GMT rhenders [32836] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) New method to 'reset' a batch, basically, pretend it was never loaded ... Wed, 30 Nov 2011 02:59:28 GMT rhenders [32835] * trunk/ippToPsps/jython/datastore.py (modified) now using 'link' rather than 'copy' argument when publishing to datastore Tue, 29 Nov 2011 21:41:42 GMT rhenders [32831] * trunk/ippToPsps/jython/czardb.py (added) adding class for czardb Tue, 29 Nov 2011 01:14:09 GMT rhenders [32829] * trunk/ippToPsps/jython/configs/newsas.xml (modified) changed DVO database to a new one Tue, 29 Nov 2011 00:16:01 GMT rhenders [32828] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) now including RA 7-9 hrs Sat, 26 Nov 2011 01:22:41 GMT rhenders [32826] * trunk/ippToPsps/jython/configs/newsas.xml (modified) production config for new SAS Sat, 26 Nov 2011 00:55:01 GMT rhenders [32825] * trunk/ippToPsps/xmlschema/BatchManifest.xsd (modified) Added all the new PSPS surveys to the XML schema for batch manifest files Sat, 26 Nov 2011 00:50:04 GMT rhenders [32824] * trunk/ippToPsps/jython/batch.py (modified) improved some log messages Sat, 26 Nov 2011 00:49:24 GMT rhenders [32823] * trunk/ippToPsps/jython/configs/newsas.xml (modified) added comment Fri, 25 Nov 2011 22:02:31 GMT rhenders [32821] * trunk/ippToPsps/jython/configs/newsas.xml (added) New config for the new SAS database Fri, 25 Nov 2011 21:17:01 GMT rhenders [32819] * trunk/ippToPsps/jython/batch.py (modified) improved logic so that batches are only marked as 'successfully' ... Thu, 24 Nov 2011 02:16:33 GMT rhenders [32802] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) add extra constraints when gathering batches that have not loaded to ... Thu, 24 Nov 2011 02:15:13 GMT rhenders [32801] * trunk/ippToPsps/jython/odm.py (modified) savinf ODM message for display; setting default message for 'details' ... Thu, 24 Nov 2011 02:13:09 GMT rhenders [32800] * trunk/ippToPsps/jython/datastoreDupeChecker.sh (added) quick and dirty shell script to check for dupes on the datastore Wed, 23 Nov 2011 22:00:23 GMT rhenders [32781] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) increased 'processing now' limit from 2 to 4 hours, as when network ... Wed, 23 Nov 2011 21:56:52 GMT rhenders [32780] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) removed 'loaded_to_datastore != 0' constraint when checking if a ... Wed, 23 Nov 2011 19:56:05 GMT rhenders [32778] * trunk/ippToPsps/jython/gpc1db.py (modified) removed redundant method used to testing Wed, 23 Nov 2011 18:49:00 GMT rhenders [32777] * trunk/ippToPsps/jython/metrics.py (modified) added a timer so program will run in a loop Tue, 22 Nov 2011 02:14:45 GMT rhenders [32737] * trunk/ippToPsps/jython/configs/lap20110809.xml (modified) added czar Db info to config Tue, 22 Nov 2011 01:54:18 GMT rhenders [32736] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) added czar db section to config Mon, 21 Nov 2011 22:12:30 GMT rhenders [32730] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) Using master DVO database on ipp005; now processing up to 18 hrs RA Fri, 11 Nov 2011 02:00:22 GMT rhenders [32655] * trunk/ippToPsps/jython/pollOdm.py (modified) Neatened this up so that the 'all' option will sequentially check ... Fri, 11 Nov 2011 01:59:12 GMT rhenders [32654] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) Removed redundant getAllUnfinishedBatchIDs() method. Not needed by ... Sat, 29 Oct 2011 08:24:40 GMT rhenders [32596] * trunk/ippToPsps/jython/batch.py (modified) some re-arranging so that, if the FITS file is not found in Nebulous, ... Fri, 28 Oct 2011 21:44:46 GMT rhenders [32592] * trunk/ippToPsps/jython/detectionbatch.py (modified) Added high-level comment Fri, 28 Oct 2011 21:43:38 GMT rhenders [32591] * trunk/ippToPsps/jython/setupScratchDb.py (modified) Calling createPsfLikelihoodFunction() explicitly Fri, 28 Oct 2011 21:41:25 GMT rhenders [32590] * trunk/ippToPsps/jython/scratchdb.py (modified) Fixed method to install psfLikelihood() stored procedure Fri, 28 Oct 2011 21:40:06 GMT rhenders [32589] * trunk/ippToPsps/jython/batch.py (modified) now exiting cleanly if no FITS file is found for non-IN batches; ... Fri, 28 Oct 2011 21:39:14 GMT rhenders [32588] * trunk/ippToPsps/jython/stackbatch.py (modified) Added high-level comment Fri, 28 Oct 2011 21:38:48 GMT rhenders [32587] * trunk/ippToPsps/jython/metrics.py (modified) Now makes an estimate of remaining time required to complete ... Fri, 28 Oct 2011 21:38:12 GMT rhenders [32586] * trunk/ippToPsps/jython/setupScratchDb.py (added) New program to setup a new scratch database on the local machine Fri, 28 Oct 2011 01:06:50 GMT rhenders [32582] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) Just processing RA 9-10 hrs Thu, 27 Oct 2011 23:41:47 GMT rhenders [32581] * trunk/ippToPsps/jython/configs/init.xml (added) config for setting up new scratch Dbs with init tables Thu, 27 Oct 2011 23:41:11 GMT rhenders [32580] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) changed maximum fails count from 3 to 4 Thu, 27 Oct 2011 23:40:40 GMT rhenders [32579] * trunk/ippToPsps/jython/load.py (modified) Now reading ra/dec coords from config when queueing-up Thu, 27 Oct 2011 23:40:11 GMT rhenders [32578] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) Ready for loading.... Thu, 13 Oct 2011 19:58:45 GMT rhenders [32543] * trunk/ippToPsps/jython/cleanup.py (modified) added time argument so it will cleanup every n hours Thu, 13 Oct 2011 19:57:27 GMT rhenders [32542] * trunk/ippToPsps/jython/pollOdm.py (modified) main polling stuff now in a function; added time argument so it will ... Thu, 13 Oct 2011 19:50:28 GMT rhenders [32541] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) no need for 'DISTINCT batch_id as that column is an index, so they ... Thu, 13 Oct 2011 19:48:23 GMT rhenders [32540] * trunk/ippToPsps/jython/odm.py (modified) now assuming that 'OnHold' batches have failed Fri, 07 Oct 2011 20:49:49 GMT rhenders [32519] * trunk/ippToPsps/jython/cleanup.py (modified) now cleaning up DXLayer as well Fri, 07 Oct 2011 20:49:23 GMT rhenders [32518] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) changes order of stages now that we are deleting DXLayer batches Fri, 07 Oct 2011 20:48:53 GMT rhenders [32517] * trunk/ippToPsps/jython/dxlayer.py (added) first commit of dxlayer class, so far only providing methods to ... Fri, 07 Oct 2011 20:47:42 GMT rhenders [32516] * trunk/ippToPsps/jython/stackbatch.py (modified) put back old code to deal with skycell/projectioncell as changes ... Fri, 07 Oct 2011 20:02:58 GMT rhenders [32515] * trunk/ippToPsps/config/IN/tables.vot (modified) removing duplicated 'z' filter Fri, 07 Oct 2011 01:26:19 GMT rhenders [32512] * trunk/ippToPsps/jython/stackbatch.py (modified) adding projectionCellID to to the SkinnyObject table Fri, 07 Oct 2011 01:18:12 GMT rhenders [32508] * trunk/ippToPsps/jython/stackbatch.py (modified) now calculating psfLikelihood in StackDetection table Fri, 07 Oct 2011 00:06:50 GMT rhenders [32501] * trunk/ippToPsps/jython/stackbatch.py (modified) fixed error with skycell and added projectioncellID. Thu, 06 Oct 2011 23:41:11 GMT rhenders [32500] * trunk/ippToPsps/jython/stackbatch.py (modified) added psfFwhm_mean and psfFwhm_max Thu, 06 Oct 2011 22:50:22 GMT rhenders [32499] * trunk/ippToPsps/jython/configs/oldthreepi.xml (added) config for loading old 3pi data Thu, 06 Oct 2011 03:05:14 GMT rhenders [32497] * trunk/ippToPsps/jython/republishbatch.py (added) first commit of program that republishes a batch that has already ... Thu, 06 Oct 2011 03:04:07 GMT rhenders [32496] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) new method that returns the batch type for the provided batch ID; ... Thu, 06 Oct 2011 03:01:52 GMT rhenders [32495] * trunk/ippToPsps/jython/metrics.py (modified) now reading eq-coords from config, if there are any