# # ChangeLog for trunk/ippToPsps # # Generated by Trac 1.6 # Jul 20, 2026, 1:02:28 PM Fri, 17 Feb 2012 01:38:20 GMT rhenders [33296] * trunk/ippToPsps/jython/load.py (modified) fixing minor typo in variable name Fri, 17 Feb 2012 01:35:36 GMT rhenders [33295] * trunk/ippToPsps/jython/pslogger.py (modified) pid and host are now class variables Fri, 17 Feb 2012 01:35:10 GMT rhenders [33294] * trunk/ippToPsps/jython/load.py (modified) now updates clients table in ipptopsps Db with current timestamp ... Fri, 17 Feb 2012 01:33:46 GMT rhenders [33293] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) lots of new methods to deal with clients table, inserting a new ... Fri, 17 Feb 2012 01:32:37 GMT rhenders [33292] * trunk/ippToPsps/jython/dvo.py (modified) slight re-wording when prompting user if he/she wishes to ingest a ... Fri, 17 Feb 2012 01:31:00 GMT rhenders [33291] * trunk/ippToPsps/jython/scratchdb.py (modified) if no DVO is ingested, then isCorrectDvo() should return false Fri, 17 Feb 2012 01:29:54 GMT rhenders [33290] * trunk/ippToPsps/jython/batch.py (modified) added try/catch around STILTS fits reader as this sometimes fails Fri, 17 Feb 2012 01:29:21 GMT rhenders [33289] * trunk/ippToPsps/jython/metrics.py (modified) now ignore config-set bounding box - just provide stats for whole ... Wed, 15 Feb 2012 23:14:29 GMT rhenders [33273] * trunk/ippToPsps/src/Dvo.c (modified) changes to purge dvoMeta table and use dvoImages instead; not using ... Wed, 15 Feb 2012 23:05:44 GMT rhenders [33272] * trunk/ippToPsps/jython/dvo.py (modified) when attempting to add PSPS_OBJ_ID column, catch exception and ... Wed, 15 Feb 2012 22:53:37 GMT rhenders [33271] * trunk/ippToPsps/jython/load.py (modified) removing debugging sys.exit() call; using more generic way of setting ... Wed, 15 Feb 2012 02:33:57 GMT rhenders [33269] * trunk/ippToPsps/jython/removeFromDatastore.py (modified) now using new Config class Wed, 15 Feb 2012 02:33:20 GMT rhenders [33268] * trunk/ippToPsps/jython/odm.py (modified) fixed bug where batch checker returned False for 'OnHold' batches; ... Wed, 15 Feb 2012 02:32:49 GMT rhenders [33267] * trunk/ippToPsps/jython/pollOdm.py (modified) removed need for LOADFAILED field - now LOADEDTOODM is set to -1 Wed, 15 Feb 2012 02:31:36 GMT rhenders [33266] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) getter methids for 'purged' batches; removed need for LOADFAILED ... Wed, 15 Feb 2012 02:30:51 GMT rhenders [33265] * trunk/ippToPsps/jython/cleanup.py (modified) now deleting 'purged' batches Tue, 14 Feb 2012 23:30:44 GMT rhenders [33264] * trunk/ippToPsps/jython/metrics.py (modified) safer log naming Tue, 14 Feb 2012 23:29:52 GMT rhenders [33263] * trunk/ippToPsps/jython/cleanup.py (modified) refreshing config after waiting defined number of minutes Tue, 14 Feb 2012 22:30:12 GMT rhenders [33262] * trunk/ippToPsps/jython/cleanup.py (modified) Changes to support a new Config class that encapuslates the xml ... Tue, 14 Feb 2012 22:29:55 GMT rhenders [33261] * trunk/ippToPsps/jython/config.py (modified) now getting and printing deletion policy Tue, 14 Feb 2012 22:19:01 GMT rhenders [33260] * trunk/ippToPsps/jython/pollOdm.py (modified) Changes to support a new Config class that encapuslates the xml ... Tue, 14 Feb 2012 22:02:48 GMT rhenders [33259] * trunk/ippToPsps/jython/batch.py (modified) * trunk/ippToPsps/jython/config.py (added) * trunk/ippToPsps/jython/czardb.py (modified) * trunk/ippToPsps/jython/datastore.py (modified) * trunk/ippToPsps/jython/detectionbatch.py (modified) * trunk/ippToPsps/jython/dvo.py (modified) * trunk/ippToPsps/jython/fits.py (modified) * trunk/ippToPsps/jython/gpc1db.py (modified) * trunk/ippToPsps/jython/initbatch.py (modified) * trunk/ippToPsps/jython/ipptopspsdb.py (modified) * trunk/ippToPsps/jython/load.py (modified) * trunk/ippToPsps/jython/metrics.py (modified) * trunk/ippToPsps/jython/mysql.py (modified) * trunk/ippToPsps/jython/pslogger.py (modified) * trunk/ippToPsps/jython/scratchdb.py (modified) * trunk/ippToPsps/jython/stackbatch.py (modified) Big changes to support a new Config class that encapuslates the xml ... Fri, 10 Feb 2012 23:43:48 GMT rhenders [33237] * trunk/ippToPsps/jython/load.py (modified) big changes to incorporate loading by region of sky Fri, 10 Feb 2012 23:42:23 GMT rhenders [33236] * trunk/ippToPsps/jython/scratchdb.py (modified) got rid of dvoMeta table - now only use dvoImages table; changes to ... Fri, 10 Feb 2012 23:40:18 GMT rhenders [33235] * trunk/ippToPsps/jython/batch.py (modified) * trunk/ippToPsps/jython/detectionbatch.py (modified) * trunk/ippToPsps/jython/initbatch.py (modified) * trunk/ippToPsps/jython/stackbatch.py (modified) got rid of dvoMeta table - now only use dvoImages table; whether we ... Fri, 10 Feb 2012 23:37:43 GMT rhenders [33234] * trunk/ippToPsps/jython/dvo.py (modified) lots of changes: now, a region is first defined using setSkyArea() ... Thu, 02 Feb 2012 00:33:35 GMT rhenders [33194] * trunk/ippToPsps/jython/regionTest.py (added) test program for DVO region loading Thu, 02 Feb 2012 00:32:57 GMT rhenders [33193] * trunk/ippToPsps/jython/dvo.py (modified) improvements to auditing of regions; some convenience methods for ... Thu, 02 Feb 2012 00:31:37 GMT rhenders [33192] * trunk/ippToPsps/jython/pslogger.py (modified) now formatting log entries when going to stdout Thu, 02 Feb 2012 00:31:08 GMT rhenders [33191] * trunk/ippToPsps/jython/load.py (modified) * trunk/ippToPsps/jython/metrics.py (modified) better way of setting default RA/Dec limits if none specified in config Thu, 02 Feb 2012 00:30:27 GMT rhenders [33190] * trunk/ippToPsps/jython/configs/oldthreepiTest.xml (added) test config for old 3PI Wed, 01 Feb 2012 21:36:03 GMT rhenders [33189] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) more sensible Dec limits Wed, 01 Feb 2012 02:29:02 GMT rhenders [33187] * trunk/ippToPsps/jars/stilts.jar (modified) new version of stilts - Oct 2011 Wed, 01 Feb 2012 02:28:37 GMT rhenders [33186] * trunk/ippToPsps/jython/gpc1db.py (modified) added convenience method to define search box by center and side length Wed, 01 Feb 2012 02:27:16 GMT rhenders [33185] * trunk/ippToPsps/jython/scratchdb.py (modified) now dropping SkyTable and Images tables when resetting DVO tables; ... Wed, 01 Feb 2012 02:22:51 GMT rhenders [33184] * trunk/ippToPsps/jython/dvo.py (modified) more measures to make safer when switching DVO databases; some ... Tue, 31 Jan 2012 19:57:07 GMT rhenders [33183] * trunk/ippToPsps/jython/dvo.py (modified) more stats for what is and isn't ingested; improvments when resetting ... Tue, 31 Jan 2012 19:52:33 GMT rhenders [33182] * trunk/ippToPsps/jython/scratchdb.py (modified) after purging detections, we now OPTIMIZE the detections table Tue, 31 Jan 2012 19:51:10 GMT rhenders [33181] * trunk/ippToPsps/jython/mysql.py (modified) added method to OPTIMIZE a table; added method to get Db friendly ... Sat, 28 Jan 2012 02:33:05 GMT rhenders [33177] * trunk/ippToPsps/jython/dvo.py (modified) * trunk/ippToPsps/jython/scratchdb.py (modified) changes to keep track of, and purge, ingested-but-out-of-date regions Sat, 28 Jan 2012 01:48:57 GMT rhenders [33176] * trunk/ippToPsps/jython/dvo.py (modified) now figuring out which currently ingested regions can be deleted; if ... Sat, 28 Jan 2012 01:46:15 GMT rhenders [33175] * trunk/ippToPsps/jython/scratchdb.py (modified) added new columns to dvoDone table and dvoDetectionFull so that each ... Fri, 27 Jan 2012 22:31:28 GMT rhenders [33170] * trunk/ippToPsps/jython/dvo.py (modified) using more meaningful name of 'region' as opposed to 'file' to refer ... Fri, 27 Jan 2012 02:05:27 GMT rhenders [33164] * trunk/ippToPsps/jython/scratchdb.py (modified) method to drop all DVO detections from database, but not Images and ... Fri, 27 Jan 2012 02:04:35 GMT rhenders [33163] * trunk/ippToPsps/jython/dvo.py (modified) slight method name change Thu, 26 Jan 2012 23:58:06 GMT rhenders [33162] * trunk/ippToPsps/jython/dvo.py (modified) new method to reset only detections from scratch Db Thu, 26 Jan 2012 22:25:36 GMT rhenders [33161] * trunk/ippToPsps/jython/dvo.py (modified) now doesn't re-ingest cpm file if previous attempt was aborted after ... Thu, 26 Jan 2012 22:23:08 GMT rhenders [33160] * trunk/ippToPsps/jython/scratchdb.py (modified) method to check we are ingesting the correct DVO; method to calculate ... Thu, 26 Jan 2012 03:10:25 GMT rhenders [33155] * trunk/ippToPsps/jython/dvo.py (modified) * trunk/ippToPsps/jython/scratchdb.py (modified) now storing size and modified date of each file ingested from DVO Thu, 26 Jan 2012 01:15:34 GMT rhenders [33154] * trunk/ippToPsps/jython/dvo.py (added) first commit of new Dvo class Wed, 25 Jan 2012 23:46:34 GMT rhenders [33153] * trunk/ippToPsps/jython/configs/newsas.xml (modified) deleting local copies Wed, 25 Jan 2012 23:45:58 GMT rhenders [33152] * trunk/ippToPsps/jython/configs/newmd4.xml (modified) deleting local copies Wed, 25 Jan 2012 23:44:59 GMT rhenders [33151] * trunk/ippToPsps/jython/configs/oldthreepi2.xml (added) * trunk/ippToPsps/jython/configs/oldthreepi3.xml (added) extra OLD configs Wed, 25 Jan 2012 23:44:23 GMT rhenders [33150] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) final RA range for OLD loading Wed, 25 Jan 2012 23:43:24 GMT rhenders [33149] * trunk/ippToPsps/jython/configs/lap20110809_2.xml (added) * trunk/ippToPsps/jython/configs/lap20110809_3.xml (added) more LAP configs Wed, 25 Jan 2012 23:42:58 GMT rhenders [33148] * trunk/ippToPsps/jython/configs/lap20110809.xml (modified) stop queuing stacks Wed, 25 Jan 2012 23:42:07 GMT rhenders [33147] * trunk/ippToPsps/jython/scratchdb.py (modified) new method to get DVO region files from SkyTable given an RA/Dec box Wed, 25 Jan 2012 23:40:31 GMT rhenders [33146] * trunk/ippToPsps/jython/stackbatch.py (modified) change to the way we call method to get cmf; more fields populated, ... Wed, 25 Jan 2012 23:31:20 GMT rhenders [33145] * trunk/ippToPsps/jython/gpc1db.py (modified) removing debug... Wed, 25 Jan 2012 23:30:33 GMT rhenders [33144] * trunk/ippToPsps/jython/gpc1db.py (modified) Big changes to SQL for getting both camera and stack stage files Tue, 13 Dec 2011 20:50:46 GMT rhenders [32934] * trunk/ippToPsps/jython/dxlayer.py (modified) return code not being set on failure to call dxlayer Tue, 13 Dec 2011 20:49:13 GMT rhenders [32933] * trunk/ippToPsps/jython/mysql.py (modified) more verbose debug message Tue, 13 Dec 2011 20:47:59 GMT rhenders [32932] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) resetting merge and merge_worthy to 0 when resetting batches Tue, 13 Dec 2011 20:41:37 GMT rhenders [32931] * trunk/ippToPsps/jython/odm.py (modified) arg to Popen close files Tue, 13 Dec 2011 03:09:28 GMT rhenders [32930] * trunk/ippToPsps/perl/deleteFromDXLayer.pl (modified) name -> Name Sun, 04 Dec 2011 05:07:13 GMT rhenders [32866] * trunk/ippToPsps/jython/configs/newmd4.xml (added) Config for load of new MD4, using ready-made DVO -> MySQL database Sat, 03 Dec 2011 04:58:38 GMT rhenders [32864] * trunk/ippToPsps/jython/configs/newsas.xml (modified) Using a new DVO Db. This is the version used to load to PSPS on ... Fri, 02 Dec 2011 00:40:15 GMT rhenders [32847] * trunk/ippToPsps/jython/configs/newsas.xml (modified) Production-ready Wed, 30 Nov 2011 21:12:42 GMT rhenders [32838] * trunk/ippToPsps/jython/republishbatch.py (modified) Added some comments Wed, 30 Nov 2011 21:09:34 GMT rhenders [32837] * trunk/ippToPsps/jython/republishbatch.py (modified) Using new ippToPspsDb method to reset the batch prior to republishing Wed, 30 Nov 2011 21:08:44 GMT rhenders [32836] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) New method to 'reset' a batch, basically, pretend it was never loaded ... Wed, 30 Nov 2011 02:59:28 GMT rhenders [32835] * trunk/ippToPsps/jython/datastore.py (modified) now using 'link' rather than 'copy' argument when publishing to datastore Tue, 29 Nov 2011 21:41:42 GMT rhenders [32831] * trunk/ippToPsps/jython/czardb.py (added) adding class for czardb Tue, 29 Nov 2011 01:14:09 GMT rhenders [32829] * trunk/ippToPsps/jython/configs/newsas.xml (modified) changed DVO database to a new one Tue, 29 Nov 2011 00:16:01 GMT rhenders [32828] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) now including RA 7-9 hrs Sat, 26 Nov 2011 01:22:41 GMT rhenders [32826] * trunk/ippToPsps/jython/configs/newsas.xml (modified) production config for new SAS Sat, 26 Nov 2011 00:55:01 GMT rhenders [32825] * trunk/ippToPsps/xmlschema/BatchManifest.xsd (modified) Added all the new PSPS surveys to the XML schema for batch manifest files Sat, 26 Nov 2011 00:50:04 GMT rhenders [32824] * trunk/ippToPsps/jython/batch.py (modified) improved some log messages Sat, 26 Nov 2011 00:49:24 GMT rhenders [32823] * trunk/ippToPsps/jython/configs/newsas.xml (modified) added comment Fri, 25 Nov 2011 22:02:31 GMT rhenders [32821] * trunk/ippToPsps/jython/configs/newsas.xml (added) New config for the new SAS database Fri, 25 Nov 2011 21:17:01 GMT rhenders [32819] * trunk/ippToPsps/jython/batch.py (modified) improved logic so that batches are only marked as 'successfully' ... Thu, 24 Nov 2011 02:16:33 GMT rhenders [32802] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) add extra constraints when gathering batches that have not loaded to ... Thu, 24 Nov 2011 02:15:13 GMT rhenders [32801] * trunk/ippToPsps/jython/odm.py (modified) savinf ODM message for display; setting default message for 'details' ... Thu, 24 Nov 2011 02:13:09 GMT rhenders [32800] * trunk/ippToPsps/jython/datastoreDupeChecker.sh (added) quick and dirty shell script to check for dupes on the datastore Wed, 23 Nov 2011 22:00:23 GMT rhenders [32781] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) increased 'processing now' limit from 2 to 4 hours, as when network ... Wed, 23 Nov 2011 21:56:52 GMT rhenders [32780] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) removed 'loaded_to_datastore != 0' constraint when checking if a ... Wed, 23 Nov 2011 19:56:05 GMT rhenders [32778] * trunk/ippToPsps/jython/gpc1db.py (modified) removed redundant method used to testing Wed, 23 Nov 2011 18:49:00 GMT rhenders [32777] * trunk/ippToPsps/jython/metrics.py (modified) added a timer so program will run in a loop Tue, 22 Nov 2011 02:14:45 GMT rhenders [32737] * trunk/ippToPsps/jython/configs/lap20110809.xml (modified) added czar Db info to config Tue, 22 Nov 2011 01:54:18 GMT rhenders [32736] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) added czar db section to config Mon, 21 Nov 2011 22:12:30 GMT rhenders [32730] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) Using master DVO database on ipp005; now processing up to 18 hrs RA Fri, 11 Nov 2011 02:00:22 GMT rhenders [32655] * trunk/ippToPsps/jython/pollOdm.py (modified) Neatened this up so that the 'all' option will sequentially check ... Fri, 11 Nov 2011 01:59:12 GMT rhenders [32654] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) Removed redundant getAllUnfinishedBatchIDs() method. Not needed by ... Sat, 29 Oct 2011 08:24:40 GMT rhenders [32596] * trunk/ippToPsps/jython/batch.py (modified) some re-arranging so that, if the FITS file is not found in Nebulous, ... Fri, 28 Oct 2011 21:44:46 GMT rhenders [32592] * trunk/ippToPsps/jython/detectionbatch.py (modified) Added high-level comment Fri, 28 Oct 2011 21:43:38 GMT rhenders [32591] * trunk/ippToPsps/jython/setupScratchDb.py (modified) Calling createPsfLikelihoodFunction() explicitly Fri, 28 Oct 2011 21:41:25 GMT rhenders [32590] * trunk/ippToPsps/jython/scratchdb.py (modified) Fixed method to install psfLikelihood() stored procedure Fri, 28 Oct 2011 21:40:06 GMT rhenders [32589] * trunk/ippToPsps/jython/batch.py (modified) now exiting cleanly if no FITS file is found for non-IN batches; ... Fri, 28 Oct 2011 21:39:14 GMT rhenders [32588] * trunk/ippToPsps/jython/stackbatch.py (modified) Added high-level comment Fri, 28 Oct 2011 21:38:48 GMT rhenders [32587] * trunk/ippToPsps/jython/metrics.py (modified) Now makes an estimate of remaining time required to complete ...