# # ChangeLog for trunk/ippToPsps # # Generated by Trac 1.6 # Jul 20, 2026, 11:07:21 AM Tue, 06 Sep 2011 23:37:06 GMT rhenders [32354] * trunk/ippToPsps/jython/metrics.py (modified) now reporting batches-per-hour and last P2 and St batch published; ... Tue, 06 Sep 2011 23:35:45 GMT rhenders [32353] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) removed some redundant metrics queries; new method to get batches- ... Tue, 06 Sep 2011 19:46:27 GMT rhenders [32332] * trunk/ippToPsps/jython/batch.py (modified) removing 'size' and 'md5' fields from BatchManifest file. Time ... Tue, 06 Sep 2011 19:35:17 GMT rhenders [32331] * trunk/ippToPsps/jython/datastore.py (modified) Just whitespace Mon, 05 Sep 2011 19:51:54 GMT rhenders [32327] * trunk/ippToPsps/jython/detectionbatch.py (modified) shifted ImageMeta and FrameMeta population into different method so ... Mon, 05 Sep 2011 19:51:02 GMT rhenders [32326] * trunk/ippToPsps/jython/batch.py (modified) checking for error, and aborting if necessary, after call to ... Mon, 05 Sep 2011 02:34:24 GMT rhenders [32306] * trunk/ippToPsps/jython/configs/lap20110809.xml (modified) publishing all LAP to PSP_JHU datastore Mon, 05 Sep 2011 02:33:36 GMT rhenders [32305] * trunk/ippToPsps/jython/detectionbatch.py (modified) now specifying columns to import from IPP smf file Mon, 05 Sep 2011 02:32:45 GMT rhenders [32304] * trunk/ippToPsps/jython/batch.py (modified) now takes extra argument of columns to method that imports IPP tables Sun, 04 Sep 2011 08:59:33 GMT rhenders [32303] * trunk/ippToPsps/jython/scratchdb.py (modified) Added to comments Fri, 02 Sep 2011 21:43:24 GMT rhenders [32295] * trunk/ippToPsps/jython/scratchdb.py (modified) added stored procedure for calculating psfLikelihoods; not being ... Fri, 02 Sep 2011 21:42:19 GMT rhenders [32294] * trunk/ippToPsps/jython/metrics.py (modified) fixed typo in call to ippToPspsDb.getMergeWorthyIDs() method Fri, 02 Sep 2011 21:41:41 GMT rhenders [32293] * trunk/ippToPsps/jython/mysql.py (modified) trivial improvements to log messages and SQL Fri, 02 Sep 2011 21:40:48 GMT rhenders [32292] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) tightened loaded_to_datastore constraint in alreadyProcessed() ... Fri, 02 Sep 2011 10:05:34 GMT rhenders [32286] * trunk/ippToPsps/jython/detectionbatch.py (modified) now using a stored procedure to calculate likelihoods. much, much ... Fri, 02 Sep 2011 09:15:10 GMT rhenders [32285] * trunk/ippToPsps/jython/detectionbatch.py (modified) deleting detections with flux < 0.0000001. a temporary hack Thu, 01 Sep 2011 02:09:19 GMT rhenders [32262] * trunk/ippToPsps/jython/batch.py (modified) writing -1 to processed column in db when a batch fails Thu, 01 Sep 2011 02:08:34 GMT rhenders [32261] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added method to return all batch IDs not yet loaded to ODM Thu, 01 Sep 2011 02:07:45 GMT rhenders [32260] * trunk/ippToPsps/jython/odm.py (modified) now grabbing 'Details' part of SOAP response when a load has failed Thu, 01 Sep 2011 02:07:12 GMT rhenders [32259] * trunk/ippToPsps/jython/metrics.py (modified) removed some redundant imports; now writing to file only thos batches ... Thu, 01 Sep 2011 02:06:27 GMT rhenders [32258] * trunk/ippToPsps/jython/configs/lap20110621.xml (modified) added deletion policy Thu, 01 Sep 2011 02:06:06 GMT rhenders [32257] * trunk/ippToPsps/jython/configs/sas12.xml (modified) * trunk/ippToPsps/jython/configs/sas123.xml (modified) * trunk/ippToPsps/jython/configs/sasFootprint.xml (modified) added deletion policy Thu, 01 Sep 2011 02:05:33 GMT rhenders [32256] * trunk/ippToPsps/jython/configs/lap20110809.xml (modified) added deletion policy Thu, 01 Sep 2011 02:05:06 GMT rhenders [32255] * trunk/ippToPsps/jython/cleanup.py (modified) now deletes from datastore and local disk if set in the config Thu, 01 Sep 2011 02:04:18 GMT rhenders [32254] * trunk/ippToPsps/jython/pollOdm.py (modified) added option to poll only for those batches not yet loaded to the ODM Wed, 31 Aug 2011 23:20:14 GMT rhenders [32250] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) various changes to stage ID getters; new method to get batch IDs; now ... Wed, 31 Aug 2011 23:18:05 GMT rhenders [32249] * trunk/ippToPsps/jython/reportloadfailures.py (added) new program to get report from ODM regarding failed loads Tue, 30 Aug 2011 21:14:27 GMT rhenders [32227] * trunk/ippToPsps/jython/load.py (modified) better logging for failed-datastore-queuing Tue, 30 Aug 2011 18:39:43 GMT rhenders [32223] * trunk/ippToPsps/jython/ipptopsps.py (deleted) * trunk/ippToPsps/jython/load.py (added) Using a more meaningful name for the main loading program Tue, 30 Aug 2011 07:35:17 GMT rhenders [32222] * trunk/ippToPsps/jython/ipptopsps.py (modified) now checking for consistent failure before running a batch; extra ... Tue, 30 Aug 2011 07:33:33 GMT rhenders [32221] * trunk/ippToPsps/jython/batch.py (modified) better logging when deleting a batch from disk Tue, 30 Aug 2011 07:32:12 GMT rhenders [32220] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added methid to check for consistent failures for a particular ... Mon, 29 Aug 2011 19:30:53 GMT rhenders [32211] * trunk/ippToPsps/jython/batch.py (modified) checking FITS file is ok before proceeding; added some log messages ... Mon, 29 Aug 2011 19:29:39 GMT rhenders [32210] * trunk/ippToPsps/jython/detectionbatch.py (modified) aborting PSPS table population if no DVO IDs were found Mon, 29 Aug 2011 19:29:02 GMT rhenders [32209] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) setter methods for new 'deleted' columns; getters for batches not ... Mon, 29 Aug 2011 19:27:54 GMT rhenders [32208] * trunk/ippToPsps/jython/metrics.py (modified) now saving missing stage_ids to a text file Mon, 29 Aug 2011 19:27:29 GMT rhenders [32207] * trunk/ippToPsps/jython/fits.py (modified) initializing header to 'None' Mon, 29 Aug 2011 19:26:53 GMT rhenders [32206] * trunk/ippToPsps/jython/ipptopsps.py (modified) new method to publish batches that previously failed to load to the ... Thu, 25 Aug 2011 23:09:32 GMT rhenders [32194] * trunk/ippToPsps/jython/batch.py (modified) added static method to publish a batch to the datastore, this is so ... Thu, 25 Aug 2011 23:08:36 GMT rhenders [32193] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) now using -1 to mean this stage has failed; changes queries to ... Thu, 25 Aug 2011 23:05:26 GMT rhenders [32192] * trunk/ippToPsps/jython/stackbatch.py (modified) primary key on StackDetection is now on objID only; duplicates will ... Wed, 24 Aug 2011 00:44:30 GMT rhenders [32183] * trunk/ippToPsps/jython/ipptopsps.py (modified) fixed error in calls to logging methods Wed, 24 Aug 2011 00:44:03 GMT rhenders [32182] * trunk/ippToPsps/jython/detectionbatch.py (modified) checking astrometric solution per chip, and discarding if necessary Wed, 24 Aug 2011 00:43:13 GMT rhenders [32181] * trunk/ippToPsps/jython/datastore.py (modified) changed log level from debug to info for removal methods Wed, 24 Aug 2011 00:42:46 GMT rhenders [32180] * trunk/ippToPsps/jython/gpc1db.py (modified) some logging improvements Wed, 24 Aug 2011 00:42:05 GMT rhenders [32179] * trunk/ippToPsps/jython/scratchdb.py (modified) new method to check whether we have a decent astrometric solution for ... Mon, 22 Aug 2011 22:07:19 GMT rhenders [32166] * trunk/ippToPsps/jython/detectionbatch.py (modified) * trunk/ippToPsps/jython/ipptopspsdb.py (modified) * trunk/ippToPsps/jython/stackbatch.py (modified) added safety checks when getting smf/cmf files and cam or stack meta data Mon, 22 Aug 2011 20:46:48 GMT rhenders [32165] * trunk/ippToPsps/jython/plots (modified) updaing ignore list to ignore png files Mon, 22 Aug 2011 20:38:37 GMT rhenders [32164] * trunk/ippToPsps/jython/configs/lap20110621.xml (modified) putting back to original state used for loading Mon, 22 Aug 2011 20:37:45 GMT rhenders [32163] * trunk/ippToPsps/jython/batch.py (modified) removed redundant alreadyProcessed() method; removed redundant log ... Mon, 22 Aug 2011 18:19:51 GMT rhenders [32162] * trunk/ippToPsps/jython/ipptopsps.py (modified) * trunk/ippToPsps/jython/ipptopspsdb.py (modified) alreadyProcessed() method now taking batch type as a parameter, as of ... Sat, 20 Aug 2011 00:23:18 GMT rhenders [32145] * trunk/ippToPsps/perl/exposureSummary.pl (deleted) * trunk/ippToPsps/perl/ippToPsps_run.pl (deleted) * trunk/ippToPsps/perl/removeFromDatastore.pl (deleted) purging some old perl scripts Sat, 20 Aug 2011 00:22:20 GMT rhenders [32144] * trunk/ippToPsps/perl/deleteFromDXLayer.pl (added) First commit of new script to delete a batch from the DXLayer Sat, 20 Aug 2011 00:21:54 GMT rhenders [32143] * trunk/ippToPsps/perl/checkOdmStatus.pl (modified) purged redundant code Sat, 20 Aug 2011 00:17:33 GMT rhenders [32142] * trunk/ippToPsps/config/IN/tables.vot (modified) changes to avoid -999 ending up in binary Region table column Fri, 19 Aug 2011 21:48:34 GMT rhenders [32141] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) changed updateMinMaxObjID() method to updateDetectionStats(); now ... Fri, 19 Aug 2011 21:47:13 GMT rhenders [32140] * trunk/ippToPsps/jython/detectionbatch.py (modified) now reporting to log original total of detections in smf file; also ... Fri, 19 Aug 2011 21:45:38 GMT rhenders [32139] * trunk/ippToPsps/jython/datastore.py (modified) remove() method is now returning true if the batch is not found on ... Fri, 19 Aug 2011 21:44:37 GMT rhenders [32138] * trunk/ippToPsps/jython/batch.py (modified) added static methods for getting various paths and name; added method ... Fri, 19 Aug 2011 21:43:27 GMT rhenders [32137] * trunk/ippToPsps/jython/cleanup.py (modified) now using Datastore and Batch objects to remove of the datastore and ... Fri, 19 Aug 2011 21:42:11 GMT rhenders [32136] * trunk/ippToPsps/jython/configs/lap20110809.xml (modified) loading version of new LAP config Fri, 19 Aug 2011 21:41:33 GMT rhenders [32135] * trunk/ippToPsps/jython/scratchdb.py (modified) New method to get filterId from filter name Wed, 17 Aug 2011 22:41:46 GMT rhenders [32124] * trunk/ippToPsps/jython/configs/test.xml (added) first commit of config for testing purposes Wed, 17 Aug 2011 22:41:03 GMT rhenders [32123] * trunk/ippToPsps/jython/cleanup.py (added) First commit of clean-up program Wed, 17 Aug 2011 22:40:45 GMT rhenders [32122] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added generic method to UPDATE certain columns; refactored other ... Wed, 17 Aug 2011 22:39:43 GMT rhenders [32121] * trunk/ippToPsps/jython/pollOdm.py (modified) using new Batch-class static method to get batch name Wed, 17 Aug 2011 22:39:08 GMT rhenders [32120] * trunk/ippToPsps/jython/datastore.py (modified) * trunk/ippToPsps/jython/odm.py (modified) using new Batch-class static methods to get batch name; putting ... Wed, 17 Aug 2011 22:38:18 GMT rhenders [32119] * trunk/ippToPsps/jython/ipptopsps.py (modified) changed logging settings when in test mode, specifically, print to ... Wed, 17 Aug 2011 22:37:27 GMT rhenders [32118] * trunk/ippToPsps/jython/batch.py (modified) added some static methods to getting batch name, paths etc; moved ... Wed, 17 Aug 2011 02:12:01 GMT rhenders [32115] * trunk/ippToPsps/jython/pollOdm.py (modified) printing results in a table Wed, 17 Aug 2011 02:11:38 GMT rhenders [32114] * trunk/ippToPsps/jython/odm.py (modified) chaning some error log message to debug Wed, 17 Aug 2011 01:52:16 GMT rhenders [32113] * trunk/ippToPsps/jython/configs/lap20110809.xml (modified) adding path to DVO database Wed, 17 Aug 2011 01:51:51 GMT rhenders [32112] * trunk/ippToPsps/jython/metrics.py (modified) saving plots to plots dir Wed, 17 Aug 2011 01:48:53 GMT rhenders [32111] * trunk/ippToPsps/jython/plots (added) adding dir for plots from metrics program Tue, 16 Aug 2011 23:14:22 GMT rhenders [32110] * trunk/ippToPsps/jython/metrics.py (modified) now produces a stacked-histogram plot Tue, 16 Aug 2011 23:13:36 GMT rhenders [32109] * trunk/ippToPsps/jython/configs/lap20110809.xml (added) adding config for new LAP Tue, 16 Aug 2011 23:13:13 GMT rhenders [32108] * trunk/ippToPsps/jython/configs/lap.xml (deleted) * trunk/ippToPsps/jython/configs/lap20110621.xml (added) changing name of old LAP condif Tue, 16 Aug 2011 18:35:30 GMT rhenders [32107] * trunk/ippToPsps/jython/pslogger.py (modified) now not printing timestamp to messages printing to stdout Tue, 16 Aug 2011 18:34:32 GMT rhenders [32106] * trunk/ippToPsps/jython/detectionbatch.py (modified) now collecting stats per chip and printing to log in a table Tue, 16 Aug 2011 18:33:52 GMT rhenders [32105] * trunk/ippToPsps/jython/mysql.py (modified) changed info log message to debug Sat, 13 Aug 2011 02:07:06 GMT rhenders [32092] * trunk/ippToPsps/jython/metrics.py (modified) now reporting much more information, specifically, the ODM status ... Sat, 13 Aug 2011 02:06:06 GMT rhenders [32091] * trunk/ippToPsps/jython/batch.py (modified) relagated a log message to DEBUG level Sat, 13 Aug 2011 02:05:37 GMT rhenders [32090] * trunk/ippToPsps/jython/ipptopsps.py (modified) using new pslogger method to setup logging; using new getter for ... Sat, 13 Aug 2011 02:04:46 GMT rhenders [32089] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) new getter methods for the various columns in the batch table; new ... Sat, 13 Aug 2011 02:03:42 GMT rhenders [32088] * trunk/ippToPsps/jython/dvoToMySQL.py (modified) * trunk/ippToPsps/jython/removeFromDatastore.py (modified) using new pslogger method Sat, 13 Aug 2011 02:03:13 GMT rhenders [32087] * trunk/ippToPsps/jython/pollOdm.py (modified) changes to loggingl removed old java code Sat, 13 Aug 2011 02:02:13 GMT rhenders [32086] * trunk/ippToPsps/jython/configs/sas12.xml (added) * trunk/ippToPsps/jython/configs/sas123.xml (added) added configs for two other SAS databases Sat, 13 Aug 2011 02:01:47 GMT rhenders [32085] * trunk/ippToPsps/jython/configs/sasFootprint.xml (modified) moved processing to ipp005 Sat, 13 Aug 2011 02:01:15 GMT rhenders [32084] * trunk/ippToPsps/jython/pslogger.py (modified) now handles configuration of logging, can send to stdout, or a file ... Sat, 13 Aug 2011 02:00:22 GMT rhenders [32083] * trunk/ippToPsps/jython/logging.conf (deleted) no need for special logging config file Thu, 11 Aug 2011 02:21:12 GMT rhenders [32075] * trunk/ippToPsps/jython/odm.py (added) New class encapsulating the ODM Wed, 10 Aug 2011 22:22:18 GMT rhenders [32072] * trunk/ippToPsps/jython/ipptopsps.py (modified) added 'Are you sure?' prompt if user requests test mode and publish Wed, 10 Aug 2011 22:15:02 GMT rhenders [32071] * trunk/ippToPsps/jython/configs/sas.xml (deleted) * trunk/ippToPsps/jython/configs/sasFootprint.xml (added) creating config for SAS footprint Wed, 10 Aug 2011 21:45:02 GMT rhenders [32070] * trunk/ippToPsps/jython/pollOdm.py (modified) now calling stripped-down version of old Perl script to poll ODM Wed, 10 Aug 2011 21:44:13 GMT rhenders [32069] * trunk/ippToPsps/perl/checkOdmStatus.pl (modified) stripped-down version for use with Jython program Wed, 10 Aug 2011 02:20:05 GMT rhenders [32067] * trunk/ippToPsps/jython/configs/lap.xml (modified) new field for pspsSurvey Wed, 10 Aug 2011 02:19:36 GMT rhenders [32066] * trunk/ippToPsps/jython/configs/sas.xml (added) first commit of config for SAS data Wed, 10 Aug 2011 02:18:54 GMT rhenders [32065] * trunk/ippToPsps/jython/batch.py (modified) now getting psps survey from config; using gpc1 DVO name in path for ... Wed, 10 Aug 2011 02:00:03 GMT rhenders [32062] * trunk/ippToPsps/jython/scratchdb.py (modified) logging improvments Wed, 10 Aug 2011 01:59:19 GMT rhenders [32061] * trunk/ippToPsps/jython/detectionbatch.py (modified) * trunk/ippToPsps/jython/stackbatch.py (modified) no need to pass survey to base-class constructor