# # ChangeLog for trunk/ippToPsps # # Generated by Trac 1.6 # Jul 20, 2026, 10:45:35 AM Thu, 27 Oct 2011 23:40:11 GMT rhenders [32578] * trunk/ippToPsps/jython/configs/oldthreepi.xml (modified) Ready for loading.... Thu, 13 Oct 2011 19:58:45 GMT rhenders [32543] * trunk/ippToPsps/jython/cleanup.py (modified) added time argument so it will cleanup every n hours Thu, 13 Oct 2011 19:57:27 GMT rhenders [32542] * trunk/ippToPsps/jython/pollOdm.py (modified) main polling stuff now in a function; added time argument so it will ... Thu, 13 Oct 2011 19:50:28 GMT rhenders [32541] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) no need for 'DISTINCT batch_id as that column is an index, so they ... Thu, 13 Oct 2011 19:48:23 GMT rhenders [32540] * trunk/ippToPsps/jython/odm.py (modified) now assuming that 'OnHold' batches have failed Fri, 07 Oct 2011 20:49:49 GMT rhenders [32519] * trunk/ippToPsps/jython/cleanup.py (modified) now cleaning up DXLayer as well Fri, 07 Oct 2011 20:49:23 GMT rhenders [32518] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) changes order of stages now that we are deleting DXLayer batches Fri, 07 Oct 2011 20:48:53 GMT rhenders [32517] * trunk/ippToPsps/jython/dxlayer.py (added) first commit of dxlayer class, so far only providing methods to ... Fri, 07 Oct 2011 20:47:42 GMT rhenders [32516] * trunk/ippToPsps/jython/stackbatch.py (modified) put back old code to deal with skycell/projectioncell as changes ... Fri, 07 Oct 2011 20:02:58 GMT rhenders [32515] * trunk/ippToPsps/config/IN/tables.vot (modified) removing duplicated 'z' filter Fri, 07 Oct 2011 01:26:19 GMT rhenders [32512] * trunk/ippToPsps/jython/stackbatch.py (modified) adding projectionCellID to to the SkinnyObject table Fri, 07 Oct 2011 01:18:12 GMT rhenders [32508] * trunk/ippToPsps/jython/stackbatch.py (modified) now calculating psfLikelihood in StackDetection table Fri, 07 Oct 2011 00:06:50 GMT rhenders [32501] * trunk/ippToPsps/jython/stackbatch.py (modified) fixed error with skycell and added projectioncellID. Thu, 06 Oct 2011 23:41:11 GMT rhenders [32500] * trunk/ippToPsps/jython/stackbatch.py (modified) added psfFwhm_mean and psfFwhm_max Thu, 06 Oct 2011 22:50:22 GMT rhenders [32499] * trunk/ippToPsps/jython/configs/oldthreepi.xml (added) config for loading old 3pi data Thu, 06 Oct 2011 03:05:14 GMT rhenders [32497] * trunk/ippToPsps/jython/republishbatch.py (added) first commit of program that republishes a batch that has already ... Thu, 06 Oct 2011 03:04:07 GMT rhenders [32496] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) new method that returns the batch type for the provided batch ID; ... Thu, 06 Oct 2011 03:01:52 GMT rhenders [32495] * trunk/ippToPsps/jython/metrics.py (modified) now reading eq-coords from config, if there are any Thu, 06 Oct 2011 03:00:42 GMT rhenders [32494] * trunk/ippToPsps/jython/configs/sas12.xml (modified) * trunk/ippToPsps/jython/configs/sas123.xml (modified) * trunk/ippToPsps/jython/configs/sasFootprint.xml (modified) deleted local batches for everything merged Thu, 06 Oct 2011 02:19:56 GMT rhenders [32493] * trunk/ippToPsps/jython/gpc1db.py (modified) added min/max RA/Dec to constraints on DVO query Thu, 06 Oct 2011 02:18:10 GMT rhenders [32492] * trunk/ippToPsps/jython/pollOdm.py (modified) now reporting counts of new merge_worthy and new merged batches Thu, 06 Oct 2011 02:16:57 GMT rhenders [32491] * trunk/ippToPsps/jython/datastore.py (modified) fixed comment Thu, 06 Oct 2011 02:16:09 GMT rhenders [32490] * trunk/ippToPsps/jython/odm.py (modified) closing stdout Thu, 06 Oct 2011 02:15:35 GMT rhenders [32489] * trunk/ippToPsps/jython/cleanup.py (modified) using new ipptopspsdb method, and changed some log messages Fri, 30 Sep 2011 01:33:14 GMT rhenders [32468] * trunk/ippToPsps/jython/load.py (modified) big changes to support multi-client loading; now locks batch table ... Fri, 30 Sep 2011 01:31:08 GMT rhenders [32467] * trunk/ippToPsps/jython/batch.py (modified) now does not create a new batchID itself, but has one passed-in to ... Fri, 30 Sep 2011 01:29:40 GMT rhenders [32466] * trunk/ippToPsps/jython/datastore.py (modified) now accepting an IppToPspsDb object as a constructor argument and ... Fri, 30 Sep 2011 01:25:31 GMT rhenders [32465] * trunk/ippToPsps/jython/cleanup.py (modified) updating of ipptopsps database now done within Datastore object, so ... Fri, 30 Sep 2011 01:24:21 GMT rhenders [32464] * trunk/ippToPsps/jython/pslogger.py (modified) now accepts host and PID arguments into the constructor for use when ... Fri, 30 Sep 2011 01:23:44 GMT rhenders [32463] * trunk/ippToPsps/jython/detectionbatch.py (modified) constructor now accepting batchID and passing it up to the base-class ... Fri, 30 Sep 2011 01:23:28 GMT rhenders [32462] * trunk/ippToPsps/jython/stackbatch.py (modified) constructor now accepting batchID and passing it up to the base-class ... Fri, 30 Sep 2011 01:23:06 GMT rhenders [32461] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added a method to lock the batch table; reworked methid to get a new ... Fri, 30 Sep 2011 01:20:12 GMT rhenders [32460] * trunk/ippToPsps/jython/pollOdm.py (modified) now taking a batch type argument at command line; using different ... Fri, 30 Sep 2011 01:19:10 GMT rhenders [32459] * trunk/ippToPsps/jython/scratchdb.py (modified) just whitespace Fri, 30 Sep 2011 01:18:43 GMT rhenders [32458] * trunk/ippToPsps/jython/initbatch.py (modified) constructor now accepting batchID and passing it up to the base-class ... Fri, 30 Sep 2011 01:18:01 GMT rhenders [32457] * trunk/ippToPsps/jython/mysql.py (modified) added a method to lock a table and a method to unlock all tables Fri, 30 Sep 2011 01:17:22 GMT rhenders [32456] * trunk/ippToPsps/jython/removeFromDatastore.py (modified) now creating a IppToPspsDb object and passing it to the Datastore ... Fri, 30 Sep 2011 01:16:31 GMT rhenders [32455] * trunk/ippToPsps/jython/fits.py (modified) temporarily not copying FITS files to local filesystem as there is ... Tue, 27 Sep 2011 20:42:19 GMT rhenders [32454] * trunk/ippToPsps/jython/initbatch.py (modified) implemented alterPspsTables() method to satisfy base-class Mon, 26 Sep 2011 23:22:50 GMT rhenders [32453] * trunk/ippToPsps/jython/metrics.py (modified) code to print some high-level stats about each batch type Mon, 26 Sep 2011 23:22:07 GMT rhenders [32452] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added seconds to method get time of last publish. stacks are fast Sat, 24 Sep 2011 01:42:18 GMT rhenders [32443] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) including loaded_to_datastore = 1 when counting detections published; ... Sat, 24 Sep 2011 01:41:16 GMT rhenders [32442] * trunk/ippToPsps/jython/stackbatch.py (modified) certain methods were not returning True upon completion Fri, 23 Sep 2011 08:55:19 GMT rhenders [32436] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) new method to count total detections published for this label, epoch etc Wed, 07 Sep 2011 02:29:05 GMT rhenders [32362] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) changed order of processing stages; added some comments Tue, 06 Sep 2011 23:37:06 GMT rhenders [32354] * trunk/ippToPsps/jython/metrics.py (modified) now reporting batches-per-hour and last P2 and St batch published; ... Tue, 06 Sep 2011 23:35:45 GMT rhenders [32353] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) removed some redundant metrics queries; new method to get batches- ... Tue, 06 Sep 2011 19:46:27 GMT rhenders [32332] * trunk/ippToPsps/jython/batch.py (modified) removing 'size' and 'md5' fields from BatchManifest file. Time ... Tue, 06 Sep 2011 19:35:17 GMT rhenders [32331] * trunk/ippToPsps/jython/datastore.py (modified) Just whitespace Mon, 05 Sep 2011 19:51:54 GMT rhenders [32327] * trunk/ippToPsps/jython/detectionbatch.py (modified) shifted ImageMeta and FrameMeta population into different method so ... Mon, 05 Sep 2011 19:51:02 GMT rhenders [32326] * trunk/ippToPsps/jython/batch.py (modified) checking for error, and aborting if necessary, after call to ... Mon, 05 Sep 2011 02:34:24 GMT rhenders [32306] * trunk/ippToPsps/jython/configs/lap20110809.xml (modified) publishing all LAP to PSP_JHU datastore Mon, 05 Sep 2011 02:33:36 GMT rhenders [32305] * trunk/ippToPsps/jython/detectionbatch.py (modified) now specifying columns to import from IPP smf file Mon, 05 Sep 2011 02:32:45 GMT rhenders [32304] * trunk/ippToPsps/jython/batch.py (modified) now takes extra argument of columns to method that imports IPP tables Sun, 04 Sep 2011 08:59:33 GMT rhenders [32303] * trunk/ippToPsps/jython/scratchdb.py (modified) Added to comments Fri, 02 Sep 2011 21:43:24 GMT rhenders [32295] * trunk/ippToPsps/jython/scratchdb.py (modified) added stored procedure for calculating psfLikelihoods; not being ... Fri, 02 Sep 2011 21:42:19 GMT rhenders [32294] * trunk/ippToPsps/jython/metrics.py (modified) fixed typo in call to ippToPspsDb.getMergeWorthyIDs() method Fri, 02 Sep 2011 21:41:41 GMT rhenders [32293] * trunk/ippToPsps/jython/mysql.py (modified) trivial improvements to log messages and SQL Fri, 02 Sep 2011 21:40:48 GMT rhenders [32292] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) tightened loaded_to_datastore constraint in alreadyProcessed() ... Fri, 02 Sep 2011 10:05:34 GMT rhenders [32286] * trunk/ippToPsps/jython/detectionbatch.py (modified) now using a stored procedure to calculate likelihoods. much, much ... Fri, 02 Sep 2011 09:15:10 GMT rhenders [32285] * trunk/ippToPsps/jython/detectionbatch.py (modified) deleting detections with flux < 0.0000001. a temporary hack Thu, 01 Sep 2011 02:09:19 GMT rhenders [32262] * trunk/ippToPsps/jython/batch.py (modified) writing -1 to processed column in db when a batch fails Thu, 01 Sep 2011 02:08:34 GMT rhenders [32261] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added method to return all batch IDs not yet loaded to ODM Thu, 01 Sep 2011 02:07:45 GMT rhenders [32260] * trunk/ippToPsps/jython/odm.py (modified) now grabbing 'Details' part of SOAP response when a load has failed Thu, 01 Sep 2011 02:07:12 GMT rhenders [32259] * trunk/ippToPsps/jython/metrics.py (modified) removed some redundant imports; now writing to file only thos batches ... Thu, 01 Sep 2011 02:06:27 GMT rhenders [32258] * trunk/ippToPsps/jython/configs/lap20110621.xml (modified) added deletion policy Thu, 01 Sep 2011 02:06:06 GMT rhenders [32257] * trunk/ippToPsps/jython/configs/sas12.xml (modified) * trunk/ippToPsps/jython/configs/sas123.xml (modified) * trunk/ippToPsps/jython/configs/sasFootprint.xml (modified) added deletion policy Thu, 01 Sep 2011 02:05:33 GMT rhenders [32256] * trunk/ippToPsps/jython/configs/lap20110809.xml (modified) added deletion policy Thu, 01 Sep 2011 02:05:06 GMT rhenders [32255] * trunk/ippToPsps/jython/cleanup.py (modified) now deletes from datastore and local disk if set in the config Thu, 01 Sep 2011 02:04:18 GMT rhenders [32254] * trunk/ippToPsps/jython/pollOdm.py (modified) added option to poll only for those batches not yet loaded to the ODM Wed, 31 Aug 2011 23:20:14 GMT rhenders [32250] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) various changes to stage ID getters; new method to get batch IDs; now ... Wed, 31 Aug 2011 23:18:05 GMT rhenders [32249] * trunk/ippToPsps/jython/reportloadfailures.py (added) new program to get report from ODM regarding failed loads Tue, 30 Aug 2011 21:14:27 GMT rhenders [32227] * trunk/ippToPsps/jython/load.py (modified) better logging for failed-datastore-queuing Tue, 30 Aug 2011 18:39:43 GMT rhenders [32223] * trunk/ippToPsps/jython/ipptopsps.py (deleted) * trunk/ippToPsps/jython/load.py (added) Using a more meaningful name for the main loading program Tue, 30 Aug 2011 07:35:17 GMT rhenders [32222] * trunk/ippToPsps/jython/ipptopsps.py (modified) now checking for consistent failure before running a batch; extra ... Tue, 30 Aug 2011 07:33:33 GMT rhenders [32221] * trunk/ippToPsps/jython/batch.py (modified) better logging when deleting a batch from disk Tue, 30 Aug 2011 07:32:12 GMT rhenders [32220] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added methid to check for consistent failures for a particular ... Mon, 29 Aug 2011 19:30:53 GMT rhenders [32211] * trunk/ippToPsps/jython/batch.py (modified) checking FITS file is ok before proceeding; added some log messages ... Mon, 29 Aug 2011 19:29:39 GMT rhenders [32210] * trunk/ippToPsps/jython/detectionbatch.py (modified) aborting PSPS table population if no DVO IDs were found Mon, 29 Aug 2011 19:29:02 GMT rhenders [32209] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) setter methods for new 'deleted' columns; getters for batches not ... Mon, 29 Aug 2011 19:27:54 GMT rhenders [32208] * trunk/ippToPsps/jython/metrics.py (modified) now saving missing stage_ids to a text file Mon, 29 Aug 2011 19:27:29 GMT rhenders [32207] * trunk/ippToPsps/jython/fits.py (modified) initializing header to 'None' Mon, 29 Aug 2011 19:26:53 GMT rhenders [32206] * trunk/ippToPsps/jython/ipptopsps.py (modified) new method to publish batches that previously failed to load to the ... Thu, 25 Aug 2011 23:09:32 GMT rhenders [32194] * trunk/ippToPsps/jython/batch.py (modified) added static method to publish a batch to the datastore, this is so ... Thu, 25 Aug 2011 23:08:36 GMT rhenders [32193] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) now using -1 to mean this stage has failed; changes queries to ... Thu, 25 Aug 2011 23:05:26 GMT rhenders [32192] * trunk/ippToPsps/jython/stackbatch.py (modified) primary key on StackDetection is now on objID only; duplicates will ... Wed, 24 Aug 2011 00:44:30 GMT rhenders [32183] * trunk/ippToPsps/jython/ipptopsps.py (modified) fixed error in calls to logging methods Wed, 24 Aug 2011 00:44:03 GMT rhenders [32182] * trunk/ippToPsps/jython/detectionbatch.py (modified) checking astrometric solution per chip, and discarding if necessary Wed, 24 Aug 2011 00:43:13 GMT rhenders [32181] * trunk/ippToPsps/jython/datastore.py (modified) changed log level from debug to info for removal methods Wed, 24 Aug 2011 00:42:46 GMT rhenders [32180] * trunk/ippToPsps/jython/gpc1db.py (modified) some logging improvements Wed, 24 Aug 2011 00:42:05 GMT rhenders [32179] * trunk/ippToPsps/jython/scratchdb.py (modified) new method to check whether we have a decent astrometric solution for ... Mon, 22 Aug 2011 22:07:19 GMT rhenders [32166] * trunk/ippToPsps/jython/detectionbatch.py (modified) * trunk/ippToPsps/jython/ipptopspsdb.py (modified) * trunk/ippToPsps/jython/stackbatch.py (modified) added safety checks when getting smf/cmf files and cam or stack meta data Mon, 22 Aug 2011 20:46:48 GMT rhenders [32165] * trunk/ippToPsps/jython/plots (modified) updaing ignore list to ignore png files Mon, 22 Aug 2011 20:38:37 GMT rhenders [32164] * trunk/ippToPsps/jython/configs/lap20110621.xml (modified) putting back to original state used for loading Mon, 22 Aug 2011 20:37:45 GMT rhenders [32163] * trunk/ippToPsps/jython/batch.py (modified) removed redundant alreadyProcessed() method; removed redundant log ... Mon, 22 Aug 2011 18:19:51 GMT rhenders [32162] * trunk/ippToPsps/jython/ipptopsps.py (modified) * trunk/ippToPsps/jython/ipptopspsdb.py (modified) alreadyProcessed() method now taking batch type as a parameter, as of ... Sat, 20 Aug 2011 00:23:18 GMT rhenders [32145] * trunk/ippToPsps/perl/exposureSummary.pl (deleted) * trunk/ippToPsps/perl/ippToPsps_run.pl (deleted) * trunk/ippToPsps/perl/removeFromDatastore.pl (deleted) purging some old perl scripts Sat, 20 Aug 2011 00:22:20 GMT rhenders [32144] * trunk/ippToPsps/perl/deleteFromDXLayer.pl (added) First commit of new script to delete a batch from the DXLayer Sat, 20 Aug 2011 00:21:54 GMT rhenders [32143] * trunk/ippToPsps/perl/checkOdmStatus.pl (modified) purged redundant code Sat, 20 Aug 2011 00:17:33 GMT rhenders [32142] * trunk/ippToPsps/config/IN/tables.vot (modified) changes to avoid -999 ending up in binary Region table column