# # ChangeLog for trunk/ippToPsps # # Generated by Trac 1.6 # Jul 20, 2026, 10:44:22 AM Fri, 01 Jul 2011 18:49:25 GMT rhenders [31808] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added stage_id column to batch table which is either cam_id or ... Fri, 01 Jul 2011 18:46:39 GMT rhenders [31807] * trunk/ippToPsps/jython/mysql.py (modified) minor change to logging message Fri, 01 Jul 2011 18:46:12 GMT rhenders [31806] * trunk/ippToPsps/jython/gpc1db.py (modified) now grabbing software_ver, bg and bg_stdev from rawExp table; now ... Fri, 01 Jul 2011 18:44:54 GMT rhenders [31805] * trunk/ippToPsps/jython/config.xml (modified) added testMode and force options; now only one dvo section; changed ... Fri, 01 Jul 2011 18:38:57 GMT rhenders [31804] * trunk/ippToPsps/jython/scratchdb.py (modified) added externID column to dvoMeta table for DVO-on-the-fly mode to be ... Wed, 29 Jun 2011 18:40:03 GMT rhenders [31759] * trunk/ippToPsps/perl/pspsSchema2xml.pl (modified) now also exporting a wiki-table format file Tue, 28 Jun 2011 02:25:39 GMT rhenders [31720] * trunk/ippToPsps/jython/batch.py (modified) * trunk/ippToPsps/jython/config.xml (modified) now using config file values to determine whether we publish to ... Thu, 23 Jun 2011 19:20:57 GMT rhenders [31692] * trunk/ippToPsps/config/detection/tables.vot (modified) added units to field attributes Tue, 10 May 2011 19:40:49 GMT rhenders [31504] * trunk/ippToPsps/jython/detectionbatch.py (modified) using base-class run() methid; overriden versions of ... Tue, 10 May 2011 18:55:14 GMT rhenders [31503] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) using base-class methods for query execution Tue, 10 May 2011 18:51:24 GMT rhenders [31502] * trunk/ippToPsps/jython/stackbatch.py (modified) using base-class 'run()' method; re-worked overriden ... Tue, 10 May 2011 18:49:04 GMT rhenders [31501] * trunk/ippToPsps/jython/gpc1db.py (modified) using base-class methods for query execution; new method to get ... Tue, 10 May 2011 18:45:44 GMT rhenders [31500] * trunk/ippToPsps/jython/scratchdb.py (modified) using base-class methods for query execution Fri, 06 May 2011 22:43:46 GMT rhenders [31470] * trunk/ippToPsps/jython/mysql.py (modified) added methods to execute SQL queries so that stmt objects can be ... Fri, 06 May 2011 22:42:21 GMT rhenders [31469] * trunk/ippToPsps/jython/batch.py (modified) Hacks to kill last MySQL connection opened by STILTS functions; new ... Fri, 29 Apr 2011 02:26:13 GMT rhenders [31406] * trunk/ippToPsps/jython/detectionbatch.py (modified) now skipping dodgy OTAs Fri, 29 Apr 2011 01:56:55 GMT rhenders [31405] * trunk/ippToPsps/jython/batch.py (modified) removed some log messages; added abstract alterPspsTables() method to ... Fri, 29 Apr 2011 01:55:24 GMT rhenders [31404] * trunk/ippToPsps/jython/config.xml (modified) Now using Maui cluster Fri, 29 Apr 2011 01:55:01 GMT rhenders [31403] * trunk/ippToPsps/jython/detectionbatch.py (modified) skipping missing smf files; can now use either full dvo tables, or ... Fri, 29 Apr 2011 01:52:48 GMT rhenders [31402] * trunk/ippToPsps/jython/stackbatch.py (modified) skipping missing cmf files; hardcoded stuff to access nightly or deep ... Fri, 29 Apr 2011 01:49:36 GMT rhenders [31401] * trunk/ippToPsps/jython/mysql.py (modified) added method to make a certain column of a certain table unique Fri, 29 Apr 2011 01:49:05 GMT rhenders [31400] * trunk/ippToPsps/jython/gpc1db.py (modified) changes to stack-cmf-getting function - was getting them wrong; added ... Fri, 29 Apr 2011 01:47:37 GMT rhenders [31399] * trunk/ippToPsps/jython/scratchdb.py (modified) getImageIDFromExternID() method to map IPP imageID to IPP externID; ... Fri, 29 Apr 2011 01:45:48 GMT rhenders [31398] * trunk/ippToPsps/jython/dvoToMySQL.py (modified) Working version: used to create MD04.merged database Wed, 27 Apr 2011 19:50:52 GMT rhenders [31390] * trunk/ippToPsps/jython/dvoToMySQL.py (modified) working version. loops through all available FITS files and ingest ... Wed, 27 Apr 2011 19:50:07 GMT rhenders [31389] * trunk/ippToPsps/jython/detectionbatch.py (modified) replacing a null byte fields with something that won't be replaced ... Wed, 27 Apr 2011 19:49:19 GMT rhenders [31388] * trunk/ippToPsps/jython/config.xml (modified) latest configuration Wed, 27 Apr 2011 19:48:39 GMT rhenders [31387] * trunk/ippToPsps/jython/mysql.py (modified) new method to replace nulls with a sub in a specific table and column Wed, 27 Apr 2011 19:47:37 GMT rhenders [31386] * trunk/ippToPsps/jython/scratchdb.py (modified) getter/setter for dvoDone table Tue, 26 Apr 2011 01:21:40 GMT rhenders [31380] * trunk/ippToPsps/jython/mysql.py (modified) new method to find and delete rows that have a field with the ... Mon, 25 Apr 2011 19:40:49 GMT rhenders [31367] * trunk/ippToPsps/jython/dvoToMySQL.py (modified) now does all SQL necessary to build up dvoDetection and dvoMeta tables Mon, 25 Apr 2011 19:39:58 GMT rhenders [31366] * trunk/ippToPsps/jython/mysql.py (modified) now uses column as part of index name Mon, 25 Apr 2011 19:39:26 GMT rhenders [31365] * trunk/ippToPsps/jython/detectionbatch.py (modified) Was writing ImageMeta for empty Detection table: fixed Sat, 23 Apr 2011 02:20:43 GMT rhenders [31357] * trunk/ippToPsps/jython/detectionbatch.py (modified) now checking if this exposure has already been processed before ... Sat, 23 Apr 2011 02:20:18 GMT rhenders [31356] * trunk/ippToPsps/jython/stackbatch.py (modified) now checking if this stack has already been processed before proceeding Sat, 23 Apr 2011 02:19:29 GMT rhenders [31355] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added insertDetectionMeta() and alreadyProcessed() methods Sat, 23 Apr 2011 02:18:53 GMT rhenders [31354] * trunk/ippToPsps/jython/scratchdb.py (modified) just added a debug line to logger Sat, 23 Apr 2011 02:18:30 GMT rhenders [31353] * trunk/ippToPsps/jython/dvoToMySQL.py (added) first commit of dvo -> Mysql program Sat, 23 Apr 2011 02:17:56 GMT rhenders [31352] * trunk/ippToPsps/jython/batch.py (modified) added alreadyProcessed() method to be implemented by all subclasses; ... Fri, 22 Apr 2011 23:37:58 GMT rhenders [31351] * trunk/ippToPsps/jython/detectionbatch.py (modified) trimming off XYnn from table names prior to export to FITS Fri, 22 Apr 2011 23:37:34 GMT rhenders [31350] * trunk/ippToPsps/jython/batch.py (modified) added ability to change table names prior to export to FITS using a regex Fri, 22 Apr 2011 23:17:45 GMT rhenders [31349] * trunk/ippToPsps/jython/config.xml (modified) Set up for MD04 loading for Boston Fri, 22 Apr 2011 23:17:20 GMT rhenders [31348] * trunk/ippToPsps/jython/batch.py (modified) removed lots of database functions, which now belong in either ... Fri, 22 Apr 2011 23:16:47 GMT rhenders [31347] * trunk/ippToPsps/jython/stackbatch.py (modified) Producing merge-able stack batches Fri, 22 Apr 2011 23:16:24 GMT rhenders [31346] * trunk/ippToPsps/jython/detectionbatch.py (modified) Now producing detection batches of same sahpe as old code Fri, 22 Apr 2011 23:15:51 GMT rhenders [31345] * trunk/ippToPsps/jython/gpc1db.py (modified) * trunk/ippToPsps/jython/ipptopspsdb.py (modified) Now subclass of MySql base class Fri, 22 Apr 2011 23:15:27 GMT rhenders [31344] * trunk/ippToPsps/jython/scratchdb.py (added) first commit of new scratch database class Fri, 22 Apr 2011 23:15:08 GMT rhenders [31343] * trunk/ippToPsps/jython/mysql.py (added) first commit of new base class for all database classes Fri, 22 Apr 2011 19:19:50 GMT rhenders [31342] * trunk/ippToPsps/config/stack/tables.vot (modified) Adding ObjectCalColor table Fri, 22 Apr 2011 19:13:01 GMT rhenders [31341] * trunk/ippToPsps/config/stack/tables.vot (modified) Adding SkinnyObject table Thu, 21 Apr 2011 19:12:57 GMT rhenders [31330] * trunk/ippToPsps/config/detection/tables.xml (modified) * trunk/ippToPsps/config/init/data.xml (modified) * trunk/ippToPsps/config/init/tables.xml (modified) * trunk/ippToPsps/config/stack/map.xml (modified) * trunk/ippToPsps/config/stack/tables.vot (modified) Changes reflecting those in the schema Thu, 21 Apr 2011 19:12:10 GMT rhenders [31329] * trunk/ippToPsps/config/detection/map.xml (modified) Added new Kron and Ap fields Tue, 19 Apr 2011 21:00:33 GMT rhenders [31325] * trunk/ippToPsps/jython/detectionbatch.py (modified) skipping corners when loop through all OTAs Tue, 19 Apr 2011 20:59:57 GMT rhenders [31324] * trunk/ippToPsps/jython/stackbatch.py (modified) now searching for all stacks for a given DVO db, and looping through ... Tue, 19 Apr 2011 20:58:16 GMT rhenders [31323] * trunk/ippToPsps/jython/gpc1db.py (modified) method to get imageIDs for a given stack; method to get sky_ids for a ... Tue, 19 Apr 2011 20:57:22 GMT rhenders [31322] * trunk/ippToPsps/jython/batch.py (modified) added Db table row count method; changed dvo table - now have ... Mon, 18 Apr 2011 22:25:23 GMT rhenders [31316] * trunk/ippToPsps/jython/stackbatch.py (modified) added psfModelID (as a string) Mon, 18 Apr 2011 22:22:46 GMT rhenders [31315] * trunk/ippToPsps/config/stack/tables.vot (modified) making psfModelID a string Sat, 16 Apr 2011 02:54:57 GMT rhenders [31305] * trunk/ippToPsps/jython/batch.py (modified) changes to the way survey IDs and dvo databases are handled Sat, 16 Apr 2011 02:54:25 GMT rhenders [31304] * trunk/ippToPsps/jython/config.xml (modified) format change for dvo databases Sat, 16 Apr 2011 02:54:05 GMT rhenders [31303] * trunk/ippToPsps/jython/detectionbatch.py (modified) looping round all OTAs and creating tables for each; many more fields ... Fri, 15 Apr 2011 23:52:28 GMT rhenders [31299] * trunk/ippToPsps/jython/batch.py (modified) added methid to count rows in database table; now checking for empty ... Fri, 15 Apr 2011 23:51:38 GMT rhenders [31298] * trunk/ippToPsps/jython/stackbatch.py (modified) Added some try/catch blocks for safety; now deleting all tables ... Fri, 15 Apr 2011 19:18:14 GMT rhenders [31292] * trunk/ippToPsps/config/stack/tables.vot (modified) * trunk/ippToPsps/jython/stackbatch.py (modified) Added kronFlux and apFlux Fri, 15 Apr 2011 18:53:08 GMT rhenders [31291] * trunk/ippToPsps/jython/batch.py (modified) New generic FITS header reading method, and methid to search for a ... Fri, 15 Apr 2011 01:19:04 GMT rhenders [31289] * trunk/ippToPsps/jython/removeFromDatastore.py (added) fist commit of script to remove a batch from the datastore Fri, 15 Apr 2011 01:18:42 GMT rhenders [31288] * trunk/ippToPsps/jython/run.sh (modified) now accepting command line args Fri, 15 Apr 2011 01:18:16 GMT rhenders [31287] * trunk/ippToPsps/jython/initbatch.py (modified) writing batch manifest file for this batch Fri, 15 Apr 2011 01:17:49 GMT rhenders [31286] * trunk/ippToPsps/jython/batch.py (modified) removing Infinity values prior to entry into database; method to call ... Fri, 15 Apr 2011 01:16:26 GMT rhenders [31285] * trunk/ippToPsps/jython/detectionbatch.py (modified) Changes to make it work with changes in superclass Fri, 15 Apr 2011 01:16:00 GMT rhenders [31284] * trunk/ippToPsps/jython/stackbatch.py (modified) Added moments (weak-lensing stuff) Fri, 15 Apr 2011 01:15:17 GMT rhenders [31283] * trunk/ippToPsps/config/init/tables.vot (modified) * trunk/ippToPsps/config/stack/tables.vot (modified) Changes reflecting those in PSPS schema Thu, 14 Apr 2011 23:25:27 GMT rhenders [31279] * trunk/ippToPsps/perl/pspsSchema2xml.pl (modified) Writing comment to votable file; now picking up '_' characters in ... Mon, 11 Apr 2011 23:13:14 GMT rhenders [31266] * trunk/ippToPsps/src/Makefile.am (modified) First commit of class for accessing a DVO database then storing IDs ... Mon, 11 Apr 2011 23:12:25 GMT rhenders [31265] * trunk/ippToPsps/src/Dvo.c (added) * trunk/ippToPsps/src/Dvo.h (added) First commit of class for accessing a DVO database then storing IDs ... Thu, 07 Apr 2011 20:06:53 GMT rhenders [31231] * trunk/ippToPsps/jython/datastore.py (modified) Fixed publish method so that it knows of success/failure; added ... Thu, 07 Apr 2011 08:27:15 GMT rhenders [31226] * trunk/ippToPsps/jython/datastore.py (added) First commit of Datastore class Thu, 07 Apr 2011 08:26:37 GMT rhenders [31225] * trunk/ippToPsps/jython/gpc1db.py (modified) * trunk/ippToPsps/jython/ipptopspsdb.py (modified) Added logging Thu, 07 Apr 2011 08:26:13 GMT rhenders [31224] * trunk/ippToPsps/jython/config.xml (modified) Added datastore 'type' Thu, 07 Apr 2011 08:25:47 GMT rhenders [31223] * trunk/ippToPsps/jython/stackbatch.py (modified) Added logging Thu, 07 Apr 2011 08:25:10 GMT rhenders [31222] * trunk/ippToPsps/jython/batch.py (modified) Added logging; methods to create tarball and publish to datastore Thu, 07 Apr 2011 08:23:49 GMT rhenders [31221] * trunk/ippToPsps/jython/logging.conf (added) Addition of logging config Thu, 07 Apr 2011 08:23:26 GMT rhenders [31220] * trunk/ippToPsps/jython/initbatch.py (modified) Introduced logging; fixed output paths Thu, 07 Apr 2011 00:42:07 GMT rhenders [31207] * trunk/ippToPsps/jars (added) * trunk/ippToPsps/jars/mysql-connector-java-5.1.14-bin.jar (added) * trunk/ippToPsps/jars/stilts.jar (added) jars necessary for STILTS jython code Wed, 06 Apr 2011 23:07:43 GMT rhenders [31202] * trunk/ippToPsps/jython/stackbatch.py (modified) method to fudge objIDs for time-being Wed, 06 Apr 2011 23:07:09 GMT rhenders [31201] * trunk/ippToPsps/jython/batch.py (modified) added method to create DVO database table and a method to update ... Wed, 06 Apr 2011 23:05:30 GMT rhenders [31200] * trunk/ippToPsps/jython/gpc1db.py (modified) Neatened some string parsing Wed, 06 Apr 2011 23:05:06 GMT rhenders [31199] * trunk/ippToPsps/jython/config.xml (modified) Added sections for DVO, datastore and local storage path Wed, 06 Apr 2011 23:04:35 GMT rhenders [31198] * trunk/ippToPsps/jython/ipptopspsdb.py (added) First commit if class representing ippToPsps database Wed, 06 Apr 2011 02:04:21 GMT rhenders [31187] * trunk/ippToPsps/jython/config.xml (added) First commit of config file for ippToPsps Wed, 06 Apr 2011 02:03:00 GMT rhenders [31185] * trunk/ippToPsps/jython/gpc1db.py (modified) removing subprocess package Wed, 06 Apr 2011 02:01:42 GMT rhenders [31184] * trunk/ippToPsps/jython/gpc1db.py (modified) removing subprocess package Wed, 06 Apr 2011 02:00:21 GMT rhenders [31183] * trunk/ippToPsps/jython/batch.py (modified) * trunk/ippToPsps/jython/gpc1.py (deleted) * trunk/ippToPsps/jython/gpc1db.py (added) * trunk/ippToPsps/jython/stackbatch.py (modified) Changing name of gpc1 database class Wed, 06 Apr 2011 01:07:50 GMT rhenders [31182] * trunk/ippToPsps/jython/stackbatch.py (modified) Method to populate StackToImage table; using new Gpc1 class to get ... Wed, 06 Apr 2011 01:06:16 GMT rhenders [31181] * trunk/ippToPsps/jython/batch.py (modified) Setting default value for inputFilePath Wed, 06 Apr 2011 01:05:45 GMT rhenders [31180] * trunk/ippToPsps/jython/initbatch.py (modified) Different args to super-constructor; setting up output filename ... Wed, 06 Apr 2011 01:02:50 GMT rhenders [31179] * trunk/ippToPsps/jython/gpc1.py (added) First commit of Gpc1 class Wed, 06 Apr 2011 01:02:30 GMT rhenders [31178] * trunk/ippToPsps/jython/batch.py (modified) Added methods to report NULL columns as well replace NULLs with a ... Tue, 05 Apr 2011 19:08:48 GMT rhenders [31172] * trunk/ippToPsps/config/init/VOTables.xml (deleted) * trunk/ippToPsps/config/stack/VOTables.xml (deleted) removing old files Tue, 05 Apr 2011 19:08:09 GMT rhenders [31171] * trunk/ippToPsps/config/init/tables.vot (added) * trunk/ippToPsps/config/stack/tables.vot (added) more filename changes