# # ChangeLog for trunk/ippToPsps # # Generated by Trac 1.6 # Jul 19, 2026, 9:08:18 PM Wed, 03 Aug 2011 21:58:35 GMT rhenders [31995] * trunk/ippToPsps/jython/metrics.py (modified) improved handling of single command line arg for config; removed some ... Wed, 03 Aug 2011 21:57:31 GMT rhenders [31994] * trunk/ippToPsps/jython/dvoToMySQL.py (modified) lots of improvements to logging; improved check that user really ... Wed, 03 Aug 2011 21:12:58 GMT rhenders [31993] * trunk/ippToPsps/jython/metrics.py (modified) now takes a path to a config file as its sole argument Wed, 03 Aug 2011 02:33:08 GMT rhenders [31986] * trunk/ippToPsps/src/Dvo.c (modified) * trunk/ippToPsps/src/Dvo.h (modified) changes to support config path being passed to constructor Wed, 03 Aug 2011 02:29:01 GMT rhenders [31985] * trunk/ippToPsps/jython/batch.py (modified) * trunk/ippToPsps/jython/datastore.py (modified) now passing XML config document to Datastore constructor Wed, 03 Aug 2011 02:25:55 GMT rhenders [31984] * trunk/ippToPsps/jython/config.xml (deleted) configs now in configs subdir Wed, 03 Aug 2011 02:24:49 GMT rhenders [31983] * trunk/ippToPsps/jython/configs/lap.xml (added) config for LAP loading Wed, 03 Aug 2011 02:24:03 GMT rhenders [31982] * trunk/ippToPsps/jython/ipptopsps.py (modified) now takes a single argument pointing to config file to use Wed, 03 Aug 2011 02:23:36 GMT rhenders [31981] * trunk/ippToPsps/jython/configs (added) * trunk/ippToPsps/jython/configs/simtest.xml (added) New directory for config files, including one for simtest test-loop stuff Wed, 03 Aug 2011 02:17:52 GMT rhenders [31980] * trunk/ippToPsps/jython/ipptopsps.py (modified) whoops - wrong XML field for queuing options Wed, 03 Aug 2011 02:15:42 GMT rhenders [31979] * trunk/ippToPsps/jython/pslogger.py (modified) new boolean printing methods Wed, 03 Aug 2011 02:13:06 GMT rhenders [31978] * trunk/ippToPsps/jython/ipptopsps.py (modified) now, batch types to be queued are set in config, not the command-line Wed, 03 Aug 2011 01:59:41 GMT rhenders [31977] * trunk/ippToPsps/jython/stackbatch.py (modified) using correct ScratchDb field name for detection table Wed, 03 Aug 2011 01:56:26 GMT rhenders [31976] * trunk/ippToPsps/jython/detectionbatch.py (modified) using correct ScratcDb field name for detection table Wed, 03 Aug 2011 01:51:54 GMT rhenders [31975] * trunk/ippToPsps/jython/fits.py (modified) trivial comment and whitespace Wed, 03 Aug 2011 01:49:52 GMT rhenders [31974] * trunk/ippToPsps/jython/detectionbatch.py (modified) no longer using defaults for SOURCEID and IMAGEID if missing Wed, 03 Aug 2011 01:49:19 GMT rhenders [31973] * trunk/ippToPsps/jython/batch.py (modified) now reporting to log a count of detections imported from DVO Tue, 02 Aug 2011 23:52:50 GMT rhenders [31972] * trunk/ippToPsps/jython/dvoToMySQL.py (modified) added abilty to reset DVO tables; added checks to make absolutely ... Tue, 02 Aug 2011 23:22:21 GMT rhenders [31971] * trunk/ippToPsps/jython/scratchdb.py (modified) Added method to reset DVO tables when running dvoToMySQL Tue, 02 Aug 2011 02:05:53 GMT rhenders [31965] * trunk/ippToPsps/jython/detectionbatch.py (modified) * trunk/ippToPsps/jython/dvoToMySQL.py (modified) * trunk/ippToPsps/jython/scratchdb.py (modified) * trunk/ippToPsps/jython/stackbatch.py (modified) * trunk/ippToPsps/src/Dvo.c (modified) finally cleared up image_id/extern_id confusion Sat, 30 Jul 2011 00:46:05 GMT rhenders [31951] * trunk/ippToPsps/jython/detectionbatch.py (modified) * trunk/ippToPsps/jython/stackbatch.py (modified) externID column has been dropped from dvoMeta table Sat, 30 Jul 2011 00:45:27 GMT rhenders [31950] * trunk/ippToPsps/jython/scratchdb.py (modified) Dropped externID from dvoMeta table. This is confusing since IMAGEID ... Fri, 29 Jul 2011 19:53:42 GMT rhenders [31949] * trunk/ippToPsps/jython/fits.py (modified) added comments and improved some logging Tue, 26 Jul 2011 02:20:22 GMT rhenders [31936] * trunk/ippToPsps/jython/detectionbatch.py (modified) using new Batch class method to substitude a default value for ... Tue, 26 Jul 2011 02:19:47 GMT rhenders [31935] * trunk/ippToPsps/jython/batch.py (modified) new method to check for header value and replace it with supplied ... Mon, 25 Jul 2011 23:53:40 GMT rhenders [31934] * trunk/ippToPsps/jython/batch.py (modified) cleaner exit from failed batch Mon, 25 Jul 2011 23:52:40 GMT rhenders [31933] * trunk/ippToPsps/jython/pslogger.py (modified) added error pair methid analogous to infoPair method Mon, 25 Jul 2011 23:51:58 GMT rhenders [31932] * trunk/ippToPsps/jython/detectionbatch.py (modified) added check to see if SOURCEID and IMAGEID are present in image FITS ... Mon, 25 Jul 2011 22:33:00 GMT rhenders [31931] * trunk/ippToPsps/src/DetectionBatchEnums.h (modified) most recent schema changes Mon, 25 Jul 2011 22:32:27 GMT rhenders [31930] * trunk/ippToPsps/src/Fits.c (modified) cleaned-up file closing Mon, 25 Jul 2011 22:31:48 GMT rhenders [31929] * trunk/ippToPsps/src/Makefile.am (modified) added dvograbber executable Mon, 25 Jul 2011 22:31:14 GMT rhenders [31928] * trunk/ippToPsps/src/Dvo.c (modified) takes an argument for DVO database location Sat, 23 Jul 2011 01:45:04 GMT rhenders [31921] * trunk/ippToPsps/jython/initbatch.py (modified) changes to make this batch type work with new Batch class Sat, 23 Jul 2011 01:44:24 GMT rhenders [31920] * trunk/ippToPsps/jython/batch.py (modified) making fits file argument to constructor optional (don't need for ... Sat, 23 Jul 2011 01:43:42 GMT rhenders [31919] * trunk/ippToPsps/jython/gpc1db.py (modified) was looking for wrong file extension when getting smf files Tue, 12 Jul 2011 19:46:47 GMT rhenders [31865] * trunk/ippToPsps/jython/metrics.py (added) First commit of new metrics code Tue, 12 Jul 2011 19:46:19 GMT rhenders [31864] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) new method for getting IDs of all failed batches Tue, 12 Jul 2011 18:35:57 GMT rhenders [31863] * trunk/ippToPsps/jython/ipptopsps.py (modified) restructured to that it polls indefinitely looking for new P2 then ST ... Tue, 12 Jul 2011 01:44:09 GMT rhenders [31861] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) removed dodgy cross-database querying method ... Tue, 12 Jul 2011 01:43:02 GMT rhenders [31860] * trunk/ippToPsps/jython/gpc1db.py (modified) yet another query to get all merged items in a DVO database Tue, 12 Jul 2011 01:42:09 GMT rhenders [31859] * trunk/ippToPsps/jython/stackbatch.py (modified) hack to fix skycell IDs issue temporarily Tue, 12 Jul 2011 00:32:27 GMT rhenders [31858] * trunk/ippToPsps/jython/gpc1db.py (modified) * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added 'WHERE state = full' constraint to get-IDs-from-DVO methods Sat, 09 Jul 2011 01:02:58 GMT rhenders [31849] * trunk/ippToPsps/jython/fits.py (modified) now taking config XML doc as constructor arg; now copying FITS file ... Sat, 09 Jul 2011 01:01:58 GMT rhenders [31848] * trunk/ippToPsps/jython/detectionbatch.py (modified) removed old start-up code; removed redundant alreadyProcessed() ... Sat, 09 Jul 2011 00:59:10 GMT rhenders [31847] * trunk/ippToPsps/jython/stackbatch.py (modified) removed redundant alreadyProcessed() method; using new logging ... Sat, 09 Jul 2011 00:55:46 GMT rhenders [31846] * trunk/ippToPsps/jython/gpc1db.py (modified) now taking config XML doc as constructor arg, and passing it to Fits ... Sat, 09 Jul 2011 00:53:38 GMT rhenders [31845] * trunk/ippToPsps/jython/ipptopsps.py (modified) prompting user if he/she is about to do something dangerous; using ... Sat, 09 Jul 2011 00:52:23 GMT rhenders [31844] * trunk/ippToPsps/jython/mysql.py (modified) now accepting config XML document to the constructor; using new ... Sat, 09 Jul 2011 00:51:24 GMT rhenders [31843] * trunk/ippToPsps/jython/pslogger.py (modified) added a 'mini' separator method Sat, 09 Jul 2011 00:50:57 GMT rhenders [31842] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added numerous methods to provide numbers for new metrics code; ... Sat, 09 Jul 2011 00:48:55 GMT rhenders [31841] * trunk/ippToPsps/jython/scratchdb.py (modified) config XML doc now passed-in; using new logging method Sat, 09 Jul 2011 00:48:02 GMT rhenders [31840] * trunk/ippToPsps/jython/batch.py (modified) removed FITS specific code and moved into new Fits class; config XML ... Sat, 09 Jul 2011 00:44:45 GMT rhenders [31839] * trunk/ippToPsps/jython/datastore.py (modified) changes to use new logging method Sat, 09 Jul 2011 00:44:07 GMT rhenders [31838] * trunk/ippToPsps/jython/config.xml (modified) added loading epoch Fri, 08 Jul 2011 21:42:27 GMT rhenders [31835] * trunk/ippToPsps/jython/pslogger.py (added) A subclass of the Python Logger class in order to add some ... Thu, 07 Jul 2011 02:26:04 GMT rhenders [31833] * trunk/ippToPsps/jython/ipptopsps.py (added) New entry point to ippToPsps code. Run this with batch type Thu, 07 Jul 2011 02:25:31 GMT rhenders [31832] * trunk/ippToPsps/jython/fits.py (added) New class encapsulating a FITS file, for reading headers not handled ... Thu, 07 Jul 2011 02:22:01 GMT rhenders [31831] * trunk/ippToPsps/jython/gpc1db.py (modified) New method to get a cmf for a given stack_id, which is non-trivial as ... Sat, 02 Jul 2011 02:01:32 GMT rhenders [31822] * trunk/ippToPsps/jython/run.sh (modified) including Apache Commons Mathematics Library in classpath Sat, 02 Jul 2011 02:00:52 GMT rhenders [31821] * trunk/ippToPsps/jython/detectionbatch.py (modified) now making ippDetectID the primary key in order that we can use a ... Sat, 02 Jul 2011 01:59:16 GMT rhenders [31820] * trunk/ippToPsps/jython/mysql.py (modified) new method that gets an updatable result set. we use this to update ... Sat, 02 Jul 2011 01:58:01 GMT rhenders [31819] * trunk/ippToPsps/jars/stilts.jar (modified) new pre-release version dealing with NULLs in tables Sat, 02 Jul 2011 01:57:31 GMT rhenders [31818] * trunk/ippToPsps/jars/commons-math-2.2.jar (added) Apache Commons Mathematics Library, needed for complimentary error ... Fri, 01 Jul 2011 19:03:28 GMT rhenders [31811] * trunk/ippToPsps/jython/stackbatch.py (modified) changes simiar to those in detectionbatch (see previous commit). this ... Fri, 01 Jul 2011 19:01:00 GMT rhenders [31810] * trunk/ippToPsps/jython/detectionbatch.py (modified) now creating XML doc for config and passing to super-constructor; ... Fri, 01 Jul 2011 18:54:16 GMT rhenders [31809] * trunk/ippToPsps/jython/batch.py (modified) implementing new dataRelease, useFullTables, force, testmode, ... Fri, 01 Jul 2011 18:49:25 GMT rhenders [31808] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) added stage_id column to batch table which is either cam_id or ... Fri, 01 Jul 2011 18:46:39 GMT rhenders [31807] * trunk/ippToPsps/jython/mysql.py (modified) minor change to logging message Fri, 01 Jul 2011 18:46:12 GMT rhenders [31806] * trunk/ippToPsps/jython/gpc1db.py (modified) now grabbing software_ver, bg and bg_stdev from rawExp table; now ... Fri, 01 Jul 2011 18:44:54 GMT rhenders [31805] * trunk/ippToPsps/jython/config.xml (modified) added testMode and force options; now only one dvo section; changed ... Fri, 01 Jul 2011 18:38:57 GMT rhenders [31804] * trunk/ippToPsps/jython/scratchdb.py (modified) added externID column to dvoMeta table for DVO-on-the-fly mode to be ... Wed, 29 Jun 2011 18:40:03 GMT rhenders [31759] * trunk/ippToPsps/perl/pspsSchema2xml.pl (modified) now also exporting a wiki-table format file Tue, 28 Jun 2011 02:25:39 GMT rhenders [31720] * trunk/ippToPsps/jython/batch.py (modified) * trunk/ippToPsps/jython/config.xml (modified) now using config file values to determine whether we publish to ... Thu, 23 Jun 2011 19:20:57 GMT rhenders [31692] * trunk/ippToPsps/config/detection/tables.vot (modified) added units to field attributes Tue, 10 May 2011 19:40:49 GMT rhenders [31504] * trunk/ippToPsps/jython/detectionbatch.py (modified) using base-class run() methid; overriden versions of ... Tue, 10 May 2011 18:55:14 GMT rhenders [31503] * trunk/ippToPsps/jython/ipptopspsdb.py (modified) using base-class methods for query execution Tue, 10 May 2011 18:51:24 GMT rhenders [31502] * trunk/ippToPsps/jython/stackbatch.py (modified) using base-class 'run()' method; re-worked overriden ... Tue, 10 May 2011 18:49:04 GMT rhenders [31501] * trunk/ippToPsps/jython/gpc1db.py (modified) using base-class methods for query execution; new method to get ... Tue, 10 May 2011 18:45:44 GMT rhenders [31500] * trunk/ippToPsps/jython/scratchdb.py (modified) using base-class methods for query execution Fri, 06 May 2011 22:43:46 GMT rhenders [31470] * trunk/ippToPsps/jython/mysql.py (modified) added methods to execute SQL queries so that stmt objects can be ... Fri, 06 May 2011 22:42:21 GMT rhenders [31469] * trunk/ippToPsps/jython/batch.py (modified) Hacks to kill last MySQL connection opened by STILTS functions; new ... Fri, 29 Apr 2011 02:26:13 GMT rhenders [31406] * trunk/ippToPsps/jython/detectionbatch.py (modified) now skipping dodgy OTAs Fri, 29 Apr 2011 01:56:55 GMT rhenders [31405] * trunk/ippToPsps/jython/batch.py (modified) removed some log messages; added abstract alterPspsTables() method to ... Fri, 29 Apr 2011 01:55:24 GMT rhenders [31404] * trunk/ippToPsps/jython/config.xml (modified) Now using Maui cluster Fri, 29 Apr 2011 01:55:01 GMT rhenders [31403] * trunk/ippToPsps/jython/detectionbatch.py (modified) skipping missing smf files; can now use either full dvo tables, or ... Fri, 29 Apr 2011 01:52:48 GMT rhenders [31402] * trunk/ippToPsps/jython/stackbatch.py (modified) skipping missing cmf files; hardcoded stuff to access nightly or deep ... Fri, 29 Apr 2011 01:49:36 GMT rhenders [31401] * trunk/ippToPsps/jython/mysql.py (modified) added method to make a certain column of a certain table unique Fri, 29 Apr 2011 01:49:05 GMT rhenders [31400] * trunk/ippToPsps/jython/gpc1db.py (modified) changes to stack-cmf-getting function - was getting them wrong; added ... Fri, 29 Apr 2011 01:47:37 GMT rhenders [31399] * trunk/ippToPsps/jython/scratchdb.py (modified) getImageIDFromExternID() method to map IPP imageID to IPP externID; ... Fri, 29 Apr 2011 01:45:48 GMT rhenders [31398] * trunk/ippToPsps/jython/dvoToMySQL.py (modified) Working version: used to create MD04.merged database Wed, 27 Apr 2011 19:50:52 GMT rhenders [31390] * trunk/ippToPsps/jython/dvoToMySQL.py (modified) working version. loops through all available FITS files and ingest ... Wed, 27 Apr 2011 19:50:07 GMT rhenders [31389] * trunk/ippToPsps/jython/detectionbatch.py (modified) replacing a null byte fields with something that won't be replaced ... Wed, 27 Apr 2011 19:49:19 GMT rhenders [31388] * trunk/ippToPsps/jython/config.xml (modified) latest configuration Wed, 27 Apr 2011 19:48:39 GMT rhenders [31387] * trunk/ippToPsps/jython/mysql.py (modified) new method to replace nulls with a sub in a specific table and column Wed, 27 Apr 2011 19:47:37 GMT rhenders [31386] * trunk/ippToPsps/jython/scratchdb.py (modified) getter/setter for dvoDone table Tue, 26 Apr 2011 01:21:40 GMT rhenders [31380] * trunk/ippToPsps/jython/mysql.py (modified) new method to find and delete rows that have a field with the ... Mon, 25 Apr 2011 19:40:49 GMT rhenders [31367] * trunk/ippToPsps/jython/dvoToMySQL.py (modified) now does all SQL necessary to build up dvoDetection and dvoMeta tables Mon, 25 Apr 2011 19:39:58 GMT rhenders [31366] * trunk/ippToPsps/jython/mysql.py (modified) now uses column as part of index name Mon, 25 Apr 2011 19:39:26 GMT rhenders [31365] * trunk/ippToPsps/jython/detectionbatch.py (modified) Was writing ImageMeta for empty Detection table: fixed Sat, 23 Apr 2011 02:20:43 GMT rhenders [31357] * trunk/ippToPsps/jython/detectionbatch.py (modified) now checking if this exposure has already been processed before ...