IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

source: trunk/ippToPsps

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @32866   15 years rhenders Config for load of new MD4, using ready-made DVO -> MySQL database
(edit) @32864   15 years rhenders Using a new DVO Db. This is the version used to load to PSPS on 2011-12-02
(edit) @32847   15 years rhenders Production-ready
(edit) @32838   15 years rhenders Added some comments
(edit) @32837   15 years rhenders Using new ippToPspsDb method to reset the batch prior to republishing
(edit) @32836   15 years rhenders New method to 'reset' a batch, basically, pretend it was never loaded …
(edit) @32835   15 years rhenders now using 'link' rather than 'copy' argument when publishing to datastore
(edit) @32831   15 years rhenders adding class for czardb
(edit) @32829   15 years rhenders changed DVO database to a new one
(edit) @32828   15 years rhenders now including RA 7-9 hrs
(edit) @32826   15 years rhenders production config for new SAS
(edit) @32825   15 years rhenders Added all the new PSPS surveys to the XML schema for batch manifest files
(edit) @32824   15 years rhenders improved some log messages
(edit) @32823   15 years rhenders added comment
(edit) @32821   15 years rhenders New config for the new SAS database
(edit) @32819   15 years rhenders improved logic so that batches are only marked as 'successfully' …
(edit) @32802   15 years rhenders add extra constraints when gathering batches that have not loaded to …
(edit) @32801   15 years rhenders savinf ODM message for display; setting default message for 'details' …
(edit) @32800   15 years rhenders quick and dirty shell script to check for dupes on the datastore
(edit) @32781   15 years rhenders increased 'processing now' limit from 2 to 4 hours, as when network is …
(edit) @32780   15 years rhenders removed 'loaded_to_datastore != 0' constraint when checking if a batch …
(edit) @32778   15 years rhenders removed redundant method used to testing
(edit) @32777   15 years rhenders added a timer so program will run in a loop
(edit) @32737   15 years rhenders added czar Db info to config
(edit) @32736   15 years rhenders added czar db section to config
(edit) @32730   15 years rhenders Using master DVO database on ipp005; now processing up to 18 hrs RA
(edit) @32655   15 years rhenders Neatened this up so that the 'all' option will sequentially check …
(edit) @32654   15 years rhenders Removed redundant getAllUnfinishedBatchIDs() method. Not needed by ODM …
(edit) @32596   15 years rhenders some re-arranging so that, if the FITS file is not found in Nebulous, …
(edit) @32592   15 years rhenders Added high-level comment
(edit) @32591   15 years rhenders Calling createPsfLikelihoodFunction() explicitly
(edit) @32590   15 years rhenders Fixed method to install psfLikelihood() stored procedure
(edit) @32589   15 years rhenders now exiting cleanly if no FITS file is found for non-IN batches; …
(edit) @32588   15 years rhenders Added high-level comment
(edit) @32587   15 years rhenders Now makes an estimate of remaining time required to complete …
(edit) @32586   15 years rhenders New program to setup a new scratch database on the local machine
(edit) @32582   15 years rhenders Just processing RA 9-10 hrs
(edit) @32581   15 years rhenders config for setting up new scratch Dbs with init tables
(edit) @32580   15 years rhenders changed maximum fails count from 3 to 4
(edit) @32579   15 years rhenders Now reading ra/dec coords from config when queueing-up
(edit) @32578   15 years rhenders Ready for loading.…
(edit) @32543   15 years rhenders added time argument so it will cleanup every n hours
(edit) @32542   15 years rhenders main polling stuff now in a function; added time argument so it will …
(edit) @32541   15 years rhenders no need for 'DISTINCT batch_id as that column is an index, so they are …
(edit) @32540   15 years rhenders now assuming that 'OnHold' batches have failed
(edit) @32519   15 years rhenders now cleaning up DXLayer as well
(edit) @32518   15 years rhenders changes order of stages now that we are deleting DXLayer batches
(edit) @32517   15 years rhenders first commit of dxlayer class, so far only providing methods to delete …
(edit) @32516   15 years rhenders put back old code to deal with skycell/projectioncell as changes …
(edit) @32515   15 years rhenders removing duplicated 'z' filter
(edit) @32512   15 years rhenders adding projectionCellID to to the SkinnyObject table
(edit) @32508   15 years rhenders now calculating psfLikelihood in StackDetection table
(edit) @32501   15 years rhenders fixed error with skycell and added projectioncellID.
(edit) @32500   15 years rhenders added psfFwhm_mean and psfFwhm_max
(edit) @32499   15 years rhenders config for loading old 3pi data
(edit) @32497   15 years rhenders first commit of program that republishes a batch that has already been …
(edit) @32496   15 years rhenders new method that returns the batch type for the provided batch ID; …
(edit) @32495   15 years rhenders now reading eq-coords from config, if there are any
(edit) @32494   15 years rhenders deleted local batches for everything merged
(edit) @32493   15 years rhenders added min/max RA/Dec to constraints on DVO query
(edit) @32492   15 years rhenders now reporting counts of new merge_worthy and new merged batches
(edit) @32491   15 years rhenders fixed comment
(edit) @32490   15 years rhenders closing stdout
(edit) @32489   15 years rhenders using new ipptopspsdb method, and changed some log messages
(edit) @32468   15 years rhenders big changes to support multi-client loading; now locks batch table …
(edit) @32467   15 years rhenders now does not create a new batchID itself, but has one passed-in to the …
(edit) @32466   15 years rhenders now accepting an IppToPspsDb object as a constructor argument and …
(edit) @32465   15 years rhenders updating of ipptopsps database now done within Datastore object, so …
(edit) @32464   15 years rhenders now accepts host and PID arguments into the constructor for use when …
(edit) @32463   15 years rhenders constructor now accepting batchID and passing it up to the base-class …
(edit) @32462   15 years rhenders constructor now accepting batchID and passing it up to the base-class …
(edit) @32461   15 years rhenders added a method to lock the batch table; reworked methid to get a new …
(edit) @32460   15 years rhenders now taking a batch type argument at command line; using different …
(edit) @32459   15 years rhenders just whitespace
(edit) @32458   15 years rhenders constructor now accepting batchID and passing it up to the base-class …
(edit) @32457   15 years rhenders added a method to lock a table and a method to unlock all tables
(edit) @32456   15 years rhenders now creating a IppToPspsDb object and passing it to the Datastore …
(edit) @32455   15 years rhenders temporarily not copying FITS files to local filesystem as there is …
(edit) @32454   15 years rhenders implemented alterPspsTables() method to satisfy base-class
(edit) @32453   15 years rhenders code to print some high-level stats about each batch type
(edit) @32452   15 years rhenders added seconds to method get time of last publish. stacks are fast
(edit) @32443   15 years rhenders including loaded_to_datastore = 1 when counting detections published; …
(edit) @32442   15 years rhenders certain methods were not returning True upon completion
(edit) @32436   15 years rhenders new method to count total detections published for this label, epoch etc
(edit) @32362   15 years rhenders changed order of processing stages; added some comments
(edit) @32354   15 years rhenders now reporting batches-per-hour and last P2 and St batch published; …
(edit) @32353   15 years rhenders removed some redundant metrics queries; new method to get batches-per-hour
(edit) @32332   15 years rhenders removing 'size' and 'md5' fields from BatchManifest file. Time …
(edit) @32331   15 years rhenders Just whitespace
(edit) @32327   15 years rhenders shifted ImageMeta and FrameMeta population into different method so …
(edit) @32326   15 years rhenders checking for error, and aborting if necessary, after call to …
(edit) @32306   15 years rhenders publishing all LAP to PSP_JHU datastore
(edit) @32305   15 years rhenders now specifying columns to import from IPP smf file
(edit) @32304   15 years rhenders now takes extra argument of columns to method that imports IPP tables
(edit) @32303   15 years rhenders Added to comments
(edit) @32295   15 years rhenders added stored procedure for calculating psfLikelihoods; not being called yet
(edit) @32294   15 years rhenders fixed typo in call to ippToPspsDb.getMergeWorthyIDs() method
(edit) @32293   15 years rhenders trivial improvements to log messages and SQL
(edit) @32292   15 years rhenders tightened loaded_to_datastore constraint in alreadyProcessed() method; …
(edit) @32286   15 years rhenders now using a stored procedure to calculate likelihoods. much, much …
Note: See TracRevisionLog for help on using the revision log.