Changes between Version 10 and Version 11 of ippToPsps_ScratchDatabase

Timestamp:

Apr 17, 2012, 9:30:57 AM (14 years ago)

Author:

rhenders

Comment:

--

ippToPsps_ScratchDatabase

@@ -32 +32 @@
  * {{{dvoPhotcodes}}}
  * {{{dvoSkyTable}}}
+
+=== {{{dvoDone}}} ===
  
+{{{dvoDone}}} is a table that records which DVO files have been ingested into this MySQL scratch database. For example:
+
+{{{
++----+---------------+-------------------------------------------------------------+--------------+-----------+
+| id | region        | path                                                        | modifiedDate | size      |
++----+---------------+-------------------------------------------------------------+--------------+-----------+
+|  1 | null          | /data/ipp005.0/gpc1/catdirs/MD04.20120307/SkyTable.fits     |   1331175448 |   9077760 | 
+|  2 | null          | /data/ipp005.0/gpc1/catdirs/MD04.20120307/Photcodes.dat     |   1322621121 |     97920 | 
+|  3 | null          | /data/ipp005.0/gpc1/catdirs/MD04.20120307/Images.dat        |   1331174312 |  36460800 | 
+|  4 | n0000/0240.01 | /data/ipp005.0/gpc1/catdirs/MD04.20120307/n0000/0240.01.cpm |   1331174328 | 544037760 | 
++----+---------------+-------------------------------------------------------------+--------------+-----------+
+}}}
+
+Whenever connecting to a scratch database, {{{ippToPsps}}} programs first check that the DVO database you plan to use (as defined in the [wiki:/ippToPsps#Loadingconfigs config]) correspond to the one currently ingested into the scratch database. If not, the user will be prompted and asked to confirm if he or she wishes to switch. care must be taken as you may have ingested many GB of DVO data into a scratch database, and all will be lost if you switch to a different DVO.
+
+The first three rows in the table above detail three DVO metadata files, SkyTable.fits, Photcodes.dat and Images.dat, which are detailed below. Following this are DVO detection files, eg cpm, cpt or cps files. By maintaining file modified dates of all files ingested, the Dvo class is able to operate a little like rsync and update any DVO files that may have changed on disk since the last time the scratch database was synchronized with DVO.
+
 === {{{dvoDetection}}}/{{{dvoDetectionFull}}} ===