Changes between Version 4 and Version 5 of IPP_Progress_Report_20120123

Timestamp:

Jan 30, 2012, 11:48:45 AM (14 years ago)

Author:

rhenders

Comment:

--

IPP_Progress_Report_20120123

@@ -23 +23 @@
 Since I already had code to load entire DVO databases into MySQL for faster access I adapted it to ingest a portion at a time, defined by a box of RA/Dec. Steps included:
 
-  * code to load SkyList.fits table into MySQL database
+  * code to load !SkyTable.fits table into MySQL database
   * code to query the above table and get region files contained in RA/Dec box (could be whole sky, or anything smaller)
   * new Db table to maintain list of DVO files imported, including modified date and size and an index number (so we can delete associated detections later)
@@ -29 +29 @@
   * rsync-style system that checks file modified dates so that we don't re-ingest unchanged files or ignore recently modified ones
   * process can be stopped and restarted as it remembers what has and hasn't been ingested
-  * implemented a method to delete a DVO region from the Db, but retain Images.dat and SkyTable from DVO (to save time)
+  * implemented a method to delete a DVO region from the Db, but retain Images.dat and !SkyTable from DVO (to save time)
 
 Future work will be an algorithm to decide which region of the sky is optimal to load next, i.e. figuring out the size available smf/cmf files versus the size on disk in DVO - there is no point ingesting 30GB of DVO data if I only have 2 smf files to load to PSPS.