IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 2 and Version 3 of ps1_public_release_pstamp_issues


Ignore:
Timestamp:
May 4, 2015, 11:46:23 AM (11 years ago)
Author:
bills
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • ps1_public_release_pstamp_issues

    v2 v3  
    1515
    1616The primary way for PS1SC users to access image data products has been through the IPP data store interface. ''Files'' are contained in ''File Sets'' (sub-directories)
    17 in particular ''Products'' (directories) on the data store HTTP server which is part of the IPP cluster on Maui. Access external to the
     17in particular ''Products'' (directories) on the data store HTTP server. This server is part of the IPP cluster on Maui. Access external to the
    1818IfA is allowed through a proxy server in Manoa on Maui. Access to this server is controlled by restricting access to IP addresses
    1919that have been identified as belonging to members of the PS1 science consortium. Access to certain products is more
     
    2525
    2626Use of the data store interface (invented by the PS1 camera group for summit data access) was chosen primarily for historical reasons.
    27 
    2827It is most useful for distributing data in a serial fashion. There is an interface which allows clients to ask the server "what's new since this fileset".
    29 This is of great use to users waiting for timely distribution of recently acquired science data in near real time.
     28This is of great use to users who need timely access to recently acquired science data as it is processed.
    3029
    3130The data store is of less utility to users of the postage stamp server. Those users simply need to know that a request has completed processing and where the results have been posted.
     
    5049
    5150It is important to understand that the postage stamp system is intimately tied with the IPP. There are a number of characteristics of the system which are tied
    52 to the way the IPP operates. Many of these things will not be relevant in the public release environment yet they have added significant complexity to the current system.
     51to the way the IPP operates. Many of these things have added significant complexity to the current system but will not be relevant in the public release environment.
    5352 * The request specification is quite rich allowing essentially any image ever processed by the IPP to be selected.
    5453 * There are several different selection methods. Many of these methods are rarely used outside of the IfA.
    5554 * Images often must be regenerated and this process must be managed.
     55 * The set of available images is stored in the gpc1 database which is quite large.
    5656 * The input image files are stored in the nebulous file system.
    57 
     57 * results are stored on the data store