IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 19 and Version 20 of External_Supercomputing_Notes


Ignore:
Timestamp:
Jan 31, 2014, 6:22:46 PM (12 years ago)
Author:
watersc1
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • External_Supercomputing_Notes

    v19 v20  
    11== 2014-01-31 ==
    22
    3 The first set of programs seem to be working for controlling remote processing.  I've revised the 2014-01-23 section to reflect the changes that I've made as developing the code. 
     3The first set of programs seem to be working for controlling remote processing.  I've revised the 2014-01-23 section to reflect the changes that I've made as developing the code.  I've been able to successfully run things up to the job polling state.  It seems that my test job is stuck waiting for resources, which leads to the next main issue.
     4
     5I'm not completely sure that I have the job resources properly defined.  This breaks down into the following points:
     6  * I allocate 60 nodes to execute the 60 chip stage jobs in the msub command.  This in turn calls srun which has 60 ppImage commands defined.  I don't fully understand if this is doing what I expect (grabbing 60 in msub, and allocating one to each ppImage via srun), or if I'm double allocating.
     7  * I'm allocating 60 nodes with ppn (proc/node) of 2 (as a test to reduce the resource request while debugging).  I don't actually care to have separate nodes (one 8 proc node could run 4 jobs), so I don't know if I'm over-restricting my request.
     8  * I don't have a good idea of the actual requirements for IPP jobs.  Are some jobs sufficiently well threaded that I should be trying to run a higher number of threads?
     9 
     10
    411
    512== 2014-01-23 ==