IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 6 and Version 7 of External_Supercomputing_Notes


Ignore:
Timestamp:
Dec 19, 2013, 9:50:34 AM (13 years ago)
Author:
watersc1
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • External_Supercomputing_Notes

    v6 v7  
    7474The example stask scripts seem to provide a path around this limitation.  From my reading of the scripts:
    7575
    76 1. A call to the {{{stask.py}}} python script is defined in the {{{stask}}} shell script.  This script also defines a task list.  {{{stask}}} is then submitted to moab as a job.
    77 1. The moab job constructs a list of nodes allocated to the job.
    78 1. The moab job passes this node list and the task list to the python script.
    79 1. The python script (running under moab) connects to the individual node via ssh, changes to the appropriate workdir, and runs the shell script {{{mult.sh}}} with the task parameters.
    80 1. The shell script (under python as a moab job, on the individual node) runs the requested job under the [http://www.gnu.org/software/parallel/parallel_tutorial.html GNU parallel] framework.
    81 1. Python completes when the shell scripts are finished on all nodes, clearing the moab job to complete and release the resources requested.
     76 1. A call to the {{{stask.py}}} python script is defined in the {{{stask}}} shell script.  This script also defines a task list.  {{{stask}}} is then submitted to moab as a job.
     77 1. The moab job constructs a list of nodes allocated to the job.
     78 1. The moab job passes this node list and the task list to the python script.
     79 1. The python script (running under moab) connects to the individual node via ssh, changes to the appropriate workdir, and runs the shell script {{{mult.sh}}} with the task parameters.
     80 1. The shell script (under python as a moab job, on the individual node) runs the requested job under the [http://www.gnu.org/software/parallel/parallel_tutorial.html GNU parallel] framework.
     81 1. Python completes when the shell scripts are finished on all nodes, clearing the moab job to complete and release the resources requested.
    8282
    8383As of 2013-12-18, I have not run an IPP command through this stask scripts.