Use ippdor user.

########
# Docs #
########

http://research.cs.wisc.edu/htcondor/manual/v7.8/4_5Application_Program.html#SECTION00551000000000000000

http://research.cs.wisc.edu/htcondor/manual/v7.8/4_1HTCondor_s_ClassAd.html#sec:classad-reference

#########################
# Condor on the cluster #
#########################
* Master: ippdb03 / User: ippdor
  /export/ippdb03.0/ippdor/condor_local/condor_config.local
  -> Added SOAP related stuff at the end of file
  -> Negotiator and Collector both run on port 9618.
  -> Sched runs on port 9619.
* ~/deploy_condor.sh for other nodes
* All config files in /export/<hostname>.0/ippdor/condor_local and
  /export/<hostname>.0/ippdor/condor_local
* Use ~/condor_installation/<template_file> to change configuration
  and distribute it.
  -> START can prevent running jobs.

###############################
# Condor SOAP C library build #
###############################
- Dependencies
--------------
* Get gsoap (version was 2.7.16) http://www.cs.fsu.edu/~engelen/soap.html
  (I don't remember where it comes from but this is required!)
INSTALLDIR=$HOME/local
cd gsoap-2.7
mv -f $INSTALLDIR/share/gsoap $INSTALLDIR/share/gsoap.old
mkdir -p $INSTALLDIR/share/gsoap
cd gsoap && cp -r WS custom extras import plugin $INSTALLDIR/share/gsoap/ && cd ..
configure --prefix=$INSTALLDIR
make #Warning no 'make -j8' since some dependencies are created thorugh bison
make install

* Get Boost (version was 1.51.0) http://www.boost.org/users/download/
INSTALLDIR=$HOME/local
cd boost_1_51_0
./bootstrap.sh --prefix=$INSTALLDIR
./b2
./b2 install

* Get the condor tarball from condor download site
Notes:
  We build without globus and kerberos.
  Reference: http://comments.gmane.org/gmane.comp.distributed.condor.user/25638
  ('grep WITH_ *' in root directory)
RELEASEDIR=$HOME/condor_release
mv -f $RELEASEDIR $RELEASEDIR.old
cmake -DWITH_GLOBUS:BOOL=FALSE -DWITH_KRB5:BOOL=FALSE -DCMAKE_INSTALL_PREFIX:PATH=$RELEASEDIR .
  (Have a look at what is displayed)
make

And unfortunately the dirty part ()
cp -r $HOME/local/share/gsoap /export/ippdb03.0/ippdor/
sudo ln -s /export/ippdb03.0/ippdor/gsoap /usr/share/gsoap

make
make install

- Library
---------
~ippdor/dev/CondorC/1test/libraries/Makefile
(both sched and collector libraries can be aggregated)
Refs:
* http://www.cs.fsu.edu/~engelen/soapdoc2.html
* http://users.skynet.be/pascalbotte/rcx-ws-doc/gsoap.htm

- Sample
---------
~ippdor/dev/CondorC/1test/libraries/mytest.c

############
# Pantasks #
############
* Source committed to https://svn.pan-starrs.ifa.hawaii.edu/repo/ipp/branches/sc_branches/pantasks_condor
  -> ~/dev/pantasks_condor
* Modified Makefiles so that I don't need the full opihi. Original Makefile renamed Makefile.sos
* Makefile.System in root dir
* Pantasks server defined in bin (dirty). Runs on ippc11
* Installation to /home/panstarrs/ippdor/ohana (LD_LIBRARY_PATH and PATH are NOT set)

Current status:
* Can add/remove/query hosts
* Can commit jobs to manager: Each job has its own transaction -> Inefficient :(
* 

TODO:
* Get job status
* Need to explicitely delete jobs with condor_rm and then condor_rm -force
* Group "similar?" jobs in batches so that there is no need to start a transaction
