
Notes on the rebalancing script:

* rebalancing is performed for one source host at a time
* a target number of bytes to remove should be determined from the current neb distribution
  (goal is uniform fractional fill-factor)


Stage 1 : Copy files from source machine

* Ngoal = total number of bytes to remove from the machine
* for each of the 256 nebulous partitions (nebulous/00 - nebulous/ff), we will select files for a total of Ngoal / 256 bytes
* generate a list of the files to copy (for each partition)
* rsync using the input file list to the target

EXAMPLE:

  rebalance.s1.mana /data/ipp070.0/nebulous /data/ipp133.0/rebalance 0.8

  * list of files to move : SRCDIR/NN/movefiles.DATE.txt
  

Stage 2 : re-insert the files in nebulous

* this is basically identical to the reinsert process from the shuffle work

(do a double-check on the re-inserted files in neb)

Stage 3 : remove the files from the source machine

****

