| | 3 | After finding terrible transfer rates on the post-chip return transfer, I set up a test set to probe how quickly I can transfer data back. I created files with a range of sizes, and used a range of parallel jobs, as shown in the table of figures below. The main result that I hadn't expected was that the majority of the transfer issue is likely to do with the inefficiency of transferring small files. Even though I attempted to use the ControlMaster path (which should minimize the connection setup time), this did not seem to significantly improve the transfer for small files (ControlMaster has a connection limit which the high-parallel tests violated. This explains why there's a break in the 10-Megabyte file rate). |
