distributed computing - Run multiple instance of a process on a number of servers -
i run multiple instances of randomized algorithm. performance reason, i'd distribute tasks on several machines.
typically, run program follows:
./main < input.txt > output.txt
and takes 30 minutes return solution.
i run many instances of possible, , ideally not change code of program. questions are:
1 - online services offer computing resources suit need?
2 - practically, how should launch remotely processes, notified of termination, , aggregate results (basically, pick best solution). there simple framework use or should ssh-based scripting?
1 - online services offer computing resources suit need?
amazon ec2.
2 - practically, how should launch remotely processes, notified of termination, , aggregate results (basically, pick best solution). there simple framework use or should ssh-based scripting?
amazon ec2 has api launching virtual machines. once they're launched, can indeed use ssh control jobs, , recommend solution. expect other softwares distributed job management exist, aren't simpler configure ssh.
Comments
Post a Comment