r - How to see how many nodes a process is using on a cluster with Sun grid engine? -
i (trying to) run r on multicore computing cluster sun grid engine. run r in parallel using mpi environment , snow / snowfall parlapply() functions. code working @ least on laptop, sure whether supposed on cluster well, have following questions.
if request number of slots / nodes, 4, how can check whether running process uses full number of requested cpus? there commend can show details cpu usage on requested nodes process?
in order verify cluster workers started on appropriate nodes, use following command right after creating cluster object:
clusterevalq(cl, sys.info()['nodename'])
this should match list of allocated nodes reported qstat
command.
to details on cpu usage, ssh each node , use commands top
, ps
, can painful if there many nodes check. have ganglia monitoring system set on our clusters, can use ganglia's web interface check various node statistics. might want check system administrators see if have set monitoring.
Comments
Post a Comment