makeClusterFunctionsMulticore

Jobs are spawned asynchronously using the functions <code>mcparallel</code> and <code>mccollect</code> (both in parallel).
Does not work on Windows, use <code>makeClusterFunctionsSocket</code> instead.

As a successor of the packages 'BatchJobs' and 'BatchExperiments',
this package provides a parallel implementation of the Map function for high
performance computing systems managed by schedulers 'IBM Spectrum LSF'
(<https://www.ibm.com/products/hpc-workload-management>),
'OpenLava' (<https://www.openlava.org/>), 'Univa Grid Engine'/'Oracle Grid
Engine' (<https://www.univa.com/>), 'Slurm' (<https://slurm.schedmd.com/>),
'TORQUE/PBS'
(<https://adaptivecomputing.com/cherry-services/torque-resource-manager/>),
or 'Docker Swarm' (<https://docs.docker.com/engine/swarm/>).
A multicore and socket mode allow the parallelization on a local machines,
and multiple machines can be hooked up via SSH to create a makeshift
cluster. Moreover, the package provides an abstraction mechanism to define
large-scale computer experiments in a well-organized and reproducible way.

Michel Lang

batchtools

Tools for Computation on Batch Systems

Bernd Bischl

Dirk Surmann

makeClusterFunctionsMulticore function

<dl><dt>ncpus</dt>
<dd>[<code>integer(1)</code>] 
Number of CPUs.
Default is to use all logical cores. The total number of cores "available" can be set via the option <code>mc.cores</code>
and defaults to the heuristic implemented in <code><a href="/link/detectCores?package=batchtools&version=0.9.17" data-mini-rdoc="batchtools::detectCores">detectCores</a></code>.</dd>
<dt>fs.latency</dt>
<dd>[<code>numeric(1)</code>] 
Expected maximum latency of the file system, in seconds.
Set to a positive number for network file systems like NFS which enables more robust (but also more expensive) mechanisms to
access files and directories.
Usually safe to set to <code>0</code> to disable the heuristic, e.g. if you are working on a local file system.</dd></dl>

Arguments

ClusterFunctions for Parallel Multicore Execution — makeClusterFunctionsMulticore

<dl>

<dt>ncpus</dt>
<dd>[<code>integer(1)</code>] 
Number of CPUs.
Default is to use all logical cores. The total number of cores "available" can be set via the option <code>mc.cores</code>
and defaults to the heuristic implemented in <code><a href='https://rdrr.io/r/parallel/detectCores.html'>detectCores</a></code>.</dd>


<dt>fs.latency</dt>
<dd>[<code>numeric(1)</code>] 
Expected maximum latency of the file system, in seconds.
Set to a positive number for network file systems like NFS which enables more robust (but also more expensive) mechanisms to
access files and directories.
Usually safe to set to <code>0</code> to disable the heuristic, e.g. if you are working on a local file system.</dd>

</dl>

makeClusterFunctionsMulticore: ClusterFunctions for Parallel Multicore Execution

Description

Usage

Value

Arguments

See Also