batchMapQuick: Combination of makeRegistry, batchMap and submitJobs.

Description

Combination of makeRegistry, batchMap and submitJobs for quick computations on the cluster. Should only be used by skilled users who know what they are doing. Creates the file.dir, maps function, potentially chunks jobs and submits them.

Usage

batchMapQuick(
  fun,
  ...,
  more.args = list(),
  file.dir = NULL,
  packages = character(0L),
  chunk.size,
  n.chunks,
  chunks.as.arrayjobs = FALSE,
  inds,
  resources = list()
)

Arguments

fun

[function] Function to map over ....

...

[any] Arguments to vectorize over (list or vector).

more.args

[list] A list of other arguments passed to fun. Default is empty list.

file.dir

[character] See makeRegistry. Default is NULL, which means that it is created in the current directory under the name “bmq_[random alphanumerics]”.

packages

[character] See makeRegistry.

chunk.size

[integer(1)] Preferred number of jobs in each chunk. Can not be used in combination with n.chunks. Note that the ids will get shuffled to balance out possible run time differences. Default is not to use chunking.

n.chunks

[integer(1)] Preferred number chunks. Can not be used in combination with chunk.size. Note that the ids will get shuffled to balance out possible run time differences. Default is not to use chunking.

chunks.as.arrayjobs

[logical(1)] Submit chunks as array jobs? Default is FALSE.

inds

[integer] Indices of ids / chunks to submit. Default is all. If ids get chunked, this subsets the list of shuffled ids.

resources

[list] Required resources for all batch jobs. Default is empty list.

Value

[Registry]