darch (version 0.12.0)

weightDecayWeightUpdate: Updates the weight using weight decay.

Description

Multiplies the weights by (1 - weightDecay) before applying the scheduled weight changes.

Usage

weightDecayWeightUpdate(darch, layerIndex, weightsInc, biasesInc, ...,
  weightDecay = getParameter(".darch.weightDecay", 0, darch),
  debug = getParameter(".debug", F, darch))

Arguments

darch

'>DArch instance.

layerIndex

Layer index within the network.

weightsInc

Matrix containing scheduled weight updates from the fine-tuning algorithm.

biasesInc

Bias weight updates.

...

Additional parameters, not used.

weightDecay

Weights are multiplied by (1 - weightDecay) before each update. Corresponds to the darch.weightDecay parameter of darch.default.

debug

Internal debugging flag.

Value

updated weights

See Also

Other weight update functions: maxoutWeightUpdate

Examples

# NOT RUN {
model <- darch(Species ~ ., iris, c(0, 50, 0),
 darch.weightUpdateFunction = "weightDecayWeightUpdate")
# }