darch (version 0.12.0)

exponentialLinearUnit: Exponential linear unit (ELU) function with unit derivatives.

Description

The function calculates the activation of the units and returns a list, in which the first entry is the exponential linear activation of the units and the second entry is the derivative of the transfer function.

Usage

exponentialLinearUnit(input, alpha = getParameter(".darch.elu.alpha", 1, ...),
  ...)

Arguments

input

Input for the activation function.

alpha

ELU hyperparameter.

...

Additional parameters.

Value

A list with the ELU activation in the first entry and the derivative of the activation in the second entry.

References

Clevert, Djork-Arne, Thomas Unterthiner, and Sepp Hochreiter (2015). "Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)". In: CoRR abs/1511.07289. URL : http://arxiv.org/abs/1511.07289

See Also

Other darch unit functions: linearUnit, maxoutUnit, rectifiedLinearUnit, sigmoidUnit, softmaxUnit, softplusUnit, tanhUnit

Examples

# NOT RUN {
data(iris)
model <- darch(Species ~ ., iris, darch.unitFunction = "exponentialLinearUnit",
 darch.elu.alpha = 2)
# }