torch (version 0.8.1)

nnf_selu: Selu

Description

Applies element-wise, $$SELU(x)=scale\ast (max(0,x)+min(0,\alpha \ast (exp(x)-1)))$$, with $\alpha =1.6732632423543772848170429916717$ and $scale=1.0507009873554804934193349852946$.

Usage

nnf_selu(input, inplace = FALSE)
nnf_selu_(input)

Arguments

input

(N,*) tensor, where * means, any number of additional dimensions

inplace

can optionally do the operation in-place. Default: FALSE

Examples

if (torch_is_installed()) {
x <- torch_randn(2, 2)
y <- nnf_selu(x)
nnf_selu_(x)
torch_equal(x, y)
}