rectified_linear_unit_function

data

the connection (weight matrix/filter) and the bias

weights


This functions calculates the value and the derivative of a rectified linear
function. Reference Vinod Nair, Geoffrey Hinton, Rectified Linear Units
Improve Restricted Boltzmann Machines


An implementation of deep neural network with rectifier linear units trained
with stochastic gradient descent method and batch normalization. A combination of these methods have
achieved state-of-the-art performance in ImageNet classification by overcoming the gradient saturation
problem experienced by many deep architecture neural network models in the past. In addition,
batch normalization and dropout are implemented as a means of regularization. The deeplearning package is
inspired by the darch package and uses its class DArch.

rectified_linear_unit_function: Rectified Linear Unit Function

Description

Usage

Arguments

Value