preTrainDArch

A instance of the class <code><a href="/link/?package=darch&version=0.12.0" darch'="" data-mini-rdoc="darch::"></a>'>DArch</code>.

darch

<code><a href="/link/?package=darch&version=0.12.0" dataset'="" data-mini-rdoc="darch::"></a>'>DataSet</code> to be used for training.

dataSet

<code><a href="/link/?package=darch&version=0.12.0" dataset'="" data-mini-rdoc="darch::"></a>'>DataSet</code> to be used for validation.

dataSetValid

numEpochs

numCD

Numeric indicating after which layer to stop training.

lastLayer

Whether to test pre-trained networks against target data

isClass

Whether to train RBMs consecutively instead of each one
epoch at a time.

consecutive

Additional parameters for the function <code><a rd-options="" href="/link/trainRBM?package=darch&version=0.12.0" data-mini-rdoc="darch::trainRBM">trainRBM</a></code>

This function pre-trains a <code><a href="/link/?package=darch&version=0.12.0" darch'="" data-mini-rdoc="darch::"></a>'>DArch</code> network with the 
contrastive divergence method

internal

The darch package is built on the basis of the code from G. E.
Hinton and R. R. Salakhutdinov (available under Matlab Code for deep belief
nets). This package is for generating neural networks with many layers (deep
architectures) and train them with the method introduced by the publications
"A fast learning algorithm for deep belief nets" (G. E. Hinton, S. Osindero,
Y. W. Teh (2006) <DOI:10.1162/neco.2006.18.7.1527>) and "Reducing the
dimensionality of data with neural networks" (G. E. Hinton, R. R.
Salakhutdinov (2006) <DOI:10.1126/science.1127647>). This method includes a
pre training with the contrastive divergence method published by G.E Hinton
(2002) <DOI:10.1162/089976602760128018> and a fine tuning with common known
training algorithms like backpropagation or conjugate gradients.
Additionally, supervised fine-tuning can be enhanced with maxout and
dropout, two recently developed techniques to improve fine-tuning for deep
learning.

Martin Drees

Package for Deep Architectures and Restricted Boltzmann Machines

preTrainDArch function

A instance of the class <code><a href='<a href='DArch'></a>'>DArch</a></code>.

<code><a href='<a href='DataSet'></a>'>DataSet</a></code> to be used for training.

<code><a href='<a href='DataSet'></a>'>DataSet</a></code> to be used for validation.

Additional parameters for the function <code><a rd-options='' href='trainRBM'>trainRBM</a></code>

This function pre-trains a <code><a href='<a href='DArch'></a>'>DArch</a></code> network with the 
contrastive divergence method

preTrainDArch: Pre-trains a `'>DArch` network

Description

Usage

Arguments

Value

Details

See Also