Preface
Natural NN's
NN History
Artificial NN's
Types of NN's
Programming NN's
  1 2 3 4 5 6 7

The activation function

The activation function can be many types and is normally included in a function. Here the implementations of the threshold, piecewise linear and sigmoid activation function are shown.

	Threshold		Piecewise linear
	Sigmoid