Le grand encyclopedia
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z LINKS
A
Artificial intelligence Artificial intelligence is the kind of intelligence that scientist has developed in computers. One of the ways of achieving AI is by using neural networks. These neural networks are very much inspiret of the way they imagine our own brain works. Though we think we have quite a good idea on which processes goes on inside our brains, nobody really knows why we are able to think the thoughts we do, and solve these abstract problems we are daily presented to. Some people think the answer lies with the compleksity of our brain, so the scientists are far from actually creating intelligence at hight with human's, because the human is so incredible complicated.

More information at:

http://search.britannica.com/search?query=artificial+intelligence
The britannica entry on artificial intelligence

Axon The Axon is used by the neuron to send out electrical signals to other neurons. The axon can be anything from a few millimetres to metres in length. The Axon uses the sodium/potassium pump to generate these electrical signals. Below is a flash showing the transportation of signals in an axon.

More information at:

http://search.britannica.com/search?query=axon
The britannica entry on axons

Array In programming an array is a set of variables, indexed by a pointer.
Algorithm A process or set of rules that are used for calculation or problem solving. In computer-science algorithms are frequently used to make a step-by-step solving of difficult problems. The algorithm could for example guide one through a simple equation by telling one which numbers to divide or multipli with, and when to do what.

More information at:

http://www.cs.bgu.ac.il/~omri/NNUGA/
Neural Networks using genetic algorithms

http://www.cis.upenn.edu/~wilf/AlgComp.html
A book about algorithms that can be downloaded in .ps format.

http://search.britannica.com/search?query=algorithm
The britannica entry on algorithms.

B
Back-propagation Sending data back through the system, checking if the output matches the wanted. Actually back-probagation learning is a very logical way of learning, sometimes humans also have the need to look back to see if where we are, is actually the place we were suposed to be.

More information at:

http://www.bham.ae.uk/EAA/eaa96/abstracts/244.htm
Here back-probagation was used to investigate some very cool stuff, the problem was very abstract, so it was very relevant to use back-probagation

http://www.dontveter.com/bpr/bpr.html
Easy understanable material about back-probagation

C
D
Dendrite The neuron uses the dendrite to recieve electrical signals from other neurons. The dendrite is only a small surface that is able to percept when the small bags of neurohormone is send there,

E
F
Feed-forward The feed-forward network only feeds information (signals) forward in the network. This disables the network from the option of back-probagation.

More information at:

http://www.md.huji.ac.il/physiology-course/bio-lec2/sld006.htm
How the body uses feed-forward to operate muscles

http://www.robotic.dlr.de/~smagt/research/feed-forward/
This is an explenation of the advantages when using feed-forward networks.

Firing pattern In the cerebral cortex, billions of neurons interact with each other to make the mind work. At certain stages the neurons form a firing pattern. When a pattern has been learnt, the brain can recall certain firing patterns that matches the given input eg. speech, looks or a smell.
G
H
I
J
K
L
Linear combiner The linear combiner is the core of an artificial neuron. It is used to sum up all the synaptic input signals and weights. The ways of the calculation will be explained to you, under the "sum-function" section.
M
Multi-Layer Perception In order to make a network able to solve more complex problems, one can be forced to expand the network with several layers. Only the layers where computing processes takes place is counted in. Ofcourse "multi" only means that there are several of them.

More information at:

http://jnns-www.okabe.rcast.u-tokyo.ac.jp/publications.html
This is an introduction in multilayer perception, by Okabe laboratory

http://www.iee.org.uk/puplish/books/knowdisp.html
This is a list of possible purposes for this kind of nn.

Matrix A matrix is a set of scalars ordered like in a spreadsheet. A NxM matrix is a matrix consisting of m rows and n columns.

More information at:

http://search.britannica.com/search?query=matrix
The britannica entry on matrix.

N
Neurohormone A hormone produced by nervecells and secreted into the circulation. The nurohormones is also the link between the different neurons in the brain. When the Axon generates an electrical signal, it stimulates small bags of neurohormone to be sent over the gap between the neurons (the synapse) These bags will carry the signal generated by the Axon to the recieving neuron.

More information at:

http://psych-www.colorado.edu/user/PSYC4092/httable.html
This is a guide to help you to determin some of the different kinds of neurohormones.

http://search.britannica.com/search?query=neurohormone
The britannica entry on neurohormones

http://www.letsfindout.com/subjects/body/rfilocke.html
Encyclopedia description of neurotransmitters

Non-linear This is a function that has too many factors to be computed using linear mathematics. This is the reason why we as humans concider ourselves so extraordinary, the ability to solve non-linear problems. A non-linear problem is a problem that is so abstract that it can not be solved by a computer, for example emotional problems, there are simply too many factors for a computer to process. We still seek to make artificial neural networks able to solve these problems, but in order to do that, we must first know how it is we do it ourselves.
Neurologist A scientist who works with the processes inside the brain, and the rest of the nervous system. Everything we know today about our own brain and it's functions, we know because of the research made by neurologists.

Want to go online with a neurologist?:

http://www.eastnc2.coastalnet.com/~cn3877/

Neuron The basic building block in the brain and in a artificial neural network. The neuron consists of several dendrites that recieves information from other neurons. These signals are led to the core, where it determins whether or not to send out a signal through the axon.
A neuron

More information at:

http://search.britannica.com/search?query=neuron
The britannica entry on neurons.

O
Object-oriented Object-oriented programming is a way of making objects containing their own code, variables and routines. In object-oriented programming the programmer doesn't have to know about the internals of the object, but only an object interface.
P
Perceptron perception is the process in which sensory stimulation is made into useful experience. Humans use perception as well, When we recieves data from our eyes, in form of flashing light, we can translate it into motion and all the things we see. A perceptron is simply a systen that performs this action.

More information at:

http://www.cs.bgu.ac.il/~omri/perceptron/
this is a site that will teach you the basics about perceptrons.

http;//www.home.cc.umanitoba.ca/~umcorbe9/perceptron.html
this is a learning applet which can teach you something about the way of the perceptron.

http://ei.cs.vt.edu/~history/Perceptrons.Estebon.html
Quick explanation of the perceptron.

Parallel The term parallel is used in computer science when more than one piece of information is transfered simultaneously. Usually this is much more efficient than working serial.
Q
R
Recurrent neural network Recurrent neural networks is a network having one or more neurons that feeds data back into the network, so that they can alter their own input. This is ofcourse used when there is somthing wrong with the total output of the system
S
Sigmoid This is a function that is curved like the uncial "sigma". "Sigma is a letter in the ancient Greek alphabet. The function is smooth around 0 to 1 on the y-axis, when the x-value is close to 0.

More information at:

http;//mathworld.wolfram.com/SigmoidFunction.html
An introduction in the Sigmoid function.

Single layer perceptron A single layer perceptron actually consists of two layers of neurons, the input layer and the computational layer. The reason why to call it a single layered network is that it is only in the last layer that computation is performed.
Synapse Between the neurons transmitters and recievers, there is a small gap. In order to pass this gap, the electrical signals causes small bags, containing a neurohormone, to be releasesd and send to the recieving neuron. The synaptical strength depends on how many signals is send to one neuron. The signal may be send from many different transmitting neurons.

More information at:

http://www.letsfindout.com/subjects/body/rfisynap.html
Encyclopedia description of the synapse.

http://search.britannica.com/search?query=synapse
Britannica entry of synapse

Synaptical strengths Synaptic strengths refers to the influence a synapse has on the neuron, it can either inhibit (excite) the neuron or exhibit (de-excite) the neuron. The outcome is determined by the synaptical strength. If sufficient neurons transmits a signal to one neuron, the synaptical strength will be high enough to excite the neuron, and it will send the signal on to the next neuron in the pattern. The level of synaptical strength needed to excite the neuron is determined by which part it takes in the paticular firing pattern.
Sum function The sum function can best be described using a flash-animation

Sodium/potasium pump These two materials have a great importance in the neurological processes, using a dimorph cell membrane they are responsible for producing the electrical signals between the neurons.

More information at:

http://www.rit.edu/~has7647/nacl.html
A brief explanation of the sodium potassium pump

Scalar A scalar represents any number.

More information at:

No further information available

Serial Serial processing means that only one piece of data is processed at any one time. The one piece of information has to be processed before a new piece of information can be processed. Nice word "processed"...
T
Tangent hyperbolic This function is smooth like the sigmoid, but goes from -1 to 1 on the y-axis, instead of 0 to 1.

More information at:

http://www.r2.uni-frankfurt.de/~andreas/ta.htm
This is a report from a german university, who have used these functions to simulate some temperature variations.

U
V
Vector A vector is an array of scalars. a two dimensional vector contains two scalars, a three-dimensional 3, and so on.

More information at:

http://search.britannica.com/search?query=vector
The britannica entry on vectors

W
X
XOR XOR, or exclusive or, is a binary function giving these results.
00 = 0
10 = 1
01 = 1
11 = 0

More information at:

No further information available

Z
LINKS
http://members.home.net/neuralnet/
A geometry approach on neural networks

http://www.aist.go.jp/NIBH/~b0616/Lab/BSOM1/index.html
Fun self organizing neural network

http://neuron.eng.wayne.edu/index.html
A collection of many neural network applets and links

http://www.aist.go.jp/NIBH/~b0616/Lab/Links.html
A collection of neural network links

http://esewww.essex.ac.uk/~sml/
Neural networks used in various applications

http://members.aol.com/Trane64/java/JRec.html
Java applet implementing pattern recognition

http://www.neuroinformatik.ruhr-uni-bochum.de/ini/VDM/research/gsn/DemoGNG/GNG.html
Different modes of competitive learning

http://neuron.eng.wayne.edu/bpFunctionApprox/bpFunctionApprox.html
Function approximation applet

http://www.geocities.com/CapeCanaveral/1624/
Neural network programs for newcomers

http://www.shef.ac.uk/psychology/gurney/notes/contents.html
Online Neural Network thesis

http://www.cs.bgu.ac.il/~omri/Perceptron/
Perceptron code for unix, linux and any platform supporting Tk

http://www.cs.bgu.ac.il/~omri/NNUGA/
Neural Network Using Genetic Algorithms for use with unix

http://esontag.hypermart.net/neuralnets.html#Onlinebooks
Links to free online neural network books

ftp://ftp.sas.com/pub/neural/FAQ.html
The neural network FAQ

http://www.cs.stir.ac.uk/~lss/NNIntro/InvSlides.html
Brief introduction to neural networks

http://www.dontveter.com/bpr/bpr.html
A backpropagation FAQ containing many links to articles

http://www.statsoft.com/textbook/stathome.html
Big statistics homepage containing a lot of text regarding neural networks

http://www.enm.bris.ac.uk/research/neural/sites.html
A collection of good neural network information.

http://www.generation5.org
Another thinkquest entry about AI