Information about Adaline

ADALINE (Adaptive Linear Neuron or later Adaptive Linear Element) is a single layer neural network. It was developed by Professor Bernard Widrow and his graduate student Ted Hoff at Stanford University in 1960. It is based on the McCulloch-Pitts neuron. It consists of a weight, a bias and a summation function.

Enlarge picture
Learning inside a single layer ADALINE

Definition

Adaline is a single layer neural network with multiple nodes where each node accepts multiple inputs and generates one output. Given the following variables:
  • x is the input vector
  • w is the weight vector
  • n is the number of nodes
  • some constant
  • y is the output
then we find that the output is . If we further assume that
then the output reduces to the dot product of x and w

Learning Algorithm

Let us assume:
  • is the learning rate (some constant)
  • d is the desired output
  • o is the actual output
then the weights are updated as follows . The ADALINE converges to the least squares error which is . For a more comprehensive proof, see Adaline (Adaptive Linear)

Bibliography

Delta Learning Rule: ADALINE
Adaline (Adaptive Linear)
Perceptron and ADALINE
Traditionally, the term neural network had been used to refer to a network or circuitry of biological neurons. The modern usage of the term often refers to artificial neural networks, which are composed of artificial neurons or nodes.
..... Click the link for more information.
Bernard Widrow (born December 24, 1929) is a U.S. professor of electrical engineering at Stanford University. He is the co-inventor of the Widrow-Hoff Least Mean Squares (LMS) adaptive algorithm with his then doctoral student Ted Hoff.
..... Click the link for more information.
Dr. Marcian Edward "Ted" Hoff Jr. (born October 28, 1937 in Rochester, New York), is one of the inventors of the microprocessor. Hoff, an engineer, joined Intel in 1968 as employee number 12, and is credited with coming up with the idea of a universal processor instead of
..... Click the link for more information.
Leland Stanford Junior University, commonly known as Stanford University or simply Stanford, is a private university located approximately 37 miles (60 kilometers) southeast of San Francisco and approximately 20 miles (32 km) northwest of San Jose in Stanford,
..... Click the link for more information.
19th century - 20th century - 21st century
1930s  1940s  1950s  - 1960s -  1970s  1980s  1990s
1957 1958 1959 - 1960 - 1961 1962 1963

Year 1960 (MCMLX
..... Click the link for more information.
An artificial neuron, also called semi-linear unit, Nv neuron, binary neuron or McCulloch-Pitts neuron, is an abstraction of biological neurons and the basic unit in an artificial neural network.
..... Click the link for more information.


This article is copied from an article on Wikipedia.org - the free encyclopedia created and edited by online user community. The text was not checked or edited by anyone on our staff. Although the vast majority of the wikipedia encyclopedia articles provide accurate and timely information please do not assume the accuracy of any particular article. This article is distributed under the terms of GNU Free Documentation License.
Herod_Archelaus


page counter