An example showing that this is this a bad measure of the error is:![]()
wjk yj
is:
wjk yj
wjk
yj
y = ς(x) = 1 / ( 1 + e-x )How would you make it less step-like (more linear)?
a x + b y = cDefine a perceptron that receives x and y as input and fires if and only if the point is on this side of the line:
a x + b y ≤ c
Then for any individual output node k,![]()
is:
yk (1-yk)
(yk-Ok)
be the change in error as we change a weight. Let c be a positive constant. Then a rule to reduce error would be:
a x - b y ≤ -c
Initialise with 100 random solutions.
Repeat forever
{
Pick the best 99.
Pick one at random to duplicate so we keep size 100.
Make small or no changes to the 100.
Repeat.
}
What can we say about this algorithm:
y = ς(x) = 1 / ( 1 + e-x )How would you make it more step-like (more like a sudden threshold)?
Seat No:_____________________
|