开发者

Should an input layer include a bias neuron?

开发者 https://www.devze.com 2023-04-01 18:16 出处:网络
I was wondering: in a multi-layer feed-forward ne开发者_开发问答ural network should the input layer include a bias neuron, or this is just useful in hidden layers? If so, why?No, an input layer doesn\

I was wondering: in a multi-layer feed-forward ne开发者_开发问答ural network should the input layer include a bias neuron, or this is just useful in hidden layers? If so, why?


No, an input layer doesn't need a connection to the bias neuron, since any activation it received from the bias neuron would be completely overridden by the actual input.

For example, imagine a network that's trying to solve the classic XOR problem, using this architecture (where the neuron just marked 1 is the bias):

Should an input layer include a bias neuron?

To run this network on input (1,0), you simply clamp the activation of neurons X1=1 and X2=0. Now, if X1 or X2 had also received input from the bias, then that input would be overridden anyways, thus making such a connection pointless.

0

精彩评论

暂无评论...
验证码 换一张
取 消