Assume we have the following neural network and all activation functions are $f(z)=z$. If the weights are initialized with the values you see in table below, what will be new updated weights after one step if learning rate, $\alpha = 0.05$?
Assume the input values are [$i_1$,$i_2$] = [2,3] and target value $out = 1$.
Hint:
$w_{new} = w_{old} - \alpha \frac{\partial E}{\partial w}$
$E_{\text {total}}=\sum \frac{1}{2}(\text {target}-\text {output})^{2}$
Updating weights in backpropagation algorithm
| Weights |
Initialization |
New weights after one step |
| $w1$ |
0.11 |
? |
| $w2$ |
0.21 |
? |
| $w3$ |
0.12 |
? |
| $w4$ |
0.08 |
? |
| $w5$ |
0.14 |
? |
| $w6$ |
0.15 |
? |
