Suppose we have m 2 inputs and N neurons on a hidden layer, so F(x, y) is a linear combination of N ReLU's. Write out th
Posted: Wed May 11, 2022 9:51 am
Suppose we have m 2 inputs and N neurons on a hidden layer, so F(x, y) is a linear combination of N ReLU's. Write out the formula for r(N, 2) to show that the count of linear pieces of F has leading term {N2.