For a random A and b (20 by 4 and 20 by 1), try stochastic gradient descent with minibatch sizes B = 1 and B = 2. Compar
Posted: Thu May 12, 2022 12:18 pm
For a random A and b (20 by 4 and 20 by 1), try stochastic
gradient descent with minibatch sizes B = 1 and B = 2. Compare the
convergence rates- theratiosrk = llxk+l-x*ll/llxk -x*ll·
(Experiment) For a random A and b (20 by 4 and 20 by 1), try stochastic gradient descent with minibatch sizes B = 1 and B = 2. Compare the convergence rates- the ratios tk = ||2k+1 – 2*ll/||2k - 2*||- =
gradient descent with minibatch sizes B = 1 and B = 2. Compare the
convergence rates- theratiosrk = llxk+l-x*ll/llxk -x*ll·
(Experiment) For a random A and b (20 by 4 and 20 by 1), try stochastic gradient descent with minibatch sizes B = 1 and B = 2. Compare the convergence rates- the ratios tk = ||2k+1 – 2*ll/||2k - 2*||- =