Performance comparison of gradient descent (GD) and stochastic gradient descent (SGD) method on MNIST dataset
Does SGD perform better than GD? Read out more to see its effect on MNIST dataset
Read More
Tag: gradient-descent
Convergence of gradient descent for smooth strongly convex case
Dive into mathematical analysis for convergence of gradient descent. Read more to find out!
Read More
Convergence of gradient descent for smooth and convex case
We provided the proof of convergence of gradient descent algorithm for smooth and nonconvex case...
Read More
Convergence of Gradient Descent for Smooth and Nonconvex Case
We introduce the basics of gradient descent and its python implementation with convergence for a...
Read More
Unraveling the Gradient Descent Algorithm: A Step-by-Step Guide
Introduction The gradient descent algorithm is an optimization technique used to find the minimum...
Read More