Understanding the Mathematics behind Gradient Descent
ModelingStatisticsGradient Descentmathematicsposted by Parul Pandey September 21, 2021
“Premature optimization is the root of all evil.” ― Donald Ervin Knuth Agile is a pretty well-known term in the software development process. The basic idea behind it is simple: build something quickly ➡️ get it out there ➡️ get some feedback ➡️ make changes depending upon... Read more
Understanding the 3 Primary Types of Gradient Descent
ModelingBatch Gradient DescentGradient DescentMini Batch Gradient DescentStochastic Gradient Descentposted by Daniel Gutierrez, ODSC November 28, 2018
Understanding Gradient descent is important because it’s the most commonly used optimization method deployed in machine learning and deep learning algorithms. It’s used to train a machine learning model and is based on a convex function. Through an iterative process, gradient descent refines a set of... Read more