Optimization lies at the heart of deep learning, driving neural networks to discover patterns in vast and complex datasets. Early approaches relied on batch gradient descent, which computes exact ...