深度學習優化方法

優化方法 1、梯度下降（Gradient Descent） A variant of this is Stochastic Gradient Descent (SGD), which is equivalent to mini-batch gradient descent where each mini-batch has just 1 example. The update rule that

>>阅读原文<<