ディープラーニングの最適化（Momentum、RMSprop、AdaGrad、Adam）

Deep Learning: Loss and Optimization - Part 2 (WS 20/21)

Gradient Descent in 3 minutes

OAMLS -- Deep Learning Theory and Optimization Part 1 -- Taiji Suzuki

Deep Reinforcement Learning for Exact Combinatorial Optimization: Learning to Branch

Deep Learning - Lecture 6.2 (Optimization: Optimization Algorithms)

2. Optimization Problems

Optimization vs Loss function | Convex Optimization

On Deep Learning by Ian Goodfellow et al: Optimization for Training Deep Models | Chapter 8

Adam最適化アルゴリズム（C2W2L08）

局所最適問題（C2W3L10）

Deep Learning - Lecture 6.1 (Optimization: Optimization Challenges)

ニューラルネットワーク向けトップオプティマイザー

Jorge Nocedal: "Tutorial on Optimization Methods for Machine Learning, Pt. 1"

Deep Learning 4 - Optimization Methods

Metaheuristic optimization for artificial neural networks and deep learning architectures - Pagano

Deep Learning in Robust Optimization

1. Introduction, Optimization Problems (MIT 6.0002 Intro to Computational Thinking and Data Science)

Optimizers in Deep Learning | Part 1 | Complete Deep Learning Course

Optimization of Deep Models | Lecture 6 | Deep Learning