This document describes a new simple gradient descent optimizer which is a potential replacement or supplement for RegularStepGradientDescentOptimizer. The optimizer requires only the gradient of the parameters and uses a simple linear model internally. [...]