backpropagation

Softmax and Cross-Entropy

Deriving the softmax Jacobian and the cross-entropy gradient, and why their composition collapses into prediction minus target.

softmax  cross-entropy  backpropagation  deep-learning

deep-learning

2022-01-20   ·   3 min read