The AI Reader.

mathematical-intuition

collection · 2 published
mathematical-intuition

Every trained model is rolling downhill on a computed slope

Minimizing x² by hand turns “training” concrete: the derivative points downhill, and a single step-size number decides whether the run settles at the bottom or flies apart.

8 min read8 sources
mathematical-intuition

A network's gradient is a product of local slopes chained backward

The slope a network rolls down is the product of the local slopes along its links, traced from the loss back to any weight in a single backward pass.

9 min read8 sources