Dot Products Power Every Layer
How a weighted sum becomes a neuron's output.
The Humble Dot Product
Strip a neural network down and you find one move repeated: the dot product, a sum of paired multiplications between two vectors.
Multiply, Then Add
A dot product multiplies each input by its matching weight, then adds the results into a single number. That number is the neuron speaking.
score = (x * w).sum() # or x @ wAll lessons in this course
- Why Loops Are Slow for Math
- Elementwise Ops & Reductions
- Matrix Multiply with matmul and @
- Dot Products Power Every Layer