https://medium.com/@yaroslavvb/backprop-and-systolic-arrays-24e925d2050

medium post

Medium post. (I'm getting too much comment spam on Blogger, so I'll probably use medium/something else from now on, and just link here)

Last week I attended Stochastic Gradient Methods workshop held at UCLA's IPAM . Surprisingly, there's still quite a bit of activity and unsolved questions around what is essentially, minimizing a quadratic function. In 2009 Strohmer and Vershinin rediscovered an algorithm used for solving linear systems of equations from 1970 -- Kaczmarz method, and...

First programmers wrote in machine code and assemblers simplified this task significantly by letting them give algorithms at a higher level. I still find stacks of punch cards like below in my St.Petersburg home Wouldn't it be great if we could extend this idea further and have the computer compile the problem into machine code? Actually, we already...

$$x_2+y_2$$