https://medium.com/@yaroslavvb/backprop-and-systolic-arrays-24e925d2050

medium post

Medium post. (I'm getting too much comment spam on Blogger, so I'll probably use medium/something else from now on, and just link here)

Some ICLR posters that caught my eye: [larger image] Very simple to implement idea that gives impressive results. They force two groups of units to be uncorrelated by penalizing their cross covariance. When the first group is also forced to model classes, the second group automatically models the "style". The problem if separating out "style" has...

Last week I attended Stochastic Gradient Methods workshop held at UCLA's IPAM . Surprisingly, there's still quite a bit of activity and unsolved questions around what is essentially, minimizing a quadratic function. In 2009 Strohmer and Vershinin rediscovered an algorithm used for solving linear systems of equations from 1970 -- Kaczmarz method, and...

First programmers wrote in machine code and assemblers simplified this task significantly by letting them give algorithms at a higher level. I still find stacks of punch cards like below in my St.Petersburg home Wouldn't it be great if we could extend this idea further and have the computer compile the problem into machine code? Actually, we already...