See also:

  • Compilers note - especially polyhedral computation section

bring your own codegen BYOC Chen 2021 halide tvm pytorch ilang egraph for equivalent patterns ? no that’s not what he’s saying glenside

flexasr hlscnn vta

im2col tvm polyhedral glesnide tiramius?

pytorch and tensorflow have irs probably too mxnet apahce tvm and mxnet. Huh glow? polyhedral

The deep learning compiler a comprehensive survey xla ngraph TC

Julia has its own thing going on probably tvm mlir

egraphs useful for finding BIG patterns ad tapinade - low level imlet

Automatic Differentiation Handbook.

Systematically Differentiating Parametric Discontinuities - gilbert

A simple differentiable programming language - Abadi and plotkin


class Value():
    def __init__(self, value):
        self.value = value
        self.grad = 0
        self.backward = lambda (): None
    def __add__(self,x):
        r = Value(self.value + x.value)
        def backward():
            self.grad += r.grad
            x.grad += r.grad
        r.backward = 
    def __mul__(self,x):

x = Value(2)
e = x * x