Žiga Sajovic: Operational Calculus for Differentiable Programming

Abstract: In this talk we will present a theoretical model for differentiable programming. We will present an algebraic language that encapsulates formal semantics of differentiable programs by way of Operational Calculus. The algebraic nature of Operational Calculus can alter the properties of the programs that are expressed within the language and transform them into their solutions.

We will demonstrate the models usefulness in differentiable programming by using it to express fractional iterations and their iterating velocities, and solve the special case of ReduceSum.