Forward and Reverse Mode Differentiation

Summary Methods to efficiently compute gradients are important as gradients underpin the training of machine learning models. In this article, we will compare forward and backwa...