We show that neural networks allow us to formulate gradients for a property that is traditionally not differentiable and that these gradients allow us to formulate new optimization algorithms.