logsumexp

A numerically stable function for computing log of a sum of exponentials. Available as torch.logsumexp and scipy.special.logsumexp. The building block of softmax, log_softmax, and almost every probabilistic loss.