A very strong relationship between the directed Kullback divergence and the likelihood function emerges simply and naturally in the context of exponential families.The directed Kullback divergence is an information-theoretic measure of the distance from one distribution to another.