Entropy and mutual information of the conditional independence model

Abstract EN

In this paper, we introduce the conditional independence model that included three elements every element is called conditional independence statement, or sometimes called network, those networks are defined by discrete random variables, we prove the conditional entropy function of the every element from this model.

We also prove the conditional mutual information for every network, throughout mesure the distance between the joint conditional probability density function and conditional probability density functions for every element in this model.