A measure of the difference between two probability density functions (f and g, say) taking non-zero values on the same interval (a, b). Usually denoted by I, where
It is also called the ‘information in favour of f ’. An equivalent expression holds for the comparison of two discrete distributions. The measure was introduced in 1951 by Kullback and Leibler. See also Bhattacharya distance; Hellinger distance.
- hypogene
- hypoglycaemia
- hypogyny
- hypolimnion
- hyponome
- hyponomic sinus
- hypophosphorus acid
- hypophysis
- hypopycnal flow
- hyporheic zone
- hypostasis
- hypostatic union
- hypostomal suture
- hypostratotype
- hyposulphite
- hyposulphurous acid
- hypotenuse
- hypothalamus
- hypotheca
- hypothecation
- hypothermal
- hypothesis
- hypothesis test
- hypothesis testing
- hypothetical