Conductor of an abelian variety: Difference between revisions

From formulasearchengine
Jump to navigation Jump to search
← Older edit
en>Uni.Liu
en>David Eppstein
add another section heading and unstub
 
Line 1: Line 1:
In [[probability theory]], and in particular, [[information theory]], the '''conditional mutual information''' is, in its most basic form, the [[expected value]] of the [[mutual information]] of two random variables given the value of a third.


==Definition==
For discrete random variables <math>X,</math> <math>Y,</math> and <math>Z,</math> we define
:<math>I(X;Y|Z) = \mathbb E_Z \big(I(X;Y)|Z\big)
    = \sum_{z\in Z} p_Z(z) \sum_{y\in Y} \sum_{x\in X}
      p_{X,Y|Z}(x,y|z) \log \frac{p_{X,Y|Z}(x,y|z)}{p_{X|Z}(x|z)p_{Y|Z}(y|z)},</math>
where the marginal, joint, and/or conditional [[probability mass function]]s are denoted by <math>p</math> with the appropriate subscript. This can be simplified as
:<math>I(X;Y|Z) = \sum_{z\in Z} \sum_{y\in Y} \sum_{x\in X}
      p_{X,Y,Z}(x,y,z) \log \frac{p_Z(z)p_{X,Y,Z}(x,y,z)}{p_{X,Z}(x,z)p_{Y,Z}(y,z)}.</math>
Alternatively, we may write<ref>K. Makarychev et al. ''A new class of non-Shannon-type inequalities for entropies.'' Communications in Information and Systems, Vol. 2, No. 2, pp. 147&ndash;166, December 2002 [http://www.cs.princeton.edu/~ymakaryc/papers/nonshann.pdf PDF]</ref>
:<math>I(X;Y|Z) = H(X,Z) + H(Y,Z) - H(X,Y,Z) - H(Z)
                = H(X|Z) - H(X|Y,Z)</math>
This can be rewritten to show its relationship to mutual information
:<math>I(X;Y|Z) = I(X;Y,Z) - I(X;Z)</math>
usually rearranged as '''the chain rule for mutual information'''
:<math>I(X;Y,Z) = I(X;Z) + I(X;Y|Z)</math>
Another equivalent form of the above is
:<math>I(X;Y|Z) = H(Z|X) + H(X) + H(Z|Y) + H(Y) - H(Z|X,Y) - H(X,Y) - H(Z)
                = I(X;Y) + H(Z|X) + H(Z|Y) - H(Z|X,Y) - H(Z)</math>


Conditioning on a third random variable may either increase or decrease the mutual information: that is, the difference <math>I(X;Y|Z) - I(X;Y)</math>, called the [[interaction information]], may be positive, negative, or zero, but it is always true that
If you present photography effectively, it helps you look much more properly at the globe around you. Offshore expert Word - Press developers high level of interactivity, accessibility, functionality and usability of our website can add custom online to using. * A community forum for debate of the product together with some other customers in the comments spot. They found out all the possible information about bringing up your baby and save money at the same time. You can customize the appearance with PSD to Word - Press conversion ''. <br><br>These folders as well as files have to copied and the saved. After all, Word - Press is free, many of the enhancements for Word - Press like themes and plugins are also free, and there is plenty of free information online about how to use Word - Press.  If you have any concerns concerning wherever and how to use [http://2am.eu/wordpressdropboxbackup627022 backup plugin], you can call us at our own website. You are able to set them within your theme options and so they aid the search engine to get a suitable title and description for the pages that get indexed by Google. It primarily lays emphasis on improving the search engine results of your website whenever a related query is typed in the search box. Once you've installed the program you can quickly begin by adding content and editing it with features such as bullet pointing, text alignment and effects without having to do all the coding yourself. <br><br>Just ensure that you hire experienced Word - Press CMS developer who is experienced enough to perform the task of Word - Press customization to get optimum benefits of Word - Press CMS. But if you are not willing to choose cost to the detriment of quality, originality and higher returns, then go for a self-hosted wordpress blog and increase the presence of your business in this new digital age. I hope this short Plugin Dynamo Review will assist you to differentiate whether Plugin Dynamo is Scam or a Genuine. You or your web designer can customize it as per your specific needs. For any web design and development assignment, this is definitely one of the key concerns, specifically for online retail outlets as well as e-commerce websites. <br><br>A built-in widget which allows you to embed quickly video from popular websites. I didn't straight consider near it solon than one distance, I got the Popup Ascendancy plugin and it's up and lengthways, likely you make seen it today when you visited our blog, and I yet customize it to fit our Thesis Wound which gives it a rattling uncomparable visage and search than any different popup you know seen before on any added journal, I hump arrogated asset of one of it's quatern themes to make our own. When we talk about functional suitability, Word - Press proves itself as one of the strongest contestant among its other rivals. The most important plugins you will need are All-in-One SEO Pack, some social bookmarking plugin, a Feedburner plugin and an RSS sign up button. Look for experience: When you are searching for a Word - Press developer you should always look at their experience level. <br><br>Someone with a basic knowledge of setting up a website should be able to complete the process in a couple of minutes however even basic users should find they are able to complete the installation in around 20 minutes by following the step by step guide online. Here's a list of some exciting Word - Press features that have created waves in the web development industry:. While deciding couple should consider the expertise of the doctor,clinics success rate,the costs of fertility treatment,including fertility tests and IVF costs and overall ones own financial budget. And, it is better that you leave it on for the duration you are writing plugin code. Your topic is going to be the basis of your site's name.
:<math>I(X;Y|Z) \ge 0</math>
for discrete, jointly distributed random variables ''X'', ''Y'', ''Z''. This result has been used as a basic building block for proving other [[inequalities in information theory]], in particular, those known as Shannon-type inequalities.
 
Like mutual information, conditional mutual information can be expressed as a [[Kullback-Leibler divergence]]:
 
:<math> I(X;Y|Z) = D_{\mathrm{KL}}[ p(X,Y,Z) \| p(X|Z)p(Y|Z)p(Z) ]. </math>
 
Or as an expected value of simpler Kullback-Leibler divergences:
:<math> I(X;Y|Z) = \sum_{z \in Z} p( Z=z ) D_{\mathrm{KL}}[ p(X,Y|z) \| p(X|z)p(Y|z) ], </math>
:<math> I(X;Y|Z) = \sum_{y \in Y} p( Y=y ) D_{\mathrm{KL}}[ p(X,Z|y) \| p(X|Z)p(Z|y) ]. </math>
 
==More general definition==
A more general definition of conditional mutual information, applicable to random variables with continuous or other arbitrary distributions, will depend on the concept of '''[[regular conditional probability]]'''.  (See also.<ref>[http://planetmath.org/encyclopedia/ConditionalProbabilityMeasure.html Regular Conditional Probability] on [http://planetmath.org/ PlanetMath]</ref><ref>D. Leao Jr. et al. ''Regular conditional probability, disintegration of probability and Radon spaces.'' Proyecciones. Vol. 23, No. 1, pp. 15–29, May 2004, Universidad Católica del Norte, Antofagasta, Chile [http://www.scielo.cl/pdf/proy/v23n1/art02.pdf PDF]</ref>)
 
Let <math>(\Omega, \mathcal F, \mathfrak P)</math> be a [[probability space]], and let the random variables ''X'', ''Y'', and ''Z'' each be defined as a Borel-measurable function from <math>\Omega</math> to some state space endowed with a topological structure.
 
Consider the Borel measure (on the σ-algebra generated by the open sets) in the state space of each random variable defined by assigning each Borel set the <math>\mathfrak P</math>-measure of its preimage in <math>\mathcal F</math>.  This is called the [[pushforward measure]] <math>X _* \mathfrak P = \mathfrak P\big(X^{-1}(\cdot)\big).</math>  The '''support of a random variable''' is defined to be the [[Support (measure theory)|topological support]] of this measure, i.e. <math>\mathrm{supp}\,X = \mathrm{supp}\,X _* \mathfrak P.</math>
 
Now we can formally define the [[conditional probability distribution|conditional probability measure]] given the value of one (or, via the [[product topology]], more) of the random variables.  Let <math>M</math> be a measurable subset of <math>\Omega,</math> (i.e. <math>M \in \mathcal F,</math>) and let <math>x \in \mathrm{supp}\,X.</math>  Then, using the [[disintegration theorem]]:
:<math>\mathfrak P(M | X=x) = \lim_{U \ni x}
  \frac {\mathfrak P(M \cap \{X \in U\})}
        {\mathfrak P(\{X \in U\})}
  \qquad \textrm{and} \qquad \mathfrak P(M|X) = \int_M d\mathfrak P\big(\omega|X=X(\omega)\big),</math>
where the limit is taken over the open neighborhoods <math>U</math> of <math>x</math>, as they are allowed to become arbitrarily smaller with respect to [[Subset|set inclusion]].
 
Finally we can define the conditional mutual information via [[Lebesgue integration]]:
:<math>I(X;Y|Z) = \int_\Omega \log
  \frac {d \mathfrak P(\omega|X,Z)\, d\mathfrak P(\omega|Y,Z)}
        {d \mathfrak P(\omega|Z)\, d\mathfrak P(\omega|X,Y,Z)}
  d \mathfrak P(\omega),
  </math>
where the integrand is the logarithm of a [[Radon–Nikodym derivative]] involving some of the conditional probability measures we have just defined.
 
==Note on notation==
In an expression such as <math>I(A;B|C),</math> <math>A,</math> <math>B,</math> and <math>C</math> need not necessarily be restricted to representing individual random variables, but could also represent the joint distribution of any collection of random variables defined on the same [[probability space]].  As is common in [[probability theory]], we may use the comma to denote such a joint distribution, e.g. <math>I(A_0,A_1;B_1,B_2,B_3|C_0,C_1).</math>  Hence the use of the semicolon (or occasionally a colon or even a wedge <math>\wedge</math>) to separate the principal arguments of the mutual information symbol.  (No such distinction is necessary in the symbol for [[joint entropy]], since the joint entropy of any number of random variables is the same as the entropy of their joint distribution.)
 
==Multivariate mutual information==
{{main|Multivariate mutual information}}
The conditional mutual information can be used to inductively define a '''multivariate mutual information''' in a set- or [[Information theory and measure theory|measure-theoretic sense]] in the context of '''[[information diagram]]s'''.  In this sense we define the multivariate mutual information as follows:
:<math>I(X_1;\cdots;X_{n+1}) = I(X_1;\cdots;X_n) - I(X_1;\cdots;X_n|X_{n+1}),</math>
where
:<math>I(X_1;\cdots;X_n|X_{n+1}) = \mathbb E_{X_{n+1}}\big(I(X_1;\cdots;X_n)|X_{n+1}\big).</math>
This definition is identical to that of [[interaction information]] except for a change in sign in the case of an odd number of random variables.  A complication is that this multivariate mutual information (as well as the interaction information) can be positive, negative, or zero, which makes this quantity difficult to interpret intuitively. In fact, for ''n'' random variables, there are <math>2^n-1</math> degrees of freedom for how they might be correlated in an information-theoretic sense, corresponding to each non-empty subset of these variables. These degrees of freedom are bounded by various Shannon- and non-Shannon-type [[inequalities in information theory]].
 
==References==
<references/>
 
[[Category:Information theory]]
[[Category:Entropy and information]]

Latest revision as of 02:52, 7 December 2014


If you present photography effectively, it helps you look much more properly at the globe around you. Offshore expert Word - Press developers high level of interactivity, accessibility, functionality and usability of our website can add custom online to using. * A community forum for debate of the product together with some other customers in the comments spot. They found out all the possible information about bringing up your baby and save money at the same time. You can customize the appearance with PSD to Word - Press conversion .

These folders as well as files have to copied and the saved. After all, Word - Press is free, many of the enhancements for Word - Press like themes and plugins are also free, and there is plenty of free information online about how to use Word - Press. If you have any concerns concerning wherever and how to use backup plugin, you can call us at our own website. You are able to set them within your theme options and so they aid the search engine to get a suitable title and description for the pages that get indexed by Google. It primarily lays emphasis on improving the search engine results of your website whenever a related query is typed in the search box. Once you've installed the program you can quickly begin by adding content and editing it with features such as bullet pointing, text alignment and effects without having to do all the coding yourself.

Just ensure that you hire experienced Word - Press CMS developer who is experienced enough to perform the task of Word - Press customization to get optimum benefits of Word - Press CMS. But if you are not willing to choose cost to the detriment of quality, originality and higher returns, then go for a self-hosted wordpress blog and increase the presence of your business in this new digital age. I hope this short Plugin Dynamo Review will assist you to differentiate whether Plugin Dynamo is Scam or a Genuine. You or your web designer can customize it as per your specific needs. For any web design and development assignment, this is definitely one of the key concerns, specifically for online retail outlets as well as e-commerce websites.

A built-in widget which allows you to embed quickly video from popular websites. I didn't straight consider near it solon than one distance, I got the Popup Ascendancy plugin and it's up and lengthways, likely you make seen it today when you visited our blog, and I yet customize it to fit our Thesis Wound which gives it a rattling uncomparable visage and search than any different popup you know seen before on any added journal, I hump arrogated asset of one of it's quatern themes to make our own. When we talk about functional suitability, Word - Press proves itself as one of the strongest contestant among its other rivals. The most important plugins you will need are All-in-One SEO Pack, some social bookmarking plugin, a Feedburner plugin and an RSS sign up button. Look for experience: When you are searching for a Word - Press developer you should always look at their experience level.

Someone with a basic knowledge of setting up a website should be able to complete the process in a couple of minutes however even basic users should find they are able to complete the installation in around 20 minutes by following the step by step guide online. Here's a list of some exciting Word - Press features that have created waves in the web development industry:. While deciding couple should consider the expertise of the doctor,clinics success rate,the costs of fertility treatment,including fertility tests and IVF costs and overall ones own financial budget. And, it is better that you leave it on for the duration you are writing plugin code. Your topic is going to be the basis of your site's name.

Retrieved from "https://en.formulasearchengine.com/index.php?title=Conductor_of_an_abelian_variety&oldid=261661"