George Dantzig: Difference between revisions

From formulasearchengine
Jump to navigation Jump to search
link to phil wolfe
en>David Eppstein
m Reverted edits by 24.199.0.74 (talk) to last version by 24.130.122.5
 
Line 1: Line 1:
{{Unreferenced|date=November 2009}}
I like my hobby Model Aircraft Hobbies. <br>I  try to learn Vietnamese in my spare time.<br><br>Here is my webpage; [http://Www.bestsongsabout.com/country-songs-for-mothers/ Fifa 15 Coin Generator]
In mathematics, '''generalized means''' are a family of functions for aggregating sets of numbers, that include as special cases the [[arithmetic mean|arithmetic]], [[geometric mean|geometric]], and [[harmonic mean|harmonic]] [[mean]]s. The generalized mean is also known as '''power mean''' or '''Hölder mean''' (named after [[Otto Hölder]]).
 
==Definition==
If ''p'' is a non-zero [[real number]], we can define the '''generalized mean''' or '''power mean''' with exponent ''p'' of the positive real numbers <math>x_1,\dots,x_n</math> as:
 
:<math>M_p(x_1,\dots,x_n) = \left( \frac{1}{n} \sum_{i=1}^n x_i^p \right)^{\frac{1}{p}}</math>
 
While for ''p'' = 0 we assume that it's equal to the geometric mean (which is, in fact, the limit of means with exponents approaching zero, as proved below for the general case):
 
:<math>M_0(x_1, \dots, x_n) = \sqrt[n]{\prod_{i=1}^n x_i}</math>
 
Furthermore, for a sequence of positive weights ''w<sub>i</sub>'' with sum <math>\sum w_i = 1</math> we define the '''weighted power mean''' as:
 
:<math>\begin{align}
  M_p(x_1,\dots,x_n) &= \left(\sum_{i=1}^n w_i x_i^p \right)^{\frac{1}{p}} \\
  M_0(x_1,\dots,x_n) &= \prod_{i=1}^n x_i^{w_i}
\end{align}</math>
 
The unweighted means correspond to setting all ''w<sub>i</sub>'' = 1/''n''. For exponents equal to positive or negative infinity the means are maximum and minimum, respectively, regardless of weights (and they are actually the limit points for exponents approaching the respective extremes, as proved below):
 
:<math>\begin{align}
  M_{ \infty}(x_1, \dots, x_n) &= \max(x_1, \dots, x_n) \\
  M_{-\infty}(x_1, \dots, x_n) &= \min(x_1, \dots, x_n)
\end{align}</math>
 
:{| class="toccolours collapsible collapsed" width="90%" style="text-align:left"
!Proof of <math>\textstyle \lim_{p \to 0} M_p = M_0</math> (geometric mean)
|-
|
We can rewrite the definition of ''M<sub>p</sub>'' using the [[exponential function]]
 
:<math>M_p(x_1,\dots,x_n) = \exp{\left( \ln{\left[\left(\sum_{i=1}^n w_ix_{i}^p \right)^{1/p}\right]} \right) } = \exp{\left( \frac{\ln{\left(\sum_{i=1}^n w_ix_{i}^p \right)}}{p} \right) }</math>
 
In the limit ''p'' → 0, we can apply [[L'Hôpital's rule]] to the exponential component,
 
:<math>\lim_{p \to 0} \frac{\ln{\left(\sum_{i=1}^n w_ix_{i}^p \right)}}{p} = \lim_{p \to 0} \frac{\sum_{i=1}^n w_i x_i^p \ln{x_i}}{\sum_{i=1}^n w_i x_i^p} = \sum_{i=1}^n w_i \ln{x_i} = \ln{\left(\prod_{i=1}^n x_i^{w_i} \right)}</math>
 
By the continuity of the exponential function, we can substitute back into the above relation to obtain
 
:<math>\lim_{p \to 0} M_p(x_1,\dots,x_n) = \exp{\left( \ln{\left(\prod_{i=1}^n x_i^{w_i} \right)} \right)} = \prod_{i=1}^n x_i^{w_i} = M_0(x_1,\dots,x_n)</math>
 
as desired.
|}
 
:{| class="toccolours collapsible collapsed" width="90%" style="text-align:left"
!Proof of <math>\textstyle \lim_{p \to \infty} M_p = M_\infty</math> and <math>\textstyle \lim_{p \to -\infty} M_p = M_{-\infty}</math>
|-
|
Assume (possibly after relabeling and combining terms together) that <math>x_1 \geq \dots \geq x_n</math>. Then
 
:<math>\lim_{p \to \infty} M_p(x_1,\dots,x_n) = \lim_{p \to \infty} \left( \sum_{i=1}^n w_i x_i^p \right)^{1/p} = x_1 \lim_{p \to \infty} \left( \sum_{i=1}^n w_i \left( \frac{x_i}{x_1} \right)^p \right)^{1/p} = x_1 = M_\infty (x_1,\dots,x_n).</math>
 
The formula for <math>M_{-\infty}</math> follows from <math>M_{-\infty} (x_1,\dots,x_n) = \frac{1}{M_\infty (1/x_1,\dots,1/x_n)}.</math>
|}
 
==Properties==
<!--
The case ''t'' = 1 yields the [[arithmetic mean]] and the case ''t'' = −1 yields the [[harmonic mean]]. The case ''t'' = 2 yields the [[root mean square]].  As ''t'' approaches 0, the [[Limit (mathematics)|limit]] of ''M''(''t'') is the [[geometric mean]] of the given numbers, and so it makes sense to ''define'' ''M''(0) to be the geometric mean. Furthermore, as ''t'' approaches ∞, ''M''(''t'') approaches the maximum of the given numbers, and as ''t'' approaches −∞, ''M''(''t'') approaches the minimum of the given numbers.
-->
* Like most [[Mean#Properties|mean]]s, the generalized mean is a [[homogeneous function]] of its arguments ''x''<sub>1</sub>, ..., ''x<sub>n</sub>''. That is, if ''b'' is a positive real number, then the generalized mean with exponent ''p'' of the numbers <math>b\cdot x_1,\dots, b\cdot x_n</math> is equal to ''b'' times the generalized mean of the numbers ''x''<sub>1</sub>, …, ''x<sub>n</sub>''.
* Like the [[quasi-arithmetic mean]]s, the computation of the mean can be split into computations of equal sized sub-blocks.
 
:: <math>M_p(x_1, \dots, x_{n \cdot k}) = M_p(M_p(x_1, \dots, x_{k}), M_p(x_{k + 1}, \dots, x_{2 \cdot k}), \dots, M_p(x_{(n - 1) \cdot k + 1}, \dots, x_{n \cdot k}))</math>
 
=== Generalized mean inequality ===
In general,
: if ''p'' < ''q'', then <math>M_p(x_1,\dots,x_n) \le M_q(x_1,\dots,x_n)</math>
 
and the two means are equal if and only if ''x''<sub>1</sub> = ''x''<sub>2</sub> = ... = ''x<sub>n</sub>''.
 
The inequality is true for real values if ''p'' and ''q'', as well as positive and negative infinity values.
 
It follows from the fact that, for all real ''p'',
 
: <math>\frac{\partial}{\partial p}M_p(x_1, \dots, x_n) \geq 0</math>
 
which can be proved using [[Jensen's inequality]]. 
 
In particular, for ''p'' in {−1, 0, 1}, the generalized mean inequality implies the [[Pythagorean means]] inequality as well as the [[inequality of arithmetic and geometric means]].
 
== Special cases ==
[[Image:MathematicalMeans.svg|thumb|right|A visual depiction of some of the specified cases for ''n=2''.]]
{| style="border:none; padding:20px"
|<math>M_{-\infty}(x_1,\dots,x_n) = \lim_{p\to-\infty} M_p(x_1,\dots,x_n) = \min \{x_1,\dots,x_n\}</math>
|style="padding:0px 0px 0px 20px"| [[minimum]]
|-
|<math>M_{-1}(x_1,\dots,x_n) = \frac{n}{\frac{1}{x_1}+\dots+\frac{1}{x_n}}</math>
|style="padding:0px 0px 0px 20px"| [[harmonic mean]]
|-
|<math>M_0(x_1,\dots,x_n) = \lim_{p\to0} M_p(x_1,\dots,x_n) = \sqrt[n]{x_1\cdot\dots\cdot x_n}</math>
|style="padding:0px 0px 0px 20px"| [[geometric mean]]
|-
|<math>M_1(x_1,\dots,x_n) = \frac{x_1 + \dots + x_n}{n}</math>
|style="padding:0px 0px 0px 20px"| [[arithmetic mean]]
|-
|<math>M_2(x_1,\dots,x_n) = \sqrt{\frac{x_1^2 + \dots + x_n^2}{n}}</math>
|style="padding:0px 0px 0px 20px"| quadratic mean, a.k.a. [[root mean square]]
|-
|<math>M_{+\infty}(x_1,\dots,x_n) = \lim_{p\to\infty} M_p(x_1,\dots,x_n) = \max \{x_1,\dots,x_n\}</math>
|style="padding:0px 0px 0px 20px"| [[maximum]]
|}
 
==Proof of power means inequality==
We will prove weighted power means inequality, for the purpose of the proof we will assume the following without loss of generality:
 
:<math>\begin{align}
  w_i \in [0; 1] \\
  \sum_{i=1}^nw_i = 1
\end{align}</math>
 
Proof for unweighted power means is easily obtained by substituting ''w<sub>i</sub>'' = 1/''n''.
 
===Equivalence of inequalities between means of opposite signs===
Suppose an average between power means with exponents ''p'' and ''q'' holds:
 
:<math>\sqrt[p]{\sum_{i=1}^nw_ix_i^p}\geq \sqrt[q]{\sum_{i=1}^nw_ix_i^q}</math>
 
applying this, then:
 
:<math>\sqrt[p]{\sum_{i=1}^n\frac{w_i}{x_i^p}}\leq \sqrt[q]{\sum_{i=1}^n\frac{w_i}{x_i^q}}</math>
 
We raise both sides to the power of −1 (strictly decreasing function in positive reals):
 
:<math>\sqrt[-p]{\sum_{i=1}^nw_ix_i^{-p}}=\sqrt[p]{\frac{1}{\sum_{i=1}^nw_i\frac{1}{x_i^p}}}\geq \sqrt[q]{\frac{1}{\sum_{i=1}^nw_i\frac{1}{x_i^q}}}=\sqrt[-q]{\sum_{i=1}^nw_ix_i^{-q}}</math>
 
We get the inequality for means with exponents −''p'' and −''q'', and we can use the same reasoning backwards, thus proving the inequalities to be equivalent, which will be used in some of the later proofs.
 
===Geometric mean===
For any ''q'' the inequality between mean with exponent ''q'' and geometric mean can be transformed in the following way:
 
:<math>\begin{align}
          \prod_{i=1}^nx_i^{w_i} &\leq \sqrt[q]{\sum_{i=1}^nw_ix_i^q} \\
  \sqrt[q]{\sum_{i=1}^nw_ix_i^q} &\leq \prod_{i=1}^nx_i^{w_i}
\end{align}</math>
 
(the first inequality is to be proven for positive ''q'', and the latter otherwise)
 
We raise both sides to the power of ''q'':
 
:<math>\prod_{i=1}^nx_i^{w_i\cdot q} \leq \sum_{i=1}^nw_ix_i^q</math>
 
in both cases we get the inequality between weighted arithmetic and geometric means for the sequence <math>x_i^q</math>, which can be proved by [[Jensen's inequality]], making use of the fact the [[logarithm]]ic function is concave:
 
:<math>\begin{align}
                  \sum_{i=1}^nw_i\log(x_i) &\leq \log\left( \sum_{i=1}^nw_ix_i \right) \\
  \log \left(\prod_{i=1}^nx_i^{w_i} \right) &\leq \log\left( \sum_{i=1}^nw_ix_i \right)
\end{align}</math>
 
By applying the [[exponential function]] to both sides (and observing that as a strictly increasing function it preserves the sign of the inequality) we get
 
:<math>\prod_{i=1}^nx_i^{w_i} \leq \sum_{i=1}^nw_ix_i</math>
 
Thus for any positive ''q'' it is true that:
 
:<math>\sqrt[-q]{\sum_{i=1}^nw_ix_i^{-q}}\leq \prod_{i=1}^nx_i^{w_i} \leq \sqrt[q]{\sum_{i=1}^nw_ix_i^q}</math>
 
thus we have proved the inequality between geometric mean and any power mean.
 
===Inequality between any two power means===
We are to prove that for any ''p'' < ''q'' the following inequality holds:
 
:<math>\sqrt[p]{\sum_{i=1}^nw_ix_i^p}\leq \sqrt[q]{\sum_{i=1}^nw_ix_i^q}</math>
 
if ''p'' is negative, and ''q'' is positive, the inequality is equivalent to the one proved above:
 
:<math>\sqrt[p]{\sum_{i=1}^nw_ix_i^p}\leq \prod_{i=1}^nx_i^{w_i} \leq\sqrt[q]{\sum_{i=1}^nw_ix_i^q}</math>
 
The proof for positive ''p'' and ''q'' is as follows: Define the following function: ''f'' : '''R'''<sub>+</sub> → '''R'''<sub>+</sub> <math>f(x)=x^{\frac{q}{p}}</math>. ''f'' is a power function, so it does have a second derivative:
 
: <math>f''(x) = \left(\frac{q}{p} \right) \left( \frac{q}{p}-1 \right)x^{\frac{q}{p}-2}</math>
 
which is strictly positive within the domain of ''f'', since ''q'' > ''p'', so we know ''f'' is convex.
 
Using this, and the Jensen's inequality we get:
 
:<math>\begin{align}
    f \left( \sum_{i=1}^nw_ix_i^p \right) &\leq \sum_{i=1}^nw_if(x_i^p) \\
  \sqrt[\frac{p}{q}]{\sum_{i=1}^nw_ix_i^p} &\leq \sum_{i=1}^nw_ix_i^q
\end{align}</math>
 
after raising both side to the power of 1/''q'' (an increasing function, since 1/''q'' is positive) we get the inequality which was to be proven:
 
:<math>\sqrt[p]{\sum_{i=1}^nw_ix_i^p}\leq\sqrt[q]{\sum_{i=1}^nw_ix_i^q}</math>
 
Using the previously shown equivalence we can prove the inequality for negative ''p'' and ''q'' by substituting them with, respectively, −''q'' and −''p'', QED.
 
== Generalized ''f''-mean ==
{{Main|Generalized f-mean|l1=Generalized ƒ-mean}}
 
The power mean could be generalized further to the [[generalized f-mean|generalized ''f''-mean]]:
 
:<math> M_f(x_1,\dots,x_n) = f^{-1} \left({\frac{1}{n}\cdot\sum_{i=1}^n{f(x_i)}}\right) </math>
 
Which covers the geometric mean without using a limit with ''f''(''x'') = ''log''(''x''). The power mean is obtained for ''f''(''x'') = ''x<sup>p</sup>''.
 
== Applications ==
===Signal processing===
A power mean serves a non-linear [[moving average]] which is shifted towards small signal values for small ''p'' and emphasizes big signal values for big ''p''. Given an efficient implementation of a [[lowpass|moving arithmetic mean]] called <code>smooth</code> you can implement a moving power mean according to the following [[Haskell (programming language)|Haskell]] code.
 
<source lang="haskell">
powerSmooth :: Floating a => ([a] -> [a]) -> a -> [a] -> [a]
powerSmooth smooth p = map (** recip p) . smooth . map (**p)
</source>
 
* For big ''p'' it can serve an [[envelope detector]] on a [[rectifier|rectified]] signal.
* For small ''p'' it can serve an [[Baseline (spectrometry)|baseline detector]] on a [[mass spectrum]].
 
==See also==
* [[Arithmetic mean]]
* [[Arithmetic-geometric mean]]
* [[Average]]
* [[Geometric mean]]
* [[Harmonic mean]]
* [[Heronian mean]]
* [[Inequality of arithmetic and geometric means]]
* [[Lehmer mean]] &ndash; also a mean related to [[Power (mathematics)|powers]]
* [[Root mean square]]
 
==External links==
*[http://mathworld.wolfram.com/PowerMean.html Power mean at MathWorld]
*[http://people.revoledu.com/kardi/tutorial/BasicMath/Average/Generalized%20mean.html Examples of Generalized Mean]
*A [http://planetmath.org/?op=getobj&from=objects&name=ProofOfGeneralMeansInequality proof of the Generalized Mean] on [[PlanetMath]]
 
[[Category:Means]]
[[Category:Inequalities]]
[[Category:Articles with example Haskell code]]

Latest revision as of 20:10, 6 February 2014

I like my hobby Model Aircraft Hobbies.
I try to learn Vietnamese in my spare time.

Here is my webpage; Fifa 15 Coin Generator