Mellin transform: Difference between revisions
en>Policron mNo edit summary |
|||
Line 1: | Line 1: | ||
{{Differential equations}} | |||
In [[mathematics]], '''separation of variables''' (also known as the '''Fourier method''') is any of several methods for solving ordinary and partial [[differential equation]]s, in which algebra allows one to rewrite an equation so that each of two variables occurs on a different side of the equation. | |||
== Ordinary differential equations (ODE) == | |||
Suppose a differential equation can be written in the form | |||
:<math>\frac{d}{dx} f(x) = g(x)h(f(x))</math> | |||
which we can write more simply by letting <math>y = f(x)</math>: | |||
:<math>\frac{dy}{dx}=g(x)h(y).</math> | |||
As long as ''h''(''y'') ≠ 0, we can rearrange terms to obtain: | |||
:<math>{dy \over h(y)} = {g(x)dx},</math> | |||
so that the two variables ''x'' and ''y'' have been separated. ''dx'' (and ''dy'') can be viewed, at a simple level, as just a convenient notation, which provides a handy mnemonic aid for assisting with manipulations. A formal definition of ''dx'' as a [[differential (infinitesimal)]] is somewhat advanced. | |||
=== Alternative notation === | |||
Some who dislike [[Leibniz's notation]] may prefer to write this as | |||
:<math>\frac{1}{h(y)} \frac{dy}{dx} = g(x),</math> | |||
but that fails to make it quite as obvious why this is called "separation of variables". Integrating both sides of the equation with respect to <math>x</math>, we have | |||
:<math>\int \frac{1}{h(y)} \frac{dy}{dx} \, dx = \int g(x) \, dx, \qquad\qquad (1) </math> | |||
or equivalently, | |||
:<math>\int \frac{1}{h(y)} \, dy = \int g(x) \, dx </math> | |||
because of the [[integration by substitution|substitution rule for integrals]]. | |||
If one can evaluate the two integrals, one can find a solution to the differential equation. Observe that this process effectively allows us to treat the [[derivative]] <math>\frac{dy}{dx}</math> as a fraction which can be separated. This allows us to solve separable differential equations more conveniently, as demonstrated in the example below. | |||
(Note that we do not need to use two [[arbitrary constant of integration|constants of integration]], in equation (1) as in | |||
:<math>\int \frac{1}{h(y)} \, dy + C_1 = \int g(x) \, dx + C_2,</math> | |||
because a single constant <math>C = C_2 - C_1</math> is equivalent.) | |||
===Example (I)=== | |||
The ordinary differential equation | |||
:<math>\frac{d}{dx}f(x)=f(x)(1-f(x))</math> | |||
may be written as | |||
:<math>\frac{dy}{dx}=y(1-y).</math> | |||
If we let <math>g(x) = 1</math> and <math>h(y) = y(1-y)</math>, we can write the differential equation in the form of equation (1) above. Thus, the differential equation is separable. | |||
As shown above, we can treat <math>dy</math> and <math>dx</math> as separate values, so that both sides of the equation may be multiplied by <math>dx</math>. Subsequently dividing both sides by <math>y(1 - y)</math>, we have | |||
:<math>\frac{dy}{y(1-y)}=dx.</math> | |||
At this point we have ''separated'' the variables ''x'' and ''y'' from each other, since ''x'' appears only on the right side of the equation and ''y'' only on the left. | |||
Integrating both sides, we get | |||
:<math>\int\frac{dy}{y(1-y)}=\int dx,</math> | |||
which, via [[partial fraction]]s, becomes | |||
:<math>\int\frac{1}{y} \, dy + \int\frac{1}{1-y}\,dy=\int 1 \, dx,</math> | |||
and then | |||
:<math>\ln |y| -\ln |1-y|=x+C</math> | |||
where ''C'' is the [[arbitrary constant of integration|constant of integration]]. A bit of [[algebra]] gives a solution for ''y'': | |||
:<math>y=\frac{1}{1+Be^{-x}}.</math> | |||
One may check our solution by taking the derivative with respect to x of the function we found, where ''B'' is an arbitrary constant. The result should be equal to our original problem. (One must be careful with the absolute values when solving the equation above. It turns out that the different signs of the absolute value contribute the positive and negative values for ''B'', respectively. And the ''B'' = 0 case is contributed by the case that ''y'' = 1, as discussed below.) | |||
Note that since we divided by <math>y</math> and <math>(1 - y)</math> we must check to see whether the solutions <math>y(x) = 0</math> and <math>y(x) = 1</math> solve the [[differential equation]] (in this case they are both solutions). See also: [[singular solution]]s. | |||
===Example (II)=== | |||
Population growth is often modeled by the differential equation | |||
: <math>\frac{dP}{dt}=kP\left(1-\frac{P}{K}\right)</math> | |||
where <math>P</math> is the population with respect to time <math>t</math>, <math>k</math> is the rate of growth, and <math>K</math> is the [[carrying capacity]] of the environment. | |||
Separation of variables may be used to solve this differential equation. | |||
: <math>\frac{dP}{dt}=kP\left(1-\frac{P}{K}\right)</math> | |||
: <math>\int\frac{dP}{P\left(1-\frac{P}{K}\right)}=\int k\,dt</math> | |||
To evaluate the integral on the left side, we simplify the fraction | |||
: <math>\frac{1}{P\left(1-\frac{P}{K}\right)}=\frac{K}{P\left(K-P\right)}</math> | |||
and then, we decompose the fraction into partial fractions | |||
: <math>\frac{K}{P\left(K-P\right)}=\frac{1}{P}+\frac{1}{K-P}</math> | |||
Thus we have | |||
: <math>\int\left(\frac{1}{P}+\frac{1}{K-P}\right)\,dP=\int k\,dt</math> | |||
: <p><math>\ln\begin{vmatrix}P\end{vmatrix}-\ln\begin{vmatrix}K-P\end{vmatrix}=kt+C</math></p> | |||
: <p><math>\ln\begin{vmatrix}K-P\end{vmatrix}-\ln\begin{vmatrix}P\end{vmatrix}=-kt-C</math></p> | |||
: <p><math>\ln\begin{vmatrix}\cfrac{K-P}{P}\end{vmatrix}=-kt-C</math></p> | |||
: <p><math>\begin{vmatrix}\cfrac{K-P}{P}\end{vmatrix}=e^{-kt-C}</math></p> | |||
: <p><math>\begin{vmatrix}\cfrac{K-P}{P}\end{vmatrix}=e^{-C}e^{-kt}</math></p> | |||
: <p><math>\frac{K-P}{P}=\pm e^{-C}e^{-kt}</math></p> | |||
: <p>Let <math>A=\pm e^{-C}</math>.</p> | |||
: <p><math>\frac{K-P}{P}=Ae^{-kt}</math></p> | |||
: <p><math>\frac{K}{P}-1=Ae^{-kt}</math></p> | |||
: <p><math>\frac{K}{P}=1+Ae^{-kt}</math></p> | |||
: <p><math>\frac{P}{K}=\frac{1}{1+Ae^{-kt}}</math></p> | |||
: <p><math>P=\frac{K}{1+Ae^{-kt}}</math></p> | |||
Therefore, the solution to the logistic equation is | |||
: <p><math>P\left(t\right)=\frac{K}{1+Ae^{-kt}}</math></p> | |||
To find <math>A</math>, let <math>t=0</math> and <math>P\left(0\right)=P_0</math>. Then we have | |||
: <math>P_0=\frac{K}{1+Ae^0}</math></p> | |||
Noting that <math>e^0=1</math>, and solving for A we get | |||
: <math>A=\frac{K-P_0}{P_0}</math> | |||
== Partial differential equations{{anchor|pde}} == | |||
The method of separation of variables is also used to solve a wide range of linear partial differential equations with boundary and initial conditions, such as [[heat equation]], [[wave equation]], [[Laplace equation]] and [[Helmholtz equation]]. | |||
===Homogeneous case=== | |||
Consider the one-dimensional [[heat equation]].The equation is | |||
{{NumBlk|:|<math>\frac{\partial u}{\partial t}-\alpha\frac{\partial^{2}u}{\partial x^{2}}=0</math>|{{EqRef|1}}}} | |||
The boundary condition is homogeneous, that is | |||
{{NumBlk|:|<math>u\big|_{x=0}=u\big|_{x=L}=0 </math>|{{EqRef|2}}}} | |||
Let us attempt to find a solution which is not identically zero satisfying the boundary conditions but with the following property: ''u'' is a product in which the dependence of ''u'' on ''x'', ''t'' is separated, that is: | |||
{{NumBlk|:|<math> u(x,t) = X(x) T(t).</math>|{{EqRef|3}}}} | |||
Substituting ''u'' back into equation and using the [[product rule]], | |||
{{NumBlk|:|<math>\frac{T'(t)}{\alpha T(t)} = \frac{X''(x)}{X(x)}.</math>|{{EqRef|4}}}} | |||
Since the right hand side depends only on ''x'' and the left hand side only on ''t'', both sides are equal to some constant value − λ. Thus: | |||
{{NumBlk|:|<math>T'(t) = - \lambda \alpha T(t),</math>|{{EqRef|5}}}} | |||
and | |||
{{NumBlk|:|<math>X''(x) = - \lambda X(x).</math>|{{EqRef|6}}}} | |||
− λ here is the [[eigenvalue]] for both differential operators, and ''T(t)'' and ''X(x)'' are corresponding [[eigenfunction]]s. | |||
We will now show that solutions for ''X(x)'' for values of λ ≤ 0 cannot occur: | |||
Suppose that λ < 0. Then there exist real numbers ''B'', ''C'' such that | |||
:<math>X(x) = B e^{\sqrt{-\lambda} \, x} + C e^{-\sqrt{-\lambda} \, x}.</math> | |||
From {{EqNote|2}} we get | |||
{{NumBlk|:|<math>X(0) = 0 = X(L),</math>|{{EqRef|7}}}} | |||
and therefore ''B'' = 0 = ''C'' which implies ''u'' is identically 0. | |||
Suppose that λ = 0. Then there exist real numbers ''B'', ''C'' such that | |||
:<math>X(x) = Bx + C.</math> | |||
From {{EqNote|7}} we conclude in the same manner as in 1 that ''u'' is identically 0. | |||
Therefore, it must be the case that λ > 0. Then there exist real numbers ''A'', ''B'', ''C'' such that | |||
:<math>T(t) = A e^{-\lambda \alpha t},</math> | |||
and | |||
:<math>X(x) = B \sin(\sqrt{\lambda} \, x) + C \cos(\sqrt{\lambda} \, x).</math> | |||
From {{EqNote|7}} we get ''C'' = 0 and that for some positive integer ''n'', | |||
:<math>\sqrt{\lambda} = n \frac{\pi}{L}.</math> | |||
This solves the heat equation in the special case that the dependence of ''u'' has the special form of {{EqNote|3}}. | |||
In general, the sum of solutions to {{EqNote|1}} which satisfy the boundary conditions {{EqNote|2}} also satisfies {{EqNote|1}} and {{EqNote|3}}. Hence a complete solution can be given as | |||
:<math>u(x,t) = \sum_{n = 1}^{\infty} D_n \sin \frac{n\pi x}{L} \exp\left(-\frac{n^2 \pi^2 \alpha t}{L^2}\right),</math> | |||
where ''D''<sub>''n''</sub> are coefficients determined by initial condition. | |||
Given the initial condition | |||
:<math>u\big|_{t=0}=f(x),</math> | |||
we can get | |||
:<math>f(x) = \sum_{n = 1}^{\infty} D_n \sin \frac{n\pi x}{L}.</math> | |||
This is the [[sine series]] expansion of ''f(x)''. Multiplying both sides with <math>\sin \frac{n\pi x}{L}</math> and integrating over ''[0,L]'' result in | |||
:<math>D_n = \frac{2}{L} \int_0^L f(x) \sin \frac{n\pi x}{L} \, dx.</math> | |||
This method requires that the eigenfunctions of ''x'', here <math>\left\{\sin \frac{n\pi x}{L}\right\}_{n=1}^{\infty}</math>, are [[orthogonal]] and [[complete]]. In general this is guaranteed by [[Sturm-Liouville theory]]. | |||
=== Nonhomogeneous case === | |||
Suppose the equation is nonhomogeneous, | |||
{{NumBlk|:|<math>\frac{\partial u}{\partial t}-\alpha\frac{\partial^{2}u}{\partial x^{2}}=h(x,t)</math>|{{EqRef|8}}}} | |||
with the boundary condition the same as {{EqNote|2}}. | |||
Expand ''h(x,t)'', ''u(x,t)'' and ''f(x,t)'' into | |||
{{NumBlk|:|<math>h(x,t)=\sum_{n=1}^{\infty}h_{n}(t)\sin\frac{n\pi x}{L},</math>|{{EqRef|9}}}} | |||
{{NumBlk|:|<math>u(x,t)=\sum_{n=1}^{\infty}u_{n}(t)\sin\frac{n\pi x}{L},</math>|{{EqRef|10}}}} | |||
{{NumBlk|:|<math>f(x)=\sum_{n=1}^{\infty}b_{n}\sin\frac{n\pi x}{L},</math>|{{EqRef|11}}}} | |||
where ''h''<sub>''n''</sub>(''t'') and ''b''<sub>''n''</sub> can be calculated by integration, while ''u''<sub>''n''</sub>(''t'') is to be determined. | |||
Substitute {{EqNote|9}} and {{EqNote|10}} back to {{EqNote|8}} and considering the orthogonality of sine functions we get | |||
: <math>u'_{n}(t)+\alpha\frac{n^{2}\pi^{2}}{L^{2}}u_{n}(t)=h_{n}(t),</math> | |||
which are a sequence of [[linear differential equations]] that can be readily solved with, for instance, [[Laplace transform]], or [[Integrating factor]]. Finally, we can get | |||
: <math>u_{n}(t)=e^{-\alpha\frac{n^{2}\pi^{2}}{L^{2}} t} \left (b_{n}+\int_{0}^{t}h_{n}(s)e^{\alpha\frac{n^{2}\pi^{2}}{L^{2}} s} \, ds \right).</math> | |||
If the boundary condition is nonhomogeneous, then the expansion of {{EqNote|9}} and {{EqNote|10}} is no longer valid. One has to find a function ''v'' that satisfies the boundary condition only, and subtract it from ''u''. The function ''u-v'' then satisfies homogeneous boundary condition, and can be solved with the above method. | |||
In [[orthogonal curvilinear coordinates]], separation of variables can still be used, but in some details different from that in Cartesian coordinates. For instance, regularity or periodic condition may determine the eigenvalues in place of boundary conditions. See [[spherical harmonics#Laplace's spherical harmonics|spherical harmonics]] for example. | |||
== Matrices == | |||
The matrix form of the separation of variables is the [[Kronecker sum]]. | |||
As an example we consider the 2D [[Discrete Laplace operator|discrete Laplacian]] on a [[regular grid]]: | |||
:<math>L = \mathbf{D_{xx}}\oplus\mathbf{D_{yy}}=\mathbf{D_{xx}}\otimes\mathbf{I}+\mathbf{I}\otimes\mathbf{D_{yy}}, \,</math> | |||
where <math>\mathbf{D_{xx}} </math> and <math>\mathbf{D_{yy}} </math> are 1D discrete Laplacians in the ''x''- and ''y''-directions, correspondingly, and <math>\mathbf{I} </math> are the identities of appropriate sizes. See the main article [[Kronecker sum of discrete Laplacians]] for details. | |||
== References == | |||
* A. D. Polyanin, ''Handbook of Linear Partial Differential Equations for Engineers and Scientists'', Chapman & Hall/CRC Press, Boca Raton, 2002. ISBN 1-58488-299-9. | |||
*{{Cite book | |||
| author = Tyn Myint-U, Lokenath Debnath | |||
| isbn = 978-0-8176-4393-5 | |||
| title = Linear Partial Differential Equations for Scientists and Engineers | |||
| location = Boston, MA | |||
| accessdate = 2011-03-29 | |||
| year = 2007 | |||
| url = http://www.springerlink.com/index/10.1007/978-0-8176-4560-1 | |||
}} | |||
* {{Cite book | last=Teschl | first=Gerald | author-link =Gerald Teschl| title=Ordinary Differential Equations and Dynamical Systems | series=Graduate Studies in Mathematics | volume=140 | publisher=[[American Mathematical Society]]| location= Providence, RI| year= 2012 | isbn=978-0-8218-8328-0| url=http://www.mat.univie.ac.at/~gerald/ftp/book-ode/}} | |||
== External links== | |||
* {{springer|title=Fourier method|id=p/f041070}} | |||
* {{mathworld2 |urlname=SeparationofVariables |title=Separation of variables|urlname2=DifferentialEquation|title2=Differential Equation|author=John Renze, [[Eric W. Weisstein]]}} | |||
* [http://eqworld.ipmnet.ru/en/education/edu-pde.htm Methods of Generalized and Functional Separation of Variables] at EqWorld: The World of Mathematical Equations | |||
* [http://www.exampleproblems.com/wiki/index.php/PDE:Integration_and_Separation_of_Variables Examples] of separating variables to solve PDEs | |||
* [http://www.math-cs.gordon.edu/courses/mat225/handouts/sepvar.pdf "A Short Justification of Separation of Variables"] | |||
[[Category:Ordinary differential equations]] | |||
[[Category:Partial differential equations]] |
Revision as of 11:40, 2 September 2013
Template:Differential equations
In mathematics, separation of variables (also known as the Fourier method) is any of several methods for solving ordinary and partial differential equations, in which algebra allows one to rewrite an equation so that each of two variables occurs on a different side of the equation.
Ordinary differential equations (ODE)
Suppose a differential equation can be written in the form
which we can write more simply by letting :
As long as h(y) ≠ 0, we can rearrange terms to obtain:
so that the two variables x and y have been separated. dx (and dy) can be viewed, at a simple level, as just a convenient notation, which provides a handy mnemonic aid for assisting with manipulations. A formal definition of dx as a differential (infinitesimal) is somewhat advanced.
Alternative notation
Some who dislike Leibniz's notation may prefer to write this as
but that fails to make it quite as obvious why this is called "separation of variables". Integrating both sides of the equation with respect to , we have
or equivalently,
because of the substitution rule for integrals.
If one can evaluate the two integrals, one can find a solution to the differential equation. Observe that this process effectively allows us to treat the derivative as a fraction which can be separated. This allows us to solve separable differential equations more conveniently, as demonstrated in the example below.
(Note that we do not need to use two constants of integration, in equation (1) as in
because a single constant is equivalent.)
Example (I)
The ordinary differential equation
may be written as
If we let and , we can write the differential equation in the form of equation (1) above. Thus, the differential equation is separable.
As shown above, we can treat and as separate values, so that both sides of the equation may be multiplied by . Subsequently dividing both sides by , we have
At this point we have separated the variables x and y from each other, since x appears only on the right side of the equation and y only on the left.
Integrating both sides, we get
which, via partial fractions, becomes
and then
where C is the constant of integration. A bit of algebra gives a solution for y:
One may check our solution by taking the derivative with respect to x of the function we found, where B is an arbitrary constant. The result should be equal to our original problem. (One must be careful with the absolute values when solving the equation above. It turns out that the different signs of the absolute value contribute the positive and negative values for B, respectively. And the B = 0 case is contributed by the case that y = 1, as discussed below.)
Note that since we divided by and we must check to see whether the solutions and solve the differential equation (in this case they are both solutions). See also: singular solutions.
Example (II)
Population growth is often modeled by the differential equation
where is the population with respect to time , is the rate of growth, and is the carrying capacity of the environment.
Separation of variables may be used to solve this differential equation.
To evaluate the integral on the left side, we simplify the fraction
and then, we decompose the fraction into partial fractions
Thus we have
Therefore, the solution to the logistic equation is
To find , let and . Then we have
Noting that , and solving for A we get
Partial differential equations<pde>...</pde>
The method of separation of variables is also used to solve a wide range of linear partial differential equations with boundary and initial conditions, such as heat equation, wave equation, Laplace equation and Helmholtz equation.
Homogeneous case
Consider the one-dimensional heat equation.The equation is
The boundary condition is homogeneous, that is Template:NumBlk
Let us attempt to find a solution which is not identically zero satisfying the boundary conditions but with the following property: u is a product in which the dependence of u on x, t is separated, that is:
Substituting u back into equation and using the product rule,
Since the right hand side depends only on x and the left hand side only on t, both sides are equal to some constant value − λ. Thus:
and
− λ here is the eigenvalue for both differential operators, and T(t) and X(x) are corresponding eigenfunctions.
We will now show that solutions for X(x) for values of λ ≤ 0 cannot occur:
Suppose that λ < 0. Then there exist real numbers B, C such that
From Template:EqNote we get
and therefore B = 0 = C which implies u is identically 0.
Suppose that λ = 0. Then there exist real numbers B, C such that
From Template:EqNote we conclude in the same manner as in 1 that u is identically 0.
Therefore, it must be the case that λ > 0. Then there exist real numbers A, B, C such that
and
From Template:EqNote we get C = 0 and that for some positive integer n,
This solves the heat equation in the special case that the dependence of u has the special form of Template:EqNote.
In general, the sum of solutions to Template:EqNote which satisfy the boundary conditions Template:EqNote also satisfies Template:EqNote and Template:EqNote. Hence a complete solution can be given as
where Dn are coefficients determined by initial condition.
Given the initial condition
we can get
This is the sine series expansion of f(x). Multiplying both sides with and integrating over [0,L] result in
This method requires that the eigenfunctions of x, here , are orthogonal and complete. In general this is guaranteed by Sturm-Liouville theory.
Nonhomogeneous case
Suppose the equation is nonhomogeneous,
with the boundary condition the same as Template:EqNote.
Expand h(x,t), u(x,t) and f(x,t) into
where hn(t) and bn can be calculated by integration, while un(t) is to be determined.
Substitute Template:EqNote and Template:EqNote back to Template:EqNote and considering the orthogonality of sine functions we get
which are a sequence of linear differential equations that can be readily solved with, for instance, Laplace transform, or Integrating factor. Finally, we can get
If the boundary condition is nonhomogeneous, then the expansion of Template:EqNote and Template:EqNote is no longer valid. One has to find a function v that satisfies the boundary condition only, and subtract it from u. The function u-v then satisfies homogeneous boundary condition, and can be solved with the above method.
In orthogonal curvilinear coordinates, separation of variables can still be used, but in some details different from that in Cartesian coordinates. For instance, regularity or periodic condition may determine the eigenvalues in place of boundary conditions. See spherical harmonics for example.
Matrices
The matrix form of the separation of variables is the Kronecker sum.
As an example we consider the 2D discrete Laplacian on a regular grid:
where and are 1D discrete Laplacians in the x- and y-directions, correspondingly, and are the identities of appropriate sizes. See the main article Kronecker sum of discrete Laplacians for details.
References
- A. D. Polyanin, Handbook of Linear Partial Differential Equations for Engineers and Scientists, Chapman & Hall/CRC Press, Boca Raton, 2002. ISBN 1-58488-299-9.
- 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
My blog: http://www.primaboinca.com/view_profile.php?userid=5889534 - 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
My blog: http://www.primaboinca.com/view_profile.php?userid=5889534
External links
- Other Sports Official Kull from Drumheller, has hobbies such as telescopes, property developers in singapore and crocheting. Identified some interesting places having spent 4 months at Saloum Delta.
my web-site http://himerka.com/ - Template:Mathworld2
- Methods of Generalized and Functional Separation of Variables at EqWorld: The World of Mathematical Equations
- Examples of separating variables to solve PDEs
- "A Short Justification of Separation of Variables"