Taylor series

"Series expansion" redirects here. For other notions of the term, see series.

File:Sintay.svg

As the degree of the Taylor polynomial rises, it approaches the correct function. This image shows <math>\sin x</math> and Taylor approximations, polynomials of degree 1, 3, 5, 7, 9, 11 and 13.

File:Exp series.gif

The exponential function (in blue), and the sum of the first n+1 terms of its Taylor series at 0 (in red).

In mathematics, the Taylor series is a representation of a function as an infinite sum of terms calculated from the values of its derivatives at a single point. It may be regarded as the limit of the Taylor polynomials. Taylor series are named in honour of English mathematician Brook Taylor. If the series uses the derivatives at zero, the series is also called a Maclaurin series, named after Scottish mathematician Colin Maclaurin.

Definition

The Taylor series of a real or complex function f(x) that is infinitely differentiable in a neighborhood of a real or complex number a, is the power series

<math>f(a)+\frac{f'(a)}{1!}(x-a)+\frac{f(a)}{2!}(x-a)^2+\frac{f^{(3)}(a)}{3!}(x-a)^3+\cdots\,,</math>

which in a more compact form can be written as

<math>\sum_{n=0}^{\infin} \frac{f^{(n)}(a)}{n!} (x-a)^{n}\,,</math>

where n! is the factorial of n and f ⁽ⁿ⁾(a) denotes the nth derivative of f evaluated at the point a; the zeroth derivative of f is defined to be f itself and (x − a)⁰ and 0! are both defined to be 1.

Often f(x) is equal to its Taylor series evaluated at x for all x sufficiently close to a. This is the main reason why Taylor series are important.

In the particular case where <math>a = 0</math>, the series is also called a Maclaurin series.

Examples

The Maclaurin series for any polynomial is the polynomial itself.

The Maclaurin series for <math>(1-x)^{-1}</math> is the geometric series

<math>1+x+x^2+x^3+\cdots\!</math>

so the Taylor series for <math>x^{-1}</math> at <math>a=1</math> is

<math>1-(x-1)+(x-1)^2-(x-1)^3+\cdots\!</math>.

By integrating the above Maclaurin series we find the Maclaurin series for <math>-\ln(1 - x)\!</math>, where <math>\ln\!</math> denotes the natural logarithm:

<math>x+\frac{x^2}2+\frac{x^3}3+\frac{x^4}4+\cdots\!</math>

and the corresponding Taylor series for <math>\ln(x)\!</math> at <math>a=1\!</math> is

<math>(x-1)-\frac{(x-1)^2}2+\frac{(x-1)^3}3-\frac{(x-1)^4}4+\cdots\!</math>.

The Maclaurin series for the exponential function <math>e^x</math> at <math> a=0</math> is

<math>1 + \frac{x^1}{1!} + \frac{x^2}{2!} + \frac{x^3}{3!} + \frac{x^4}{4!} + \frac{x^5}{5!}+ \cdots \qquad = \qquad 1 + x + \frac{x^2}{2} + \frac{x^3}{6} + \frac{x^4}{24} + \frac{x^5}{120} + \cdots\!</math>.

The above expansion holds because the derivative of <math>e^x</math> is also <math>e^x</math> and <math>e^0</math> equals 1. This leaves the terms <math>(x-0)^n</math> in the numerator and n! in the denominator for each term in the infinite sum.

Convergence

File:Taylorsine.svg

The sine function (blue) is closely approximated by its Taylor polynomial of degree 7 (pink) for a full period centered at the origin.

File:LogTay.svg

The Taylor polynomials for log(1+x) only provide accurate approximations in the range -1 < x ≤ 1. Note that, for x > 1, the Taylor polynomials of higher degree are worse approximations.

Taylor series need not in general be convergent series, but often they are. The limit of a convergent Taylor series of a function <math>f</math> need not in general be equal to the function value <math>f(x)</math>, but often it is. If <math>f(x)</math> is equal to its Taylor series in a neighborhood of <math>a</math>, it is said to be analytic in this neighborhood. If <math>f(x)</math> is equal to its Taylor series everywhere it is called entire. The exponential function <math>e^x</math> and the trigonometric functions sine and cosine are examples of entire functions. Examples of functions that are not entire include the logarithm, the trigonometric function tangent, and its inverse arctan. For these functions the Taylor series do not converge if <math>x</math> is far from <math>a</math>.

A Taylor series can be used to calculate the value of an entire function in every point, if the value of the function, and of all of its derivatives, are known at a single point. Uses of the Taylor series for entire functions include:

1. The partial sums (the Taylor polynomials) of the series can be used as approximations of the entire function. These approximations are good if sufficiently many terms are included.
2. The series representation simplifies many mathematical proofs.

Pictured on the right is an accurate approximation of sin(x) around the point a = 0. The pink curve is a polynomial of degree seven:

<math>\sin\left( x \right) \approx x - \frac{x^3}{3!} + \frac{x^5}{5!} - \frac{x^7}{7!}\!</math>.

The error in this approximation is no more than <math>\tfrac{|x|^9}{9!}\!</math>. In particular, for <math>|x|<1\!</math>, the error is less than 0.000003.

In contrast, also shown is a picture of the function log(1+x) and some of its Taylor polynomials around a = 0. These approximations converge to the function only in the region -1 < x ≤ 1; outside of this region the higher-degree Taylor polynomials are worse approximations for the function. This is an example of Runge's phenomenon.

Taylor's theorem gives a variety of general bounds on the size of the error in <math>R_{n}(x)</math> incurred in approximating a function by its nth order Taylor polynomial.

History

The Pythagorean philosopher Zeno considered the problem of summing an infinite series to achieve a finite result, but rejected it as an impossibility: the result was Zeno's paradox. Later, Aristotle proposed a philosophical resolution of the paradox, but the mathematical content was apparently unresolved until taken up by Democritus and then Archimedes. It was through Archimedes's method of exhaustion that an infinite number of progressive subdivisions could be performed to achieve a finite trigonometric result. Liu Hui independently employed a similar method a few centuries later.

In the 14th century, the earliest examples of the use of Taylor series and closely-related methods were given by Madhava of Sangamagrama. Though no record of his work survives, writings of later Indian mathematicians suggest that he found a number of special cases of the Taylor series, including those for the trigonometric functions of sine, cosine, tangent, and arctangent. The Kerala school of astronomy and mathematics further expanded his works with various series expansions and rational approximations until the 16th century.

In the 17th century, James Gregory also worked in this area and published several Maclaurin series. It was not until 1715 however that a general method for constructing these series for all functions for which they exist was finally provided by Brook Taylor, after whom the series are now named.

The Maclaurin series was named after Colin Maclaurin, a professor in Edinburgh, who published the special case of the Taylor result in the 18th century.

Properties

File:Expinvsq.svg

The function e^−1/x² is not analytic at x = 0: the Taylor series is identically 0, although the function is not.

If this series converges for every x in the interval (a − r, a + r) and the sum is equal to f(x), then the function f(x) is said to be analytic in the interval (a − r, a + r). If this is true for any r then the function is said to be an entire function. To check whether the series converges towards f(x), one normally uses estimates for the remainder term of Taylor's theorem. A function is analytic if and only if it can be represented as a power series; the coefficients in that power series are then necessarily the ones given in the above Taylor series formula.

The importance of such a power series representation is at least fourfold. First, differentiation and integration of power series can be performed term by term and is hence particularly easy. Second, an analytic function can be uniquely extended to a holomorphic function defined on an open disk in the complex plane, which makes the whole machinery of complex analysis available. Third, the (truncated) series can be used to compute function values approximately (often by recasting the polynomial into the Chebyshev form and evaluating it with the Clenshaw algorithm).

Fourth, algebraic operations can often be done much more readily on the power series representation; for instance the simplest proof of Euler's formula uses the Taylor series expansions for sine, cosine, and exponential functions. This result is of fundamental importance in such fields as harmonic analysis.

Note that there are examples of infinitely differentiable functions f(x) whose Taylor series converge, but are not equal to f(x). For instance, the function defined pointwise by f(x) = e^−1/x² if x ≠ 0 and f(0) = 0 is an example of a non-analytic smooth function. All its derivatives at x = 0 are zero, so the Taylor series of f(x) at 0 is zero everywhere, even though the function is nonzero for every x ≠ 0. This particular pathology does not afflict Taylor series in complex analysis. There, the area of convergence of a Taylor series is always a disk in the complex plane (possibly with radius 0), and where the Taylor series converges, it converges to the function value. Notice that e^−1/z² does not approach 0 as z approaches 0 along the imaginary axis, hence this function is not continuous as a function on the complex plane.

Since every sequence of real or complex numbers can appear as coefficients in the Taylor series of an infinitely differentiable function defined on the real line, the radius of convergence of a Taylor series can be zero. There are even infinitely differentiable functions defined on the real line whose Taylor series have a radius of convergence 0 everywhere.

Some functions cannot be written as Taylor series because they have a singularity; in these cases, one can often still achieve a series expansion if one allows also negative powers of the variable x; see Laurent series. For example, <math>f(x) = e^{-1/x^2}\!</math> can be written as a Laurent series.

The Parker-Sochacki method is a recent advance in finding Taylor series which are solutions to differential equations. This algorithm is an extension of the Picard iteration.

List of Taylor series of some common functions

File:TaylorCosCos.png

The cosine function in the complex plane.

File:TaylorCosPol.png

An 8th degree approximation of the cosine function in the complex plane.

File:TaylorCosAll.png

The two above curves put together.

Several important Maclaurin series expansions follow. All these expansions are valid for complex arguments <math>x\!</math>.

Exponential function:

<math>\mathrm{e}^{x} = \sum^{\infin}_{n=0} \frac{x^n}{n!} = 1 + x + \frac{x^2}{2!} + \frac{x^3}{3!} + \cdots\quad\mbox{ for all } x\!</math>

Natural logarithm:

<math>\ln(1-x) = -\sum^{\infin}_{n=1} \frac{x^n}n\quad\mbox{ for } |x| < 1\!</math>

Finite geometric series:

<math>\frac{1-x^{m + 1}}{1-x} = \sum^{m}_{n=0} x^n\quad\mbox{ for } x \not= 1\mbox{ and } m\in\mathbb{N}_0\!</math>

Infinite geometric series:

<math>\frac{1}{1-x} = \sum^{\infin}_{n=0} x^n\quad\mbox{ for } |x| < 1\!</math>

Variants of the infinite geometric series:

<math>\frac{x^m}{1-x} = \sum^{\infin}_{n=m} x^n\quad\mbox{ for } |x| < 1 \mbox{ and } m\in\mathbb{N}_0\!</math>

<math>\frac{x}{(1-x)^2} = \sum^{\infin}_{n=1}n x^n\quad\mbox{ for } |x| < 1\!</math>

Square root:

<math>\sqrt{1+x} = \sum_{n=0}^\infty \frac{(-1)^n(2n)!}{(1-2n)n!^24^n}x^n \quad\mbox{ for } |x|<1\!</math>

Binomial series (includes the square root for α = 1/2 and the infinite geometric series for α = −1):

<math>(1+x)^\alpha = \sum_{n=0}^\infty {\alpha \choose n} x^n\quad\mbox{ for all } |x| < 1 \mbox{ and all complex } \alpha\!</math>

with generalized binomial coefficients

<math>{\alpha\choose n} = \prod_{k=1}^n \frac{\alpha-k+1}k = \frac{\alpha(\alpha-1)\cdots(\alpha-n+1)}{n!}\!</math>

Trigonometric functions:

<math>\sin x = \sum^{\infin}_{n=0} \frac{(-1)^n}{(2n+1)!} x^{2n+1}\quad = x - \frac{x^3}{3!} + \frac{x^5}{5!} - \cdots\mbox{ for all } x\!</math>

<math>\cos x = \sum^{\infin}_{n=0} \frac{(-1)^n}{(2n)!} x^{2n}\quad = 1 - \frac{x^2}{2!} + \frac{x^4}{4!} - \cdots\mbox{ for all } x\!</math>

<math>\tan x = \sum^{\infin}_{n=1} \frac{B_{2n} (-4)^n (1-4^n)}{(2n)!} x^{2n-1}\quad = x + \frac{x^3}{3} + \frac{2 x^5}{15} + \cdots\mbox{ for } |x| < \frac{\pi}{2}\!</math>

where the Bs are Bernoulli numbers.

<math>\sec x = \sum^{\infin}_{n=0} \frac{(-1)^n E_{2n}}{(2n)!} x^{2n}\quad\mbox{ for } |x| < \frac{\pi}{2}\!</math>

<math>\arcsin x = \sum^{\infin}_{n=0} \frac{(2n)!}{4^n (n!)^2 (2n+1)} x^{2n+1}\quad\mbox{ for } |x| < 1\!</math>

<math>\arctan x = \sum^{\infin}_{n=0} \frac{(-1)^n}{2n+1} x^{2n+1}\quad\mbox{ for } |x| \le 1\!</math>

Hyperbolic functions:

<math>\sinh x = \sum^{\infin}_{n=0} \frac{x^{2n+1}}{(2n+1)!} \quad\mbox{ for all } x\!</math>

<math>\cosh x = \sum^{\infin}_{n=0} \frac{x^{2n}}{(2n)!} \quad\mbox{ for all } x\!</math>

<math>\tanh x = \sum^{\infin}_{n=1} \frac{B_{2n} 4^n (4^n-1)}{(2n)!} x^{2n-1}\quad\mbox{ for } |x| < \frac{\pi}{2}\!</math>

<math>\mathrm{arcsinh} (x) = \sum^{\infin}_{n=0} \frac{(-1)^n (2n)!}{4^n (n!)^2 (2n+1)} x^{2n+1}\quad\mbox{ for } |x| < 1\!</math>

<math>\mathrm{arctanh} (x) = \sum^{\infin}_{n=0} \frac{x^{2n+1}}{2n+1} \quad\mbox{ for } |x| < 1\!</math>

Lambert's W function:

<math>W_0(x) = \sum^{\infin}_{n=1} \frac{(-n)^{n-1}}{n!} x^n\quad\mbox{ for } |x| < \frac{1}{\mathrm{e}}\!</math>

The numbers <math>B_k\!</math> appearing in the summation expansions of tan(x) and tanh(x) are the Bernoulli numbers. The <math>E_k\!</math> in the expansion of sec(x) are Euler numbers.

Calculation of Taylor series

Several methods exist for the calculation of Taylor series of a large number of functions. One can attempt to use the Taylor series as-is and generalize the form of the coefficients, or one can use manipulations such as substitution, multiplication or division, addition or subtraction of standard Taylor series to construct the Taylor series of a function, by virtue of Taylor series being power series. In some cases, one can also derive the Taylor series by repeatedly applying integration by parts. Particularly convenient is the use of computer algebra systems to calculate Taylor series.

First example

Compute the 7^th degree Maclaurin polynomial for the function

<math>f(x)=\ln\cos x, \quad x\in(-\pi/2, \pi/2)\!</math>.

First, rewrite the function as

<math>f(x)=\ln(1+(\cos x-1))\!</math>.

We have for the natural logarithm (by using the big O notation)

<math>\ln(1+x) = x - \frac{x^2}2 + \frac{x^3}3 + \mathcal{O}(x^4)\!</math>

and for the cosine function

<math>\cos x - 1 = -\frac{x^2}2 + \frac{x^4}{24} - \frac{x^6}{720} + \mathcal{O}(x^8)\!</math>

The latter series expansion has a zero constant term, which enables us to substitute the second series into the first one and to easily omit terms of higher order than the 7^th degree by using the big O notation:

<math>\begin{align}f(x)&=\ln(1+(\cos x-1))\\

&=\bigl(\cos x-1\bigr) - \frac12\bigl(\cos x-1\bigr)^2 + \frac13\bigl(\cos x-1\bigr)^3+ \mathcal{O}\bigl((\cos x-1)^4\bigr)\\&=\biggl(-\frac{x^2}2 + \frac{x^4}{24} - \frac{x^6}{720} +\mathcal{O}(x^8)\biggr)-\frac12\biggl(-\frac{x^2}2+\frac{x^4}{24}+\mathcal{O}(x^6)\biggr)^2+\frac13\biggl(-\frac{x^2}2+\mathcal{O}(x^4)\biggr)^3 + \mathcal{O}(x^8)\\ & =-\frac{x^2}2 + \frac{x^4}{24}-\frac{x^6}{720} - \frac{x^4}8 + \frac{x^6}{48} - \frac{x^6}{24} +\mathcal{O}(x^8)\\ & =- \frac{x^2}2 - \frac{x^4}{12} - \frac{x^6}{45}+\mathcal{O}(x^8). \end{align}\!</math> Since the cosine is an even function, the coefficients for all the odd powers x, x^{3, x5, x7, . . . have to be zero.}

Second example

Suppose we want the Taylor series at 0 of the function

<math>g(x)=\frac{e^x}{\cos x}\!</math>.

We have for the exponential function

<math>e^x = \sum^\infty_{n=0} {x^n\over n!} =1 + x + {x^2 \over 2!} + {x^3 \over 3!} + {x^4 \over 4!}+\cdots\!</math>

and, as in the first example,

<math>\cos x = 1 - {x^2 \over 2!} + {x^4 \over 4!} - \cdots\!</math>

Assume the power series is

<math>{e^x \over \cos x} = c_0 + c_1 x + c_2 x^2 + c_3 x^3 + \cdots\!</math>

Then multiplication with the denominator and substitution of the series of the cosine yields

<math>\begin{align} e^x &= (c_0 + c_1 x + c_2 x^2 + c_3 x^3 + \cdots)\cos x\\

&=\left(c_0 + c_1 x + c_2 x^2 + c_3 x^3 + c_4x^4 + \cdots\right)\left(1 - {x^2 \over 2!} + {x^4 \over 4!} - \cdots\right)\\&=c_0 - {c_0 \over 2}x^2 + {c_0 \over 4!}x^4 + c_1x - {c_1 \over 2}x^3 + {c_1 \over 4!}x^5 + c_2x^2 - {c_2 \over 2}x^4 + {c_2 \over 4!}x^6 + c_3x^3 - {c_3 \over 2}x^5 + {c_3 \over 4!}x^7 +\cdots \end{align}\!</math> Collecting the terms up to fourth order yields

<math>=c_0 + c_1x + \left(c_2 - {c_0 \over 2}\right)x^2 + \left(c_3 - {c_1 \over 2}\right)x^3+\left(c_4+{c_0 \over 4!}-{c_2\over 2}\right)x^4 + \cdots\!</math>

Comparing coefficients with the above series of the exponential function yields the desired Taylor series

<math>\frac{e^x}{\cos x}=1 + x + x^2 + {2x^3 \over 3} + {x^4 \over 2} + \cdots\!</math>.

Taylor series as definitions

Classically, algebraic functions are defined by an algebraic equation, and transcendental functions (including those discussed above) are defined by some property that holds for them, such as a differential equation. For example the exponential function is the function which is everywhere equal to its own derivative, and assumes the value 1 at the origin. However, one may equally well define an analytic function by its Taylor series.

Taylor series are used to define functions in diverse areas of mathematics. In particular, this is true in areas where the classical definitions of functions break down. For example, using Taylor series, one may define analytical functions of matrices and operators, such as the matrix exponential or matrix logarithm.

In other areas, such as formal analysis, it is more convenient to work directly with the power series themselves. Thus one may define a solution of a differential equation as a power series which, one hopes to prove, is the Taylor series of the desired solution.

Taylor series in several variables

The Taylor series may also be generalized to functions of more than one variable with

<math>T(x_1,\cdots,x_d) = </math>

<math>=\sum_{n_1=0}^{\infin} \cdots \sum_{n_d=0}^{\infin}

\frac{\partial^{n_1}}{\partial x_1^{n_1}} \cdots \frac{\partial^{n_d}}{\partial x_d^{n_d}} \frac{f(a_1,\cdots,a_d)}{n_1!\cdots n_d!} (x_1-a_1)^{n_1}\cdots (x_d-a_d)^{n_d}\!</math>.

For example, for a function that depends on two variables, x and y, the Taylor series to second order about the point (a, b) is:

<math>f(x,y)\!</math>

<math>\approx f(a,b) + f_x(a,b)(x-a) + f_y(a,b)(y-b) \!</math>

<math>+ \frac{1}{2!}\left[ f_{xx}(a,b)(x-a)^2 + 2f_{xy}(a,b)(x-a)(y-b) + f_{yy}(a,b)(y-b)^2 \right]\!</math>

where the subscripts denote the respective partial derivatives.

A second-order Taylor series expansion of a scalar-valued function of more than one variable can be compactly written as

<math>T(\mathbf{x}) = f(\mathbf{a}) + \mathrm{D} f(\mathbf{a})^T (\mathbf{x} - \mathbf{a}) + \frac{1}{2!} (\mathbf{x} - \mathbf{a})^T \mathrm{D}^2 f(\mathbf{a}) (\mathbf{x} - \mathbf{a}) + \cdots\!

</math>

where <math>D f(\mathbf{a})\!</math> is the gradient and <math>D^2 f(\mathbf{a})\!</math> is the Hessian matrix. Applying the multi-index notation the Taylor series for several variables becomes

<math>T(\mathbf{x}) = \sum_{|\alpha| \ge 0}^{}{\frac{\mathrm{D}^{\alpha}f(\mathbf{a})}{\alpha !}(\mathbf{x}-\mathbf{a})^{\alpha}}\!</math>

in full analogy to the single variable case.

See also

• Taylor's theorem
• Laurent series
• Holomorphic functions are analytic — a proof that a holomorphic function can be expressed as a Taylor power series
• Newton's divided difference interpolation
• Madhava of Sangamagrama (credited with the first use of "Taylor" series)
• Difference engine

References

• Thomas, George B. Jr.; Finney, Ross L. (1996). Calculus and Analytic Geometry (9th ed.). Addison Wesley. ISBN 0-201-53174-7.CS1 maint: Multiple names: authors list (link)
• Greenberg, Michael (1998). Advanced Engineering Mathematics (2nd ed.). Prentice Hall. ISBN 0-13-321431-1.

External links

• Template:MathWorld
• Madhava of Sangamagramma
• Taylor Series Representation Module by John H. Mathews
• "Discussion of the Parker-Sochacki Method"
• Why so much fuss about Taylor Series Expansion?
• Another Taylor visualisation - where you can choose the point of the approximation and the number of derivatives