- Polynomial interpolation
In the mathematical subfield of
numerical analysis, polynomial interpolation is the interpolationof a given data setby a polynomial. In other words, given some data points (such as obtained by sampling), the aim is to find a polynomial which goes exactly through these points.
Polynomials can be used to approximate more complicated curves, for example, the shapes of letters in
typography, given a few points. A related application is the evaluation of the natural logarithmand trigonometric functions: pick a few known data points, create a lookup table, and interpolate between those data points. This results in significantly faster computations. Polynomial interpolation also forms the basis for algorithms in numerical quadratureand numerical ordinary differential equations.
Polynomial interpolation is also essential to perform sub-quadratic multiplication and squaring such as
Karatsuba multiplicationand Toom–Cook multiplication, where an interpolation through points on a polynomial which defines the product yields the product itself. For example, given "a" = "f"("x") = "a"0"x"0 + "a"1"x"1 + ... and "b" = "g"("x") = "b"0"x"0 + "b"1"x"1 + ... then the product "ab" is equivalent to "W"("x") = "f"("x")"g"("x"). Finding points along "W"("x") by substituting "x" for small values in "f"("x") and "g"("x") yields points on the curve. Interpolation based on those points will yield the terms of "W"("x") and subsequently the product "ab". In the case of Karatsuba multiplication this technique is substantially faster than quadratic multiplication, even for modest-sized inputs. This is especially true when implemented in parallel hardware.
Given a set of "n"+1 data points ("x""i","y""i") where no two "x""i" are the same, one is looking for a polynomial "p" of degree at most "n" with the property:
The unisolvence theorem states that such a polynomial "p" exists and is unique.
In more sophisticated terms, the theorem states that for "n"+1 interpolation nodes ("x""i"), polynomial interpolation defines a linear
bijection:where is the vector spaceof polynomials with degree "n" or less.
Constructing the interpolation polynomial
Suppose that the interpolation polynomial is in the form:The statement that "p" interpolates the data points means that:If we substitute equation (1) in here, we get a
system of linear equationsin the coefficients . The system in matrix-vector form reads :We have to solve this system for to construct the interpolant
The matrix on the left is commonly referred to as a
Vandermonde matrix. Its determinantis nonzero, which proves the unisolvence theorem: there exists a unique interpolating polynomial.
The condition number of the Vandermonde matrix may be large [cite journal|last=Gautschi|first=Walter|title=Norm Estimates for Inverses of Vandermonde Matrices|journal=Numerische Mathematik|volume=23|pages=337–347|year=1975|doi=10.1007/BF01438260] , causing large errors when computing the coefficients if the system of equations is solved using
Gauss elimination. Several authors have therefore proposed algorithms which exploit the structure of the Vandermonde matrix to compute numerically stable solutions in operations instead of the required by Gaussian elimination. [cite journal|last=Higham|first=N. J.|title=Fast Solution of Vandermonde-Like Systems Involving Orthogonal Polynomials|journal=IMA Journal of Numerical Analysis|volume=8|pages=473–486|year=1988|doi=10.1093/imanum/8.4.473] [cite journal|last=Björck|first=Å|coauthors=V. Pereyra|title=Solution of Vandermonde Systems of Equations|journal=Mathematics of Computation|volume=24|number=112|pages=893–903|year=1970|doi=10.2307/2004623] [cite journal|author=Calvetti, D and Reichel, L|title=Fast Inversion of Vanderomnde-Like Matrices Involving Orthogonal Polynomials|journal=BIT|number=33|pages=473–484|year=1993|doi=10.1007/BF01990529|volume=33] These methods rely on constructing first a Newton interpolation of the polynomial and then converting it to the monomial form above.
We are trying to construct our unique interpolation polynomial in the vector space that is the vector space of polynomials of degree "n". When using a
monomial basisfor we have to solve the Vandermonde matrix to construct the coefficients for the interpolation polynomial. This can be a very costly operation (as counted in clock cycles of a computer trying to do the job). By choosing another basis for we can simplify the calculation of the coefficients but then we have to do additional calculations when we want to express the interpolation polynomial in terms of a monomial basis.
One method is to write the interpolation polynomial in the
Newton formand use the method of divided differencesto construct the coefficients, e.g. Neville's algorithm. The cost is O operations, while Gaussian elimination costs O operations. Furthermore, you only need to do a bit of extra work if an extra point is added to the data set, while for the other methods, you have to redo the whole computation.
Another method is to use the
Lagrange formof the interpolation polynomial. The resulting formula immediately shows that the interpolation polynomial exists under the conditions stated in the above theorem.
Bernstein formwas used in a constructive proof of the Weierstrass approximation theoremby Bernstein and has nowadays gained great importance in computer graphics in the form of Bezier curves.
When interpolating a given function "f" by a polynomial of degree "n" at the nodes "x""0",...,"x""n" we get the error
is the notation for
divided differences. When "f" is "n"+1 times continuously differentiable on the smallest interval "I" which contains the nodes "x""i" and "x" then we can write the error in the Lagrange form as
for some in "I". Thus the remainder term in the Lagrange form of the Taylor theorem is a special case of interpolation error when all interpolation nodes "x""i" are identical.
In the case of equally spaced interpolation nodes , it follows that the interpolation error is O. However, this does not yield any information on what happens when . That question is treated in the section "Convergence properties".
The above error bound suggests choosing the interpolation points "x""i" such that the product | ∏ ("x" − "x""i") | is as small as possible. The
Chebyshev nodesachieve this.
:"See the main article: Lebesgue constant."
We fix the interpolation nodes "x"0, ..., "x""n" and an interval ["a", "b"] containing all the interpolation nodes. The process of interpolation maps the function "f" to a polynomial "p". This defines a mapping "X" from the space "C"( ["a", "b"] ) of all continuous functions on ["a", "b"] to itself. The map "X" is linear and it is a projection on the subspace Π"n" of polynomials of degree "n" or less.
The Lebesgue constant "L" is defined as the
operator normof "X". One has (a special case of Lebesgue's lemma)::In other words, the interpolation polynomial is at most a factor ("L"+1) worse than the best possible approximation. This suggests that we look for a set of interpolation nodes that "L" small. In particular, we have for Chebyshev nodes::We conclude again that Chebyshev nodes are a very good choice for polynomial interpolation, as the growth in "n" is exponential for equidistant nodes. However, those nodes are not optimal.
It is natural to ask, for which classes of functions and for which interpolation nodes the sequence of interpolating polynomials converges to the interpolated function as the degree "n" goes to infinity? Convergence may be understood in different ways, e.g. pointwise, uniform or in some integral norm.
The situation is rather bad for equidistant nodes, in that uniform convergence is not even guaranteed for infinitely differentiable functions. One classical example, due to Carle Runge, is the function "f"("x") = 1 / (1 + "x"2) considered on the interval [−5, 5] . The interpolation error ||"f" − "p""n"||∞ grows without bound as "n" → ∞. Another example is the function "f"("x") = |"x"| on the interval [−1, 1] , for which the interpolating polynomials do not even converge pointwise except at the three points "x" = −1, 0, and 1. [Watson (1980, p. 21) attributes the last example to Bernstein (1912).]
One might think that better convergence properties may be obtained by choosing different interpolation nodes. The following theorem seems to be a rather encouraging answer: :For any function "f"("x") continuous on an interval ["a","b"] there exists a table of nodes for which the sequence of interpolating polynomials converges to "f"("x") uniformly on ["a","b"] .
Proof. It's clear that the sequence of polynomials of best approximation converges to "f"("x") uniformly (due to
Weierstrass approximation theorem). Now we have only to show that each may be obtained by means of interpolation on certain nodes. But this is true due to a special property of polynomials of best approximation known from the Chebyshev alternation theorem. Specifically, we know that such polynomials should intersect "f"("x") at least "n"+1 times. Choosing the points of intersection as interpolation nodes we obtain the interpolating polynomial coinciding with the best approximation polynomial.
The defect of this method, however, is that interpolation nodes should be calculated anew for each new function "f"("x"), but the algorithm is hard to be implemented numerically. Does there exist a single table of nodes for which the sequence of interpolating polynomials converge to any continuous function "f"("x")? The answer is unfortunately negative as it is stated by the following theorem:
:For any table of nodes there is a continuous function "f"("x") on an interval ["a","b"] for which the sequence of interpolating polynomials diverges on ["a","b"] . [Watson (1980, p. 21) attributes this theorem to Faber (1914).]
The proof essentially uses the lower bound estimation of the Lebesgue constant, which we defined above to be the operator norm of "X""n" (where "X""n" is the projection operator on Π"n"). Now we seek a table of nodes for which : for any Due to the
Banach-Steinhaus theorem, this is only possible when norms of "X""n" are uniformly bounded, which cannot be true since we know that
For example, if equidistant points are chosen as interpolation nodes, the function from
Runge's phenomenondemonstrates divergence of such interpolation. Note that this function is not only continuous but even infinitely times differentiable on [−1, 1] . For better Chebyshev nodes, however, such an example is much harder to find because of the theorem:
:For every absolutely continuous function on [−1, 1] the sequence of interpolating polynomials constructed on Chebyshev nodes converges to "f"("x") uniformly.
Runge's phenomenonshows that for high values of "n", the interpolation polynomial may oscillate wildly between the data points. This problem is commonly resolved by the use of spline interpolation. Here, the interpolant is not a polynomial but a spline: a chain of several polynomials of a lower degree.
Using harmonic functions to interpolate a
periodic functionis usually done using Fourier series, for example in discrete Fourier transform. This can be seen as a form of polynomial interpolation with harmonic base functions, see trigonometric interpolationand trigonometric polynomial. Hermite interpolationproblems are those where not only the values of the polynomial "p" are given, but also some derivatives. Birkhoff interpolationis the generalization which allows for some derivatives to be given, without specifying the values of "p" themselves. Collocation methods for the solution of differential and integral equations are based on polynomial interpolation.
The technique of
rational function modelingis a generalization that considers ratios of polynomial functions.
* Kendell A. Atkinson (1988). "An Introduction to Numerical Analysis" (2nd ed.), Chapter 3. John Wiley and Sons. ISBN 0-471-50023-2.
* Sergei N. Bernstein (1912), Sur l'ordre de la meilleure approximation des fonctions continues par les polynômes de degré donné. "Mem. Acad. Roy. Belg." 4, 1–104.
* L. Brutman (1997), Lebesgue functions for polynomial interpolation — a survey, "Ann. Numer. Math." 4, 111–127.
* Georg Faber (1912), Über die interpolatorische Darstellung stetiger Funktionen, "Deutsche Math. Jahr." 23, 192–210.
* M.J.D. Powell (1981). "Approximation Theory and Methods," Chapter 4. Cambridge University Press. ISBN 0-521-29514-9.
* Michelle Schatzman (2002). "Numerical Analysis: A Mathematical Introduction," Chapter 4. Clarendon Press, Oxford. ISBN 0-19-850279-6.
* Endre Süli and David Mayers (2003). "An Introduction to Numerical Analysis," Chapter 6. Cambridge University Press. ISBN 0-521-00794-1.
* G. Alistair Watson (1980). "Approximation Theory and Numerical Methods". John Wiley. ISBN 0-471-27706-1.
* [http://demonstrations.wolfram.com/InterpolatingPolynomial/ Interpolating Polynomial] by
Stephen Wolfram, The Wolfram Demonstrations Project.
Wikimedia Foundation. 2010.
Look at other dictionaries:
Interpolation — In the mathematical subfield of numerical analysis, interpolation is a method of constructing new data points within the range of a discrete set of known data points. In engineering and science one often has a number of data points, as obtained… … Wikipedia
interpolation — /in terr peuh lay sheuhn/, n. 1. the act or process of interpolating or the state of being interpolated. 2. something interpolated, as a passage introduced into a text. 3. Math. a. the process of determining the value of a function between two… … Universalium
Polynomial — In mathematics, a polynomial (from Greek poly, many and medieval Latin binomium, binomial   , the word has been introduced, in Latin, by Franciscus Vieta) is an expression of finite length constructed from variables (also known as… … Wikipedia
Interpolation (computer programming) — In the context of computer animation, interpolation refers to the use of (usually) piecewise polynomial interpolation to draw images semi automatically. For all applications of this type, a set of key points is defined by the graphic artist.… … Wikipedia
Polynomial and rational function modeling — In statistical modeling (especially process modeling), polynomial functions and rational functions are sometimes used as an empirical technique for curve fitting.Polynomial function modelsA polynomial function is one that has the form:y = a… … Wikipedia
Interpolation attack — In cryptography, an interpolation attack is a type of cryptanalytic attack against block ciphers.In the attack, an algebraic function is used to represent an S box. This may be a simple quadratic, or a polynomial or rational function over a… … Wikipedia
Polynomial — Polynôme Courbe polynomiale cubique Un polynôme, en mathématiques, est la combinaison linéaire des produits de puissances d une ou de plusieurs indéterminées, habituellement notées X, Y, Z… Ces objets sont largement utilisés en pratique, ne… … Wikipédia en Français
Newton polynomial — In the mathematical field of numerical analysis, a Newton polynomial, named after its inventor Isaac Newton, is the interpolation polynomial for a given set of data points in the Newton form. The Newton polynomial is sometimes called Newton s… … Wikipedia
Lagrange polynomial — In numerical analysis, a Lagrange polynomial, named after Joseph Louis Lagrange, is the interpolation polynomial for a given set of data points in the Lagrange form. It was first discovered by Edward Waring in 1779 and later rediscovered by… … Wikipedia
Trigonometric interpolation — In mathematics, trigonometric interpolation is interpolation with trigonometric polynomials. Interpolation is the process of finding a function which goes through some given data points. For trigonometric interpolation, this function has to be a… … Wikipedia