 Nonlinear filter

A nonlinear filter is a signalprocessing device whose output is not a linear function of its input. Terminology concerning the filtering problem may refer to the time domain (state space) showing of the signal or to the frequency domain representation of the signal. When referring to filters with adjectives such as "bandpass, highpass, and lowpass" one has in mind the frequency domain. When resorting to terms like "additive noise", one has in mind the time domain, since the noise that is to be added to the signal is added in the state space representation of the signal. The state space representation is more general and is used for the advanced formulation of the filtering problem as a mathematical problem in probability and statistics of stochastic processes.
Contents
Frequency domain
In signal processing one often deals with obtaining an input signal and processing it into an output signal. At times the signal may be transmitted through a channel which corrupts it, resulting in a noisy output. As a consequence, the user at the output end has to attempt to reconstruct the original signal given the noisy one. When the noise is additive, i.e. it is added to the signal (rather than multiplied for example) and the statistics of the noise process are known to follow the gaussian statistical law, then a linear filter is known to be optimal under a number of possible criteria (for example the mean square error criterion, aiming at minimizing the variance of the error). This optimality is one of the main reasons why linear filters are so important in the history of signal processing.
However, in several cases one cannot find an acceptable linear filter, either because the noise is nonadditive or nongaussian. For example, linear filters can remove additive high frequency noise if the signal and the noise do not overlap in the frequency domain. Still, in twodimensional signal processing the signal may have important and structured high frequency components, like edges and small details in image processing. In this case a linear lowpass filter would blur sharp edges and yield bad results. Nonlinear filters should be used instead.
Nonlinear filters locate and remove data that is recognised as noise. The algorithm is 'nonlinear' because it looks at each data point and decides if that data is noise or valid signal. If the point is noise, it is simply removed and replaced by an estimate based on surrounding data points, and parts of the data that are not considered noise are not modified at all. Linear filters, such as those used in bandpass, highpass, and lowpass, lack such a decision capability and therefore modify all data. Nonlinear filters are sometimes used also for removing very short wavelength, but high amplitude features from data. Such a filter can be thought of as a noise spikerejection filter, but it can also be effective for removing short wavelength geological features, such as signals from surficial features.
Examples of nonlinear filters include:
 phaselocked loops
 detectors
 mixers
 median filters
 ranklets
When moving to the time domain description of a system, in state space form, there is the possibility of describing more effectively the dynamics of a system, considering also the case where the timeevolution of the system is described by nonlinear differential (or difference in discrete time) equations, or the case where the observations are a known nonlinear function of the signal then perturbed by additive noise. These are possible further sources of nonlinearity, besides nonadditive or nongaussian noise, for which in most cases we have to move into the state space description of a system and abandon the frequency domain formulation.
Time domain: nonlinear filter (estimation theory)
When moving in the time domain and mostly under the state space representation of a system, one can have the most general formulation of the nonlinear filtering problem, see also "filtering problem (stochastic processes)". In this context, and more generally in estimation theory, control theory, and engineering, a nonlinear filter is an algorithm that estimates the state of a (stochastic) dynamical system from noisy measurements, where either the system dynamics model or measurement model is a nonlinear function of the state. When the system is linear the optimal solution is the Kalman filter. The problem of optimal nonlinear filtering was solved by Ruslan L. Stratonovich (1959,^{[1]}^{[2]} 1960^{[3]}^{[4]}), see also Harold J. Kushner's work ^{[5]} and Moshe Zakai's, who introduced a simplified dynamics for the unnormalized conditional law of the filter^{[6]} known as Zakai equation. Its linear case is known as the Kalman filter (or KalmanBucy filter). The KushnerStratonovich solution to the nonlinear filtering problem in continuous time takes the form of a mathematical object called Stochastic Partial Differential Equation. It has been proved by Mireille ChaleyatMaurel and Dominique Michel^{[7]} that the solution is infinite dimensional in general, and as such requires finite dimensional approximations. These may be heuristicsbased such as the Extended Kalman Filter or the Assumed Density Filters described in Peter S. Maybeck's book ^{[8]} or more methodologically driven such as the projection filters introduced by Damiano Brigo, Bernard Hanzon and François Le Gland,^{[9]} some subfamilies of which are shown to coincide with the Assumed Density Filters.^{[10]}
See also
 Nonlinearity
 Filtering problem (stochastic processes)
References
 ^ Stratonovich, R.L. (1959). Optimum nonlinear systems which bring about a separation of a signal with constant parameters from noise. Radiofizika, 2:6, pp. 892–901.
 ^ Stratonovich, R.L. (1959). On the theory of optimal nonlinear filtering of random functions. Theory of Probability and its Applications, 4, pp. 223–225.
 ^ Stratonovich, R.L. (1960) Application of the Markov processes theory to optimal filtering. Radio Engineering and Electronic Physics, 5:11, pp. 1–19.
 ^ Stratonovich, R.L. (1960). Conditional Markov Processes. Theory of Probability and its Applications, 5, pp. 156–178.
 ^ Kushner, Harold. (1967). Nonlinear filtering: The exact dynamical equations satisfied by the conditional mode. Automatic Control, IEEE Transactions on Volume 12, Issue 3, Jun 1967 Page(s): 262  267
 ^ Zakai, Moshe (1969), On the optimal filtering of diffusion processes. Zeit. Wahrsch. 11 230–243. MR242552  zbl = 0164.19201  doi = 10.1007/BF00536382
 ^ ChaleyatMaurel, Mireille and Dominique Michel. Des resultats de non existence de filtre de dimension finie. Stochastics, 13(1+2):83102, 1984.
 ^ Maybeck, Peter S., Stochastic models, estimation, and control, Volume 141, Series Mathematics in Science and Engineering, 1979, Academic Press
 ^ Brigo, Damiano, Hanzon, Bernard and François LeGland, A Differential Geometric approach to nonlinear filtering: the Projection Filter, IEEE Transactions on Automatic Control Vol. 43, 2 (1998), pp 247252.
 ^ Brigo, Damiano, Hanzon, Bernard and François Le Gland, Approximate Nonlinear Filtering by Projection on Exponential Manifolds of Densities, Bernoulli, Vol. 5, N. 3 (1999), pp. 495534
Further reading
 Jazwinski, Andrew H. (1970). Stochastic Processes and Filtering Theory. New York: Academic Press. ISBN 0123815509.
External links
Categories: Filter theory
Wikimedia Foundation. 2010.
Look at other dictionaries:
nonlinear filter — netiesinis filtras statusas T sritis automatika atitikmenys: angl. nonlinear filter vok. nichtlineares Filter, n rus. нелинейный фильтр, m pranc. filtre non linéaire, m … Automatikos terminų žodynas
Nonlinear photonic crystal — Nonlinear photonic crystals are usually used as quasi phase matching materials. They can be either one dimensional[1] or two dimensional.[2] Nonlinear Photonic Crystals Broadly speaking, nonlinear photonic crystals (PC) are periodic structures… … Wikipedia
Extended Kalman filter — In estimation theory, the extended Kalman filter (EKF) is the nonlinear version of the Kalman filter which linearizes about the current mean and covariance. The EKF is often considered the de facto standard in the theory of nonlinear state… … Wikipedia
Linear filter — A linear filter applies a linear operator to a time varying input signal. Linear filters are very common in electronics and digital signal processing (see the article on electronic filters), but they can also be found in mechanical engineering… … Wikipedia
nichtlineares Filter — netiesinis filtras statusas T sritis automatika atitikmenys: angl. nonlinear filter vok. nichtlineares Filter, n rus. нелинейный фильтр, m pranc. filtre non linéaire, m … Automatikos terminų žodynas
Kalman filter — Roles of the variables in the Kalman filter. (Larger image here) In statistics, the Kalman filter is a mathematical method named after Rudolf E. Kálmán. Its purpose is to use measurements observed over time, containing noise (random variations)… … Wikipedia
Ensemble Kalman filter — The ensemble Kalman filter (EnKF) is a recursive filter suitable for problems with a large number of variables, such as discretizations of partial differential equations in geophysical models. The EnKF originated as a version of the Kalman filter … Wikipedia
KalmanFilter — Das Kalman Filter ist ein nach seinem Entdecker Rudolf E. Kálmán benannter Satz von mathematischen Gleichungen. Mithilfe dieses Filters sind bei Vorliegen lediglich fehlerbehafteter Beobachtungen Rückschlüsse auf den Zustand von vielen der… … Deutsch Wikipedia
KalmanBucyFilter — Das Kalman Filter ist ein nach seinem Entdecker Rudolf E. Kálmán benannter Satz von mathematischen Gleichungen. Mithilfe dieses Filters sind bei Vorliegen lediglich fehlerbehafteter Beobachtungen Rückschlüsse auf den exakten Zustand von… … Deutsch Wikipedia
KálmánFilter — Das Kalman Filter ist ein nach seinem Entdecker Rudolf E. Kálmán benannter Satz von mathematischen Gleichungen. Mithilfe dieses Filters sind bei Vorliegen lediglich fehlerbehafteter Beobachtungen Rückschlüsse auf den exakten Zustand von… … Deutsch Wikipedia