As a response to the problem formulated above, we
have developed a novel class of
algorithms
for tracking smooth but fast variations in the parameters of
linear regression models, in particular FIR models.
The novel design technique is the subject of a
PhD Thesis
by Lars Lindbom.
The performance of a resulting low-complexity algorithm,
the Simplified Wiener-LMS or SWLMS scheme, is illustrated below.
It is compared to a well-tuned LMS algorithm
for a time-varying parameter typical of the IS-136 environment.
The (patented) SWLMS algorithm works well in
IS-136 equalizers
also in difficult situations
with flat fading, i.e. for single-tap FIR channels.
While the novel technique for analysis and design
has been inspired by
mobile radio applications, the results have wider significance.
The key tool is a Wiener filtering approach
to the design of tracking algorithms.
From this viewpoint, the understanding of algorithms such as LMS,
momentum LMS
and signed regressor LMS can be improved
and a general class of algorithms with time-invariant gains can be
proposed and optimized.
The new class of algorithms
combines low computational complexity
with the possibility for a significant performance increase
as compared to LMS/windowed RLS.
This is attained by
introducing stochastic "hypermodels"
which describe the second order properties of
the vector of time-varying parameters:
h(t+1) = F h(t) + C
e(t) , or
D h(t) = C
e(t) .
Here, h(t) is the parameter column vector, while
F, C and
D = qI
- F
are polynomial
matrices in the shift operator q and
e(t) is a white noise column vector.
The optimal structure of an adaptation algorithm
with constant adaptation gain will then be as follows:
hh(t+k|t) = F
hh(t+k-1|t-1) +
G fi(t) eps(t) , (a)
where
| hh( . ) |
is the parameter estimate (column vector) |
| fi(t) |
is the transposed regressor matrix |
| eps(t) |
is the prediction error, or output error |
| F |
is obtained directly from the hypermodel, while |
| G |
is in general a matrix of transfer functions. |
The LMS algorithm is obtained if
F = I and if
G
is a diagonal
matrix containing adaptation gains. This structure is optimal only
if the true parameter vector
h(t)
has random walk statistics
h(t+1) = h(t) + e(t).
The polynomial matrix
F will
be given directly by the
hypermodel. The adjustment of
G which
provides a minimal sum of
squared parameter errors can be obtained by solving a linear
(Wiener) design problem.
This problem is illustrated below, where
R is
the covariance matrix of the regressors and the
leftmost block represents the hypermodel.
The rational matrix
G in the adaptation law (a)
is uniquely determined by the resulting
optimal stable rational matrix
Lk below.
The Wiener problem can in general be solved via
a spectral factorization
and a bilateral Diophantine equation.
In simplified but powerful variants, the design
equations become trivial, and no equations
need to be solved.
The design can also be made
robust
against uncertainties in the hypermodels.
Adaptation laws for parameter prediction (k>0), filtering
(k=0) and fixed lag smoothing (k<0) can be derived.
The use of smoothing improves the attainable performance,
while multistep prediction of channel coefficients
is of interest e.g. in adaptive Viterbi receivers for TDMA
mobile radio systems, or in power control algorithms in CDMA.
In digital communications, the resulting tracking algorithms
can be applied to the multi-input multi-output FIR channels
appearing in
multiuser detection,
in CDMA systems as well as in OFDM systems.
In other applications,
the method can be applied to time-varying output error models
and various functional series models.
A restriction is that analysis and design has not yet been
developed for models with lagged output data as regressors,
such as ARMA models.
This work has also resulted in an analysis leading to
exact expressions for parameter error
covariances for fast time-variations, in situations
of relevance for mobile communications.