Fast Fourier Transforms by C. Sidney Burrus, Matteo Frigo, Steven G. Johnson, - HTML preview

PLEASE NOTE: This is an HTML preview only and some elements such as links or page numbers may be incorrect.
Download the book in PDF, ePub, Kindle for a complete version.

Chapter 6Factoring the Signal Processing Operators

A third approach to removing redundancy in an algorithm is to express the algorithm as an operator and then factor that operator into sparse factors. This approach is used by Tolimieri 4, 5, Egner 3, Selesnick, Elliott 2 and others. It is presented in a more general form in DFT and FFT: An Algebraic View The operators may be in the form of a matrix or a tensor operator.

The FFT from Factoring the DFT Operator

The definition of the DFT in Multidimensional Index Mapping: Equation 1 can written as a matrix-vector operation by C=WX which, for N=8 is

(6.1)
_autogen-svg2png-0003.png

which clearly requires N2=64 complex multiplications and N(N–1) additions. A factorization of the DFT operator, W, gives _autogen-svg2png-0007.png and _autogen-svg2png-0008.png or, expanded,

(6.2)
_autogen-svg2png-0009.png
(6.3)
_autogen-svg2png-0010.png

where the Fi matrices are sparse. Note that each has 16 (or 2N) non-zero terms and F2 and F3 have 8 (or N) non-unity terms. If N=2M, then the number of factors is log(N)=M. In another form with the twiddle factors separated so as to count the complex multiplications we have

(6.4)
_autogen-svg2png-0018.png
(6.5)
_autogen-svg2png-0019.png
(6.6)
_autogen-svg2png-0020.png

which is in the form _autogen-svg2png-0021.png described by the index map. A1, A2, and A3 each represents 8 additions, or, in general, N additions. M1 and M2 each represent 4 (or N/2) multiplications.

This is a very interesting result showing that implementing the DFT using the factored form requires considerably less arithmetic than the single factor definition. Indeed, the form of the formula that Cooley and Tukey derived showing that the amount of arithmetic required by the FFT is on the order of Nlog(N) can be seen from the factored operator formulation.

Much of the theory of the FFT can be developed using operator factoring and it has some advantages for implementation of parallel and vector computer architectures. The eigenspace approach is somewhat of the same type 1.

Algebraic Theory of Signal Processing Algorithms

A very general structure for all kinds of algorithms can be generalized from the approach of operators and operator decomposition. This is developed as “Algebraic Theory of Signal Processing" discussed in the module DFT and FFT: An Algebraic View by Püschel and others 3.

References

  1. Beard, James K. (2003). The FFT in the 21st Century: Eigenspace Processing. Boston: Kluwer.

  2. Elliott, Douglas F. (Ed.). (1987). Handbook of Digital Signal Processing. [Chapter 7 on FFT by Elliott]. San Diego, CA: Academic Press.

  3. Egner, Sebastian and Püschel, Markus. (2001). Automatic Generation of Fast Discrete Signal Transforms. IEEE Transactions on Signal Processing, 49(9), 1992–202.

  4. Tolimieri, Richard and An, Myoung and Lu, Chao. (1989, 1997). Algorithms for Discrete Fourier Transform and Convolution. (second). New York: Springer-Verlag.

  5. Tolimieri, Richard and An, Myoung and Lu, Chao. (1993, 1997). Mathematics of Multidimensional Fourier Transform Algorithms. (second). New York: Springer-Verlag.

Solutions