This original work offers the most comprehensive and up-to-date treatment of the important subject of optimal linear estimation, which is encountered in many areas of engineering such as communications, control, and signal processing, and also in several other fields, e.g., econometrics and statistics. The book not only highlights the most significant contributions to this field during the 20th century, including the works of Wiener and Kalman, but it does so in an original and novel manner that paves the way for further developments. This book contains a large collection of problems that complement it and are an important part of piece, in addition to numerous sections that offer interesting historical accounts and insights. The book also includes several results that appear in print for the first time.
They say in (9) that the Additive Noise is uncorrelated (By defining its Auto Correlation by Delat Function).
In (10) they say the optimal estimation of $ x \left( t \right) $ is given by $ \hatx \left( t \mid t \right) $ is a linear combination of $ y \left( t \right) $ and $ z \left( t \right) $.
In (11) they exactly use the Orthogonal Principle which the estimator must obey.
In (12) they just derive the Correlation Matrix between the processes.
Since the linear estimator represent the correlation it is not surprising to see that it is the linear combination defined by the optimal filter $ g \left( \cdot \right) $.
Thomas Kailath received the B.E. (Telecom) degree from the College of Engineering, Pune, in India, and S.M. (1959) and Sc.D. (1961) degrees in electrical engineering from the Massachusetts Institute of Technology. He then worked at the Jet Propulsion Labs in Pasadena, CA, before being appointed to Stanford University as Associate Professor of Electrical Engineering in 1963.
Professor Kailath was promoted to Professor in 1968, and was appointed the first holder of the Hitachi America Professorship in 1988. He assumed emeritus status in 2001, but remains active with his research and writing activities. Kailath's research and teaching at Stanford have ranged over several fields of engineering and mathematics: information theory, communications, linear systems, estimation and control, signal processing, semiconductor manufacturing, probability and statistics, and matrix and operator theory. He has also co-founded and served as a director of several high-technology companies.
Professor Kailath has mentored an outstanding array of over a hundred doctoral and postdoctoral scholars. Their joint efforts have led to over 300 journal papers, several of which have received outstanding paper prizes; they have also led to a dozen patents and to several books and monographs, including the major textbooks: Linear Systems (1980) and Linear Estimation (2000). Kailath received the IEEE Medal of Honor in 2007 for "exceptional contributions to the development of powerful algorithms for communications, control, computing and signal processing".
Among Professor Kailath's other major honors are the Shannon Award of the IEEE Information Theory Society; the IEEE Education Medal and the IEEE Signal Processing Medal; honorary degrees from universities in Sweden, Scotland, Spain, France, India and Israel; the Padma Bhushan, a high civilian award of the Government of India; the 2009 Spanish BBVA Foundation Prize for Information and Communication Technologies; membership of the U.S. National Academy of Engineering and the U.S. National Academy of Sciences; and, among others, foreign membership of the Royal Society of London, the Royal Spanish Academy of Engineering, the Indian National Academy of Engineering and the Indian Academy of Sciences.
Thomas Kailath (born June 7, 1935) is an Indian born American electrical engineer, information theorist, control engineer, entrepreneur and the Hitachi America Professor of Engineering emeritus at Stanford University. Professor Kailath has authored several books, including the well-known book Linear Systems, which ranks as one of the most referenced books in the field of linear systems.
Kailath is Hitachi America Professor of Engineering emeritus at Stanford University. Here he has supervised about 80 Ph.D. theses. Kailath's research work has encompassed linear systems, estimation and control theory, signal processing, information theory and semiconductor device fabrication.[5][6][7]
We first describe how noticing analogies between studies of the Wiener-Hopf equation in the statistical theories of prediction and filtering and in the earlier researches of V. Ambartzumian and S. Chandrasekhar in radiative transfer theory led to fast implementations of the Kalman filter for constant parameter state space systems. Further exploration led to the concept of Displacement Structure and the development of fast algorithms (and efficient integrated circuit implementations thereof) for a host of problems in several fields, including communications, control, signal processing, linear algebra and operator theory.
After his studies at the Massachusetts Institute of Technology (Sc.D., 1961), Thomas Kailath was invited by S. Golomb to join the Communications Research Group at the Jet Propulsion Laboratory in Pasadena, CA, in a section led by A. Viterbi. He also held a visiting appointment at Caltech, which perhaps had a role in his move in 1963 to Stanford University, where he is now Hitachi America Professor of Engineering, Emeritus. Over the years, aided by a stellar array of over a hundred doctoral and postdoctoral scholars, his research has ranged over several fields, including information theory, linear systems, estimation and control, signal processing, semiconductor manufacturing, probability and statistics, and matrix and operator theory. Major honors include the IEEE Education and Signal Processing Medals and the IEEE Medal of Honor in 2007. He has also held Guggenheim and Churchill Fellowships, received several honorary degrees, co-founded companies with his students, and been elected to the U.S. National Academy of Engineering, the U.S. National Academy of Sciences, the American Academy of Arts and Sciences, the Silicon Valley Engineering Hall of Fame and several foreign academies. In 2009, he received a Padma Bhushan national award from the President of India, the Blaise Pascal Medal from the European Academy of Sciences, and was elected as a Foreign Member of the Royal Society of London.
It must be with some trepidation that one ventures to speak about the problems of linear estimation to an audience already well familiar with the overwhelmingly more difficult nonlinear filtering problem. However, perhaps to compensate for this spectacle, the organizers have given me the opportunity to speak first, with considerable latitude in the choice of my topics.
Dr. Thomas Kailath was born on June 7, 1935, in Poona, India. Dating back to his early writings in the late 1950s, Dr. Kailath recognized that engineering theory would play a critical role in meeting technological challenges in the disciplines of communication, computation, control and signal processing. Since then, his theoretical work has led to fundamental breakthroughs in communications, information theory, signal detection and estimation, sensor array signal processing, VLSI architectures for signal processing and semiconductor manufacturing. He also contributed to probability and statistics, linear algebra, and matrix and operator theory.
He has written several books, authored or co-authored over 300 journal articles and papers, and shared in the development of 13 patents. Specific contributions by him and his over ninety Ph.D. students and postdoctoral scholars include algorithms for feedback communications, universal estimator-correlator detector structures for random signals in noise and the concept of displacement structure leading to fast algorithms in many fields, such as estimation, control, direction of arrival estimation, adaptive filtering, channel identification and equalization, VLSI systems for signal processing, matrix theory and linear algebra. Much of his early work outpaced what could be implemented at the time. As technology advanced, Dr. Kailath and his students were able to successfully address industrial issues in areas such as optical lithography and multiple antenna wireless communications.
Much of the research I have performed has been carried out with some 100 doctoral and postdoctoral scholars over the last four decades and has ranged over many areas of electrical engineering (information and communication theory, statistical signal detection and estimation, linear system theory, control theory, inverse scattering, sensor array processing, VLSI design, and computation) and mathematics (stochastic processes, operator theory, linear algebra, and interpolation theory). I have particularly enjoyed working at the interfaces of these fields, carrying tools and insights across various disciplinary boundaries. My current major interests are in the area of semiconductor manufacturing and in developing fast algorithms for many applications by identifying and exploiting we have called "displacement structure" in the problem. In the first area I have introduced multi-variable system identification and control techniques to generate (essentially) arbitrary temperature profiles across a wafer, a possibility that can significantly increase the yield of thermal processing operations in many fields. So also in optical lithography, concepts of signal processing have been successfully introduced to break the "0.1 um barrier" in optical lithography.
Kailath befasste sich unter anderem mit Signalverarbeitung und Signal-Detektion einschließlich der Entwicklung von Antennen. Mit seinem Doktoranden Ralph Schmidt entwickelte er Grundlagen für bessere Richtungssensitivität der Signaldetektion in Antennen-Arrays, aus welcher der Esprit Algorithmus von Arogyaswami Paulraj entstand (patentiert von Paulraj und Kailath) und in den 1990er Jahren MIMO Antennensysteme (multiple input-multiple output). Weiter befasste er sich mit dem Entwurf von VLSI-Schaltkreisen, insbesondere für Signalverarbeitung, und zugehöriger Algorithmenentwicklung, mit linearen Systemen, über die er 1980 ein einflussreiches Lehrbuch veröffentlichte, mit Beiträgen zu zugehörigen mathematischen Gebieten wie Linearer Algebra und in den 1990er Jahren mit Chip-Fertigung. Mit seinem Kollegen Stephen Boyd entwickelte er eine Methode mit mehreren Wärmequellen die Wafer jeder für sich schnell und kontrolliert in Öfen zu erhitzen und er befasste sich mit optischen Verzerrungen bei der Lithographie und deren Ausgleich (Phase-shift Masks), vermarktet mit seiner Firma Numerical Technologies.
aa06259810