934 39, ; 2),, ; 3),,, ; 4), ( ) ( ), ; 5),,,,,.,.,,.,, Worst-case [28 30],,,. [31 33]. 90,, H L 1, Worst-case, H [34 39], [40 42]. 80 H L 1..,,

Size: px

Start display at page:

Download "934 39, ; 2),, ; 3),,, ; 4), ( ) ( ), ; 5),,,,,.,.,,.,, Worst-case [28 30],,,. [31 33]. 90,, H L 1, Worst-case, H [34 39], [40 42]. 80 H L 1..,,"

记成滑
7 years ago
Views:

1 39 7 Vol. 39, No ACTA AUTOMATICA SINICA July, 2013 : 1 2 :.,.,,.,,.,,.,,,,. DOI,,,,,,,. :., 2013, 39(7): /SP.J System Identification: New Paradigms, Challenges, and Opportunities WANG Le-Yi 1 ZHAO Wen-Xiao 2 Abstract The traditional paradigm of system identification employs prior information on system structures and environments and input/output observation data to derive system models. Extensive research and development on its methodologies, theoretical foundation, algorithms, verifications, and applications over the past half century have established a mature field with a rich literature and substantial benchmark applications. However, rapid advancement in science, technology, engineering, and social medias has ushered in a new era of systems science and control in which challenges and opportunities are abundant for system identification. In this sense, system identification remains an exciting, young, viable, and critical field that mandates new paradigms to meet such challenges. This article points out some potentially important aspects of system identification in these new paradigms, suggests some worthy areas of research focus, and most importantly opens the forum for further discussions. Key words System identification, uncertainty, information, complexity, networked system, large data processing, integration of identification and decision Citation Wang Le-Yi, Zhao Wen-Xiao. System identification: new paradigms, challenges, and opportunities. Acta Automatica Sinica, 2013, 39(7): Zadeh [1], [2 9]., ;,, Manuscript received July 4, 2012; accepted November 7, 2012 ( , , ) Supported by National Natural Science Foundation of China ( , , ) Recommended by Academician HUANG Lin Department of Electrical and Computer Engineering, Wayne State University, Detroit, Michigan 48202, USA 2. Institute of Systems Science, Chinese Academy of Sciences, Beijing , China ;,,, [8, 10] [8] [11 14] [11] Akaike [15 16] Rissanen [17], [18 21] [22] [23], [24 26],.,,, [27],. : 1),

2 934 39, ; 2),, ; 3),,, ; 4), ( ) ( ), ; 5),,,,,.,.,,.,, Worst-case [28 30],,,. [31 33]. 90,, H L 1, Worst-case, H [34 39], [40 42]. 80 H L 1..,,.,.,, ; ( ).,,,,.,.,.,,. Cyber-physical 3C (Computer, communication, control),..,., :,,,..,,...,.,.,,,,. : 1 ; 2 ; 3 ; 4 ; 5 ; 6 ; 7 ; 8. 1,.,.

3 7 : : 935 [43 45],,.,., [46].,. : 1)..,, ;, ;,.,,.,. Worst-case [29, 47 51]. [49]. 2).,., ( ),,, ;,,,,.,. 3).,.,,.,,.. 4)..,... Google PageRank,, ;,,,,..,.,,.. 2.,,.,,.,,,, ;, ;,, ;, ;, ;,,. [52], [53 54],., [55 56] : 1).,..,,

4 936 39,. 2)...,., /.. [57 59]. 3).,.,,.. 4).,.,, ;,.,. 5)., [60]. [61 63].., : 1), ; 2) ; 3) ; 4), ; 5). 3,., ,,,.,,,, Chebyshev-Markov-Stieltjes Chernoff. [64 65].,.,,.,.,, Wiener [11, 66 67] Hammerstein [68 72] [73 74] ARX [75] [76 77] [78 79] [80 81]..,,,..,,,.,..,, [82].,.,.,,,.,,. :,, ;,

5 7 : : 937, (Illumina Ion Torrent ). 4,,.,,., 50 %.,,,,,.,,,,.,,.,,,.,.,,,,,,.,.., [83 87] :,,. 5,.,.,.,,.,,,,,, ( ) ( Cramer-Rao (CR) ).,,.,,.,..,.,., [88 90], Worst-case.,, [8, 12, 77] CR Fisher. [46, 91].,.,., : 1)., [51, 82, 92 93] [94] [95].,,.,, [87 89]. 2). CR [96] Fisher [97]. Fisher [97 98].,,. 3). Shannon. [99 102]., Shannon.,

6 938 39,. 4)., [103], : P- NP-., P, NP.,,.,.,. [104]. 6,.,,. :,.,,. [105]..,. 1),,.,..,.,.,. 2),.,,... 3)..,.,.,.,. 7 :, Matlab/Simulink [ ].,,,, ;., iphone Facebook,.,,. 8,,,.,.,.,,,,.,,,,,.. 1),... : a).. b).

7 7 : : 939. c).. 2),. ( ) ( ) ( ).. 3),. ( ),..,. 4),..,..,, ( ):,,,,,,,,,.,,. George Zames. H, Zames.. Zames.,. Zames. Zames. George Zames. References 1 Zadeh L A. On the identification problem. IEEE Transactions on Circuits and Systems, 1956, 3(4): Cai Ji-Bin. System Identification. Beijing: Beijing Institute of Technology Press, 1989 (.. :, 1989) 3 Guo Lei, Cheng Dai-Zhan, Feng De-Xing. Introduction to Control Theory: from Basic Concepts to Research Frontiers, Beijing: Science Press, 2005 (,,.. :, 2005) 4 Ljung L, Vicino A. Guest editorial: special issue on system identification. IEEE Transactions on Automatic Control, 2005, 50(10): Gevers M. A personal view of the development of system identification: a 30-year journey through an exciting field. IEEE Control Systems Magazine, 2006, 26(6): Ljung L. Perspectives on system identification. In: Proceedings of the 17th IFAC World Congress. Seoul, South Korea: IFAC, Ljung L, Hjalmarsson H, Ohlsson H. Four encounters with system identification. European Journal of Control, 2011, 17(5 6): Ljung L. System Identification: Theory for the User. Englewood Cliffs, NJ: Prentice-Hall, Chen H F, Guo L. Identification and Stochastic Adaptive Control. Boston, MA: Birkhäuser, Ljung L. Analysis of recursive stochastic algorithms. IEEE Transactions on Automatic Control, 1977, 22(4): Chen H F. Recursive identification for Wiener model with discontinuous piece-wise linear function. IEEE Transactions on Automatic Control, 2006, 51(3): Kushner H J, Yin G. Stochastic Approximation and Recursive Algorithms and Applications (2nd edition). New York: Springer-Verlag, Chen H F, Zhu Y M. Stochastic approximation procedures with randomly varying truncations. Science in China, Series A, 1986, 29(9): Chen H F. Stochastic Approximation and Its Applications. Dordrecht, The Netherlands: Kluwer Academic, Akaike H. A new look at the statistical model identification. IEEE Transactions on Automatic Control, 1974, 19(6):

8 Burnham K P, Anderson D R. Multimodel inference: understanding AIC and BIC in model selection. Sociological Methods and Research, 2004, 33(2): Rissanen J. Modeling by shortest data description. Automatica, 1978, 14(5): Zheng W X, Feng C B. Identification of stochastic time lag systems in the presence of colored noise. Automatica, 1990, 26(4): Zheng W X, Feng C B. A bias-correction method for indirect identification of closed-loop systems. Automatica, 1995, 31(7): Soderstrom T. Accuracy analysis of the Frisch scheme for identifying errors-in-variables systems. IEEE Transactions on Automatic Control, 2007, 52(6): Söderström T, Soverini U, Mahata K. Perspectives on errorsin-variables estimation for dynamic systems. Signal Processing, 2002, 82(8): Forssel U, Ljung L. Closed-loop identification revisited. Automatica, 1999, 35(7): Obinata G, Brian D O A. Model Reduction for Control System Design. London: Springer, Kalman R E. Design of a self-optimising control system. Transactions on ASME, 1958, 80: Aström K J, Wittenmark B. On self tuning regulators. Automatica, 1973, 9(2): Guo L. Convergence and logarithm laws of self-tuning regulators. Automatica, 1995, 31(3): Durrett R. Probability: Theory and Examples (Cambridge Series in Statistical and Probabilistic Mathematics) (4th edition). Cambridge: Cambridge University Press, Zhou Tong. Introduction to Control-Oriented System Identification. Beijing: Tsinghua University Press, 2004 (.. :, 2004 ) 29 Milanese M, Belforte G. Estimation theory and uncertainty intervals evaluation in presence of unknown but bounded errors: linear families of models and estimators. IEEE Transactions on Automatic Control, 1982, 27(2): Milanese M, Vicino A. Optimal estimation theory for dynamic systems with set membership uncertainty: an overview. Automatica, 1991, 27(6): Mäkilä P M, Partington J R, Gustafsson T K. Worst-case control-relevant identification. Automatica, 1995, 31(12): Chen J, Gu G X. Control-Oriented System Identification: An H Approach. New York: Wiley-Interscience, Smith R S, Dahleh M A [Editor]. The modeling of uncertainty in control systems. In: Proceedings of the 1992 Santa Barbara Workshop. Berlin, Germany: Springer-Verlag, Helmicki A J, Jacobson C A, Nett C N. Control oriented system identification: a worst-case/deterministic approach in H. IEEE Transactions on Automatic Control, 1991, 36(10): Gu G X, Khargonekar P P. Linear and nonlinear algorithms for identification in H. IEEE Transactions on Automatic Control, 1992, 37(7): Gu G X, Khargonekar P P. A class of algorithms for identification in H. Automatica, 1992, 28(2): Chen J, Nett C N. The Caratheodory-Fejer problem and H /l 1 identification: a time domain approach. IEEE Transactions on Automatic Control, 1995, 40(4): Chen J, Nett C N, Fan M K H. Worst case system identification in H : validation of a priori information, essentially optimal algorithms, and error bounds. IEEE Transactions on Automatic Control, 1995, 40(7): Zhou T, Kimura H. Time domain identification for robust control. Systems and Control Letters, 1993, 20(3): Chen J. Frequency-domain tests for validation of linear fractional uncertain models. IEEE Transactions on Automatic Control, 1997, 42(6): Poolla K, Khargonekar P, Tikku A, Krause J, Nagpal K. A time-domain approach to model validation. IEEE Transactions on Automatic Control, 1994, 39(5): Smith R S, Doyle J C. Model validation: a connection between robust control and identification. IEEE Transactions on Automatic Control, 1992, 37(7): Anderson T W. The Statistical Analysis of Time Series. New York: Wiley, Serfling R J. Approximation Theorems of Mathematical Statistics. New York: Wiley, Bohlin T. On the maximum likelihood method of identification. IBM Journal of Research and Development, 1970, 14(1): Wang L Y. Uncertainty, information and complexity in identification and control. International Journal of Robust and Nonlinear Control, 2000, 10(11 12): Casini M, Garulli A, Vicino A. Time complexity and input design in worst-case identification using binary sensors. In: Proceedings of the 46th IEEE Conference on Decision and Control. New Orleans, LA, USA: IEEE, Milanese M, Vicino A. Information-based complexity and nonparametric worst-case system identification. Journal of Complexity, 1993, 9(4): Wang L Y, Yin G G. Towards a harmonic blending of deterministic and stochastic frameworks in information processing. Robustness in Identification and Control, Lecture Notes in Control and Information Sciences Volume 245. London: Springer-Verlag, Wang L Y, Yin G G. Persistent identification of systems with unmodeled dynamics and exogenous disturbances. IEEE Transactions on Automatic Control, 2000, 45(7): Dahleh M A, Theodosopoulos T V, Tsitsiklis J N. The sample complexity of worst-case identification of FIR linear systems. Systems and Control Letters, 1993, 20: Chong C Y, Kumar S P. Sensor networks: evolution, opportunities, and challenges. Proceedings of the IEEE, 2003, 91(8): Wang J D, Zheng W X, Chen T W. Identification of linear dynamic systems operating in a networked environment. Automatica, 2009, 45(12):

9 7 : : Zhang Q, Zhang J F. Distributed parameter estimation over unreliable networks with Markovian switching topologies. IEEE Transactions on Automatic Control, 2012, 57(10): Liu X H, Goldsmith A. Wireless communication tradeoffs in distributed control. In: Proceedings of the 42nd IEEE Conference on Decision and Control. Maui, HI: IEEE, Yuksel S, Basar T. Optimal signaling policies for decentralized multicontroller stabilizability over communication channels. IEEE Transactions on Automatic Control, 2007, 52(10): Wang L Y, Zhang J F, Yin G. System identification using binary sensors. IEEE Transactions on Automatic Control, 2003, 48(11): Wang L Y, Yin G, Zhang J F, Zhao Y L. System Identification with Quantized Observations. Boston, MA: Birkhäuser, Wang L Y, Li C Y, Yin G, Guo L, Xu C Z. State observability and observers of linear-time-invariant systems under irregular sampling and sensor limitations. IEEE Transactions on Automatic Control, 2011, 56(11): He T, Lu X L, Wu X Q, Lu J A, Zheng W X. Optimizationbased structure identification of dynamical networks. Physica A: Statistical Mechanics and Its Applications, 2013, 392(4): Zhou T, Wang Y L. Causal relationship inference for a largescale cellular network. Bioinformatics, 2010, 26(16): Wang Y L, Zhou T. A relative variation-based method to unraveling gene regulatory networks. PLoS ONE, 2012, 7(2): e Bolouri H, Bower J M. Computational Modeling of Genetic and Biochemical Networks. Cambridge, Mass: MIT Press, Billings S A. Identification of nonlinear systems a survey. IEE Proceedings D: Control Theory and Applications, 1980, 127(6): Sjöberg J, Zhang Q H, Ljung L, Benveniste A, Delyon B, Glorennec P Y, Hjalmarsson H, Juditskys A. Nonlinear black-box modeling in system identification: a unified overview. Automatica, 1995, 31(12): Verhaegen M, Westwick D. Identifying MIMO Wiener systems using subspace model identification methods. Signal Processing, 1996, 52(2): Bai E W, Reyland J Jr. Towards identification of Wiener systems with the least amount of a priori information on the nonlinearity. Automatica, 2008, 44(4): Bai E W. An optimal two-stage identification algorithm for Hammerstein-Wiener nonlinear system. Automatica, 1998, 34(3): Ninness B, Gibson S. Quantifying the accuracy of Hammerstein model estimation. Automatica, 2002, 38(12): Zhu Y. Estimation of an N-L-N Hammerstein-Wiener model. Automatica, 2002, 38: Bai E W, Li K. Convergence of the iterative algorithm for a general Hammerstein system identification. Automatica, 2010, 46(11): Zhao W X, Chen H F. Adaptive tracking and recursive identification for Hammerstein systems. Automatica, 2009, 45: Zhao W X, Chen H F. Identification of Wiener, Hammerstein, and NARX systems as Markov chains with improved estimates for their nonlinearities. Systems and Control Letters, 2012, 61(12): Mu B Q, Chen H F. Recursive identification of Wiener- Hammerstein systems. SIAM Journal on Control and Optimization, 2012, 50(5): Roll J, Nazin A, Ljung L. Nonlinear system identification via direct weight optimization. Automatica, 2005, 41(3): Zhao Y L, Wang L Y, Yin G G, Zhang J F. Identification of Wiener systems with binary-valued output observations. Automatica, 2007, 43(10): Wang L Y, Yin G G. Asymptotically efficient parameter estimation using quantized output observations. Automatica, 2007, 43(7): Katayama T. Subspace Methods for System Identification. London: Springer, Van Overschee P, de Moor B. A unifying theorem for three subspace system identification algorithms. Automatica, 1995, 31(12): Vidal R. Recursive identification of switched ARX systems. Automatica, 2008, 44(9): Wang J, Chen T. Parameter estimation of periodically switched linear systems. IET Control Theory and Applications, 2012, 6(6): Zames G, Lin L, Wang L Y. Fast identification n-widths and uncertainty principles for LTI and slowly varying systems. IEEE Transactions on Automatic Control, 1994, 39(9): Tan P N, Steinbach M, Kumar V. Introduction to Data Mining. Boston, MA: Addison-Wesley, Sayeed A M. A signal modeling framework for integrated design of sensor networks. In: Proceedings of the 2003 IEEE Workshop Statistical Signal Processing. St. Louis, MO, USA: IEEE, Vapnik V N. Statistical Learning Theory. New York: Wiley- Interscience, Vapnik V N. The Nature of Statistical Learning Theory (Information Science and Statistics for Engineering and Information Science) (2nd edition). New York: Springer Verlag, Vidyasagar M. Learning and Generalization: With Applications to Neural Networks (2nd edition). London: Springer, Kolmogorov A N. On some asymptotic characteristics of completely bounded spaces. Doklady Akademii Nauk SSSR, 1956, 108: (in Russian)

10 942 自动化 89 Pinkus A. N-Widths in Approximation Theory. New York: Springer-Verlag, Traub J F, Wasilkowski G W, Wozniakowski H. Informationbased Complexity. New York: Academic Press, Wang L Y, Yin G G, Zhang J F, Zhao Y L. Space and time complexities and sensor threshold selection in quantized identification. Automatica, 2008, 44(12): Lin L, Wang L Y, Zames G. Time complexity and model complexity of fast identification of continuous-time LTI systems. IEEE Transactions on Automatic Control, 1999, 44(10): Poolla K, Tikku A. On the time complexity of worstcase system identification. IEEE Transactions on Automatic Control, 1994, 39(5): Tse D C N, Dahleh M A, Tsitsiklis J N. Optimal asymptotic identification under bounded disturbances. IEEE Transactions on Automatic Control, 1993, 38(8): Zames G. On the metric complexity of causal linear systems: ε-entropy and ε-dimension for continuous time. IEEE Transactions on Automatic Control, 1979, 24(2): Cramer H. Mathematical Methods of Statistics. Princeton NJ: Princeton University Press, Frieden B R. Science from Fisher Information: A Unification. Cambridge: Cambridge University Press, Hannan E J, Deistler M. The Statistical Theory of Linear Systems. New York: John Wiley and Sons, Cover T M, Thomas J A. Elements of Information Theory. New York: Wiley-Interscience, Gallager R G. Information Theory and Reliable Communication. New York: John Wiley and Sons, Gersho A, Gray R M. Vector Quantization and Signal Compression. Norwell, MA: Kluwer Academic Publishers, Sayood K. Introduction to Data Compression (2nd edition). San Francisco: Morgan Kaufmann, Davis M D, Sigal R, Weyuker E J. Computability, Complexity, and Languages (2nd edition). San Diego: Academic Press, Zurek W H. Complexity, Entropy, and the Physics of Information. Reading, MA: Addison-Wesley, Gevers M. Towards a joint design of identification and control? Essays on Control: Perspectives in the Theory and Its Applications. Boston, MA: Birkha user, Ljung L. System Identification Toolbox for Use with Matlab, User0 s Guide (5th edition). Natick, MA: The MathWorks, Inc. Sherborn, Mass, Garnier H, Gilson M, Laurain V. The CONTSID toolbox for Matlab: Extensions and latest developments. In: Proceedings of the 15th IFAC Symposium on System Identification. Saint-Malo, France, 学报 39 卷 108 Ljung L. Educational aspects of identification software user interfaces. In: Proceedings of the 13th IFAC Symposium on System Identification. Rotterdam, The Netherlands: IFAC, Rivera D E, Lee H, Braun M W, Mittelmann H D. Plantfriendly system identification: a challenge for the process industries. In: Proceedings of the 13th IFAC Symposium on System Identification. Rotterdam, Netherlands: IFAC, 王乐一 1990 年于加拿大蒙特利尔麦吉尔大学电气工程系获得博士学位. 自 1990 起在美国密西根州韦恩州立大学电气与计算机工程系任教, 现任教授, IEEE Fellow. 主要研究方向为系统复杂性及信息, 系统辨识, 鲁棒控制, H 时变系统, 自适应系统, 混合与非线性系统. 本文通信作者. lywang@eng.wayne.edu (WANG Le-Yi Received his Ph. D. degree in electrical engineering from McGill University, Montreal, Canada, in Since 1990, he has been with Wayne State University, Detroit, Michigan, where he is currently a professor in the Department of Electrical and Computer Engineering. He is a fellow of IEEE. His research interest covers complexity and information, system identification, robust control, H optimization, time-varying systems, adaptive systems, hybrid and nonlinear systems. Corresponding author of this paper.) 赵文虓 2003 获得山东大学数学学院学士学位, 2008 获得中国科学院数学与系统科学研究院理学博士学位, 其后曾在清华大学自动化系做博士后, 在澳大利亚西悉尼大学数学系任访问学者. 目前, 任中国科学院数学与系统科学研究院系统科学研究所副研究员. 主要研究方向为系统辨识, 适应控制以及信号处理和系统生物学中的相关问题. wxzhao@amss.ac.cn (ZHAO Wen-Xiao Received the B. Sc. degree from Shandong University, China in 2003 and the Ph. D. degree in operation research and cybernetics from the Institute of Systems Science (ISS), Academy of Mathematics and Systems Science (AMSS), Chinese Academy of Sciences (CAS), China in After graduation, he worked as a postdoctoral fellow in the Department of Automation, Tsinghua University, and a visiting scholar at the School of Mathematics, University of Western Sydney, Australia. He is currently an associate professor with ISS, AMSS, CAS. His research interest covers identification, adaptive control, and systems biology.)

,,.,, : 1),,,,, 2),,,,, 3),,,,,,,,,, [6].,,, ( ),, [9], : 1), 2),,,,, 3),,, 2.,, [10].,,,,,,,,, [11]. 2.1,, [12],, ;, ; Fig. 1 1 Granular hier

,,.,, : 1),,,,, 2),,,,, 3),,,,,,,,,, [6].,,, ( ),, [9], : 1), 2),,,,, 3),,, 2.,, [10].,,,,,,,,, [11]. 2.1,, [12],, ;, ; Fig. 1 1 Granular hier 36 7 Vol. 36, No. 7 2010 7 ACTA AUTOMATICA SINICA July, 2010 1, 2 1, 2, 3 1, 2,,,,,,, DOI,,, 10.3724/SP.J.1004.2010.00923 Distributed Simulation System Hierarchical Design Model Based on Quotient Space