Accurate And Efficient Global Approximation using Adaptive Polynomial RSM for Complex Mechanical and Vehicular Performance Models

Global approximation using metamodel for complex mathematical function or computer model over a large variable domain is often needed in sensibility analysis, computer simulation, optimal control, and global design optimization of complex, multiphysics systems. To overcome the limitations of the existing response surface (RS), surrogate or metamodel modeling methods for complex models over large variable domain, a new adaptive and regressive RS modeling method using quadratic functions and local area model improvement schemes is introduced. The method applies an iterative and Latin hypercube sampling based RS update process, divides the entire domain of design variables into multiple cells, identifies rougher cells with large modeling error, and further divides these cells along the roughest dimension direction. A small number of additional sampling points from the original, expensive model are added over the small and isolated rough cells to improve the RS model locally until the model accuracy criteria are satisfied. The method then combines local RS cells to regenerate the global RS model with satisfactory accuracy. An effective RS cells sorting algorithm is also introduced to improve the efficiency of model evaluation. Benchmark tests are presented and use of the new metamodeling method to replace complex hybrid electrical vehicle powertrain performance model in vehicle design optimization and optimal control are discussed.

Authors:

• Y. Z. Wu
• Z. Dong
• S. K. You

Keywords:

• Global approximation
• polynomial response surface
• domain decomposition
• domain combination
• multiphysics modeling
• hybrid powertrain optimization

References:

[1] Surrogates Toolbox, http://fchegury.googlepages.com
[2] G. Matheron, "Principles of Geostatistics," Economic Geology, vol. 58,
pp. 1246-1266, 1963.
[3] Sacks, J., Welch, W. J., Mitchell, T.J., and Wynn, H. P., "Design and
Analysis of Computer Experiments," Statistical Science, vol. 4, no. 4,
pp. 409-423, 1989.
[4] Cresssie, N., "Spatial Prediction and Ordinary Kriging," Math. Geol.,
vol. 20, no. 4, pp. 405-421, 1988.
[5] S. N. Lophaven, H. B. Nielsen, and J. S├©ndergaard, "DACE - A
MATLAB Kriging Toolbox," Technical Report IMM-TR-2002-12,
Informatics and Mathematical Modelling, Technical University of
Denmark, 2002.
[6] Hardy, R. L., "Multiquadratic Equations of Topography and Other
Irregular Surfaces," J.Geophus. Res., vol.76, pp.1905-1915, 1971.
[7] M. D. Buhmann, Radial Basis Functions, Cambridge University Press,
Cambridge, UK, 2003.
[8] Martin, J. D., and Simpson, T. W., "A Study on the Use of Kriging
Models to Approximate Deterministic Computer Models," Proceedings
of 2003 ASME Design Engineering Technical Conferences and
Computers and Information in Engineering Conference, Chicago,
Illinois USA, 2003.
[9] Smith, M., "Neural Networks for Statistical Modeling," Von Nostrand
Reinhold, 1993.
[10] Box, G. E. P., and Wilson, K. B., "On the Experimental Attainment of
Optimum Conditions," Journal of the Royal Statistical Society. Series B
Methodological, vol. 13, no. 1, pp.1-45, 1951.
[11] G. E. P. Box, W. G. Hunter, and J. S. Hunter, Statistics for
Experimenters, John Wiley & Sons, New York, 1978.
[12] Myers, R. H., and Montgomery, D. C., Response Surface Methodology:
Process and Product Optimization Using Designed Experiments, John
Wiley& Sons, INC., Toronto, 2002.
[13] S. R. Gunn, "Support Vector Machines for Classification and
Regression," Technical Report, Image Speech and Intelligent Systems
Research Group, University of Southampton, UK, 1997.
[14] Vapnik, V., Golowich, S., and Smola, A., "Support Vector Method for
Function Approximation, Regression Estimation, and Signal
Processing," Advance in Neural Information Processing Systems, MIT
Press, Cambridge, MA, pp. 281-287, 1997.
[15] Prakasvudhisarn, C., Trafalis, T. B., and Raman, S., "Support Vector
Regression for Determination of Minimum Zone," ASME J. Manuf. Sci.
Eng., vol. 125, no. 4, pp. 736-739, 2003.
[16] S. M. Clarke, J. H. Griebsch, and T. W. Simpson, "Analysis of Support
Vector Regression for Approximation of Complex Engineering
Analyses," Journal of Mechanical Design, vol. 127, pp. 1077-1087,
2005.
[17] Friedman, J. H., "Multivariate Adaptive Regression Splines," The
Annals of Statistics, vol. 19, no. 1, pp.1-67, 1991.
[18] Chen, V. C. P., Ruppert, D., and Shoemaker, C. A., "Applying
Experimental Design and Regression Splines to High-Dimensional
Continuous-State Stochastic Dynamic Programming," Oper. Res., vol.
47, pp. 38-53, 1999.
[19] Scott Crino, Donald E. Brown, "Global Optimization With Multivariate
Adaptive Regression Splines," IEEE Transactions on Systems, Man, and
Cybernetics - Part B: Cybernetics, vol. 37, no. 2, pp. 333-340, April
2007.
[20] Steven Richardson, Song Wang, Les S. Jennings. A Multivariate
Adaptive Regression B-Spline Algorithm (BMARS) for Solving a Class
of Nonlinear Optimal Feedback Control Problems. Automatica, vol. 44,
pp. 1149 - 1155, 2008.
[21] Gu, J., Li, G. Y., and Dong, Z., "Hybrid and Adaptive Metamodel Based
Global Optimization," Proc. Proceedings of the ASME 2009
International Design Engineering Technical Conferences &Computers
and Information in Engineering Conference, IDETC/CIE 2009,
DETC2009-87121, San Diego, California, USA, Aug 30 - Sep 2, 2009.
[22] S.N. Lophaven, H.B. Nielsen, J. Sindergaard, Aspects of the Matlab
Toolbox DACE. Report IMM-REP-2002-13, Informatics and
Mathematical Modelling, DTU. (2002), 44 pages, available at
http://www.imm.dtu.dk/»hbn/publ/TR0213.ps
[23] Younis, A., Gu, J., Dong, Z., and Li, G., "Trends, Features, and Tests of
Common and Recently Introduced Global Optimization Methods,"
Proceedings of the 12th AIAA/ISSMO Multidisciplinary Analysis and
Optimization Conference, Victoria, British Columbia Canada, Paper No.
AIAA-2008-5853, 2008.
[24] James R. Simpson , Drew Landman, Rupert Giroux et al, Adapting
Second-order Response Surface Designs to Specific Need. Quality and
Reliability Engineering International. Qual. Reliab. Engng. Int., vol. 24,
pp. 331-349, 2007.
[25] Xuan Son Nguyen, Alain Sellier and Frédéric Duprat. "Adaptive
Response Surface Method Based on a Double Weighted Regression
Technique," Probabilistic Engineering Mechanics, vol. 24, pp. 135-143,
2009.
[26] Armin Iske and Jeremy Levesley. "Multilevel Scattered Data
Approximation by Adaptive Domain Decomposition," Numerical
Algorithms, vol. 39, pp. 187-198, 2005.
[27] Tobin A. Driscoll_, Alfa R.H. Heryudono. "Adaptive Residual
Subsampling Methods for Radial Basis Function Interpolation and
Collocation Problems," Computers and Mathematics with Applications
vol. 53, pp. 927-939, 2007.
[28] Hongbing Fang and Mark F. Horstemeyer. "Global Response
Approximation with Radial Basis Functions," Engineering Optimization.
vol. 38, no. 4, pp. 407-424, June 2006.
[29] Daniel Busby, Chris L. Farmer, and Armin Iske. "Hierarchical Nonlinear
Approximation for Experimental Design and Statistical Data Fitting,"
SIAM J. Sci. Comput. Vol. 29, No. 1, pp. 49-69.
[30] Jay D. Martin. "Computational Improvements to Estimating Kriging
Metamodel Parameters," Journal of Mechanical Design. vol. 131 /
084501-1, August 2009.
[31] Jack P.C. Kleijnen. "Kriging Metamodeling in Simulation: A Review,"
European Journal of Operational Research, Vol. 192, pp. 707-716, 2009.
[32] D. Shahsavani a, and A. Grimvall. "An Adaptive Design and
Interpolation Technique for Extracting Highly Nonlinear Response
Surfaces from Deterministic Models," Reliability Engineering and
System Safety, vol. 94, pp. 1173-1182, 2009.