Property Aggregation and Uncertainty with Links to the Management and Determination of Critical Design Features

Within the domain of Systems Engineering the need to perform property aggregation to understand, analyze and manage complex systems is unequivocal. This can be seen in numerous domains such as capability analysis, Mission Essential Competencies (MEC) and Critical Design Features (CDF). Furthermore, the need to consider uncertainty propagation as well as the sensitivity of related properties within such analysis is equally as important when determining a set of critical properties within such a system. This paper describes this property breakdown in a number of domains within Systems Engineering and, within the area of CDFs, emphasizes the importance of uncertainty analysis. As part of this, a section of the paper describes possible techniques which may be used within uncertainty propagation and in conclusion an example is described utilizing one of the techniques for property and uncertainty aggregation within an aircraft system to aid the determination of Critical Design Features.

Authors:

• Steven Whittle
• Ingrida Valiusaityte

Keywords:

• Complex Systems
• Critical Design Features
• Property Aggregation
• Uncertainty.

References:

[1] Alger, Garrity, McCall, Beer, Rodriguez, "Competency-based definition
of work and performance for command and control", Air Force Research
Laboratory, Human Effectiveness Directorate, Contract #F33615-00-C-
6004.
http://www.aptima.net/publications/2003_Alliger_Garrity_McCall_Beer
_Rodriguez.pdf.
[2] S. Symons, F. Michael, J. Bell and W. Bennett,
"Linking Knowledge and Skills to Mission Essential Competency-Based
Syllabus Development for Distributed Mission Operations", Air Force
Research Laboratory, Warfighter Readiness Research Division,
Technical Report No. AFRL-HE-AZ-TR-2006-0041, pp. 1-18, 2006.
[3] W. Bennett, B.T. Schreiber and D.H. Andrews: "Developing
competency-based methods for near-real-time air combat problem
solving assessment", Computers in Human Behaviour, Vol. 18, pp. 773-
782, 2002.
[4] C.M. Colgrove and G.M. Alliger, "Mission Essential Competencies:
Defining Combat Mission Readiness in a Novel Way", SAS-038
Symposium, Brussels, Belgium, No. RTO-MP-099, April 2002.
[5] D.B. Cochrane, "The Evolution of Simulation. The Necessity for
Distributed Mission Training (DMT) in Meeting Future Air Force Flying
Requirements", Canadian Forces College, MDS Research Project CSC
30, pp. 1-94, 2004.
[6] B.T. Schreiber, W.A. Stock, W. Bennett, "Distributed Mission
Operations Within Simulator Training Effectiveness Baseline Study:
Metric Development and Objectively Quantifying the Degree of
Learning", Air Force Research Laboratory, Warfighter Readiness
Research Division, Technical Report No. 2, pp. 1-42, 2006.
[7] L. Zadeh, "Outline of a new approach to the analysis of complex
systems and decision processes", IEEE Trans. Systems, Man &
Cybernetics, 1973, 3: 28-44.
[8] G Shafer, "Perspectives on the theory and practice of belief functions",
International Journal of Approximate Reasoning, 1990, 3: 1-40.
[9] Hahn and Shapiro, Statistical Models in Engineering, John Wiley and
Sons, New York, USA.
[10] Z Qiu and I Elishakoff "Anti-optimization technique - a generalization
of interval analysis for non-probabilistic treatment of uncertainty",
Chaos, Solitons and Fractals, Vol. 12, Issue 9, July 2001, pages 1747 -
1759.
[11] I. Valiusaityte, E. Rajabally, T. Page, "Mathematical Means for
Assessing Military Aircraft Pilot Performance as Applied to Training
Effectiveness" SISO Fall SIW 2008, submitted for publication.
[12] W. T. Estler, "A distribution-independent bound on the level of
confidence in the result of a measurement", Journal of research of the
National Institute of Standards and Technology, Vol. 102, No. 5, 587-
588, 1997.
[13] E. Rajabally, P. Sen and S. Whittle, "A methodology for model
dependability assessment", Proceedings of the Engineering Design
Conference, pp. 291 - 300, 9 - 11 July 2002, Kings College, London.