Feature Analysis of Predictive Maintenance Models

Research in predictive maintenance modeling has improved in the recent years to predict failures and needed maintenance with high accuracy, saving cost and improving manufacturing efficiency. However, classic prediction models provide little valuable insight towards the most important features contributing to the failure. By analyzing and quantifying feature importance in predictive maintenance models, cost saving can be optimized based on business goals. First, multiple classifiers are evaluated with cross-validation to predict the multi-class of failures. Second, predictive performance with features provided by different feature selection algorithms are further analyzed. Third, features selected by different algorithms are ranked and combined based on their predictive power. Finally, linear explainer SHAP (SHapley Additive exPlanations) is applied to interpret classifier behavior and provide further insight towards the specific roles of features in both local predictions and global model behavior. The results of the experiments suggest that certain features play dominant roles in predictive models while others have significantly less impact on the overall performance. Moreover, for multi-class prediction of machine failures, the most important features vary with type of machine failures. The results may lead to improved productivity and cost saving by prioritizing sensor deployment, data collection, and data processing of more important features over less importance features.

• Zhaoan Wang

• Automated supply chain
• intelligent manufacturing
• predictive maintenance machine learning
• feature engineering
• model interpretation.

[1] Y. Y. Ran, X. Zhou, P.F. Lin, Y. G. Wen, and R. L. Deng, “A Survey of Predictive Maintenance: Systems, Purposes and Approaches”, IEEE Communications Surveys & Tutorials, NOV. 2019.
[2] G. A. Susto, A. Schirru, S. Pampuri, S. McLoone and A. Beghi, "Machine Learning for Predictive Maintenance: A Multiple Classifier Approach," in IEEE Transactions on Industrial Informatics, vol. 11, no. 3, pp. 812-820, June 2015, doi: 10.1109/TII.2014.2349359.
[3] Azure AI guide for predictive maintenance solutions. URL: https://docs.microsoft.com/enus/azure/machine-learning/team-data-science-process/predictive-maintenance-playbook.
[4] Data preparation for predictive maintenance, https://docs.microsoft.com/en-us/azure/machinelearning/team-data-science-process/predictive-maintenance-playbook#data-preparation-for-predictivemaintenance.
[5] https://docs.microsoft.com/en-us/azure/machine-learning/team-data-science-process/predictivemaintenance-playbook.
[6] Source: https://gallery.azure.ai/Experiment/Predictive-Maintenance-Modelling-Guide-Data-Sets-1.
[7] I. A. Guyon and Elisseeff, “An introduction to variable and feature selection,” J. Mach. Learn. Res., vol. 3, pp. 1157-1182, 2013.
[8] J. Li, K. Cheng, S. Wang, F. Morstatter, R. Trevino, J. Tang and H. Liu, “Feature Selection: A Data Perspective,” ACM Computing Surveys, 50(6), pp.1-45, January 2018.
[9] https://github.com/slundberg/shap.
[10] S. M. Lundberg and S.I. Lee. “A Unified Approach to Interpreting Model Predictions”, Advances in Neural Information Processing Systems (2017), pp. 4768–4777.