On the Learning of Causal Relationships between Banks in Saudi Equities Market Using Ensemble Feature Selection Methods

Financial forecasting using machine learning techniques has received great efforts in the last decide . In this ongoing work, we show how machine learning of graphical models will be able to infer a visualized causal interactions between different banks in the Saudi equities market. One important discovery from such learned causal graphs is how companies influence each other and to what extend. In this work, a set of graphical models named Gaussian graphical models with developed ensemble penalized feature selection methods that combine ; filtering method, wrapper method and a regularizer will be shown. A comparison between these different developed ensemble combinations will also be shown. The best ensemble method will be used to infer the causal relationships between banks in Saudi equities market.

• Adel Aloraini

• Causal interactions
• banks
• feature selection
• regularizere

<p>[1] Adel Aloraini, James Cussens, and Richard Birnie. Extending prostate
cancer kegg pathways using machine learning of graphical models. In
Systemics and Informatics World Network,SIWN, volume 10, pages 56–
67, 2010.
[2] Jerome Friedman, Trevor Hastie, and Robert Tibshirani. Sparse inverse
covariance estimation with the graphical lasso. Biostatistics, 0(0):1–10,
2007.
[3] Dan Geiger and David Heckerman. Learning Gaussian networks. In
UAI, volume 10, pages 235–243, 1994.
[4] Isabelle Guyon. Practical Feature Selection: from Correlation to
Causality. IOS Press, January 16 2008.
[5] Trevor Hastie, Robert Tibshirani, and Jerome Friedman. The Elements
of Statistical Learning. Springer New York Inc., 2009.
[6] Tim C Hesterberg, Nam H Choi, Lukas Meier, and Chris Fraley. Least
angle and l1 penalized regression: A review. Statistics Surveys, 2:61–93,
2008.
[7] Y. Hiemstra. Modeling structured nonlinear knowledge to predict stock
market returns. .R. Trippi (Ed.), Chaos and Nonlinear Dynamics in the
Financial Markets: Theory, Evidence and Applications, pages 163–175,
1995.
[8] K. Kim and I. Han. Genetic algorithms approach to feature discretization
in artificial neural networks for the prediction of stock price index.
Expert Syst. Appl, 19:125–132, 2000.
[9] K. Kim and I. Han. Financial time series forecasting using support
vector machines. Neurocomputing, 55:307–319, 2003.
[10] KAZUHIRO KOHARA, TSUTOMU ISHIKAWA, YOSHIMI
FUKUHARA, and YUKIHIRO NAKAMURA. Stock price prediction
using prior knowledge and neural networks. Intelligent Systems in
Accounting, Finance and Management, 6:12–22, 1997.
[11] Florian Markowetz and Rainer Spang. Inferring cellular networks - a
review. BMC Bioinformatics, 8(S-6), 2007.
[12] Jie Peng, Pei Wang, Nengfeng Zhou, and Ji Zhu. Partial correlation
estimation by joint sparse regression models. American Statistical
Association, 104(486):735–746, 2009.
[13] Yvan Saeys, In aki Inza, and Pedro Larran aga. A review of feature
selection techniques in bioinformatics. Bioinformatics, 23:2507–2517,
2007.
[14] Robert J. Tibshirani. Regression shrinkage and selection via the lasso.
Journal of the Royal Statistical Society, Series B, 58(1):267–288, 1996.
[15] G. Zhang, B.E. Patuwo, and M.Y. Hu. Forecasting with artificial neural
networksthe state of the art. J. Forecasting, 14:35–62, 1998.</p>