Publications
Causality and prediction
K. Kiritoshi, T. Izumitani, K. Koyama, T. Okawachi, K. Asahara, and S. Shimizu. Estimating individual-level optimal causal interventions combining causal models and machine learning models. In Proc. KDD'21 Workshop on Causal Discovery, PMLR 150:55-77, 2021.
[pdf] [Google scholar]
[Proposes a method for estimating individual-level optimal causal intervention by combining causal discovery and machine learning.]P. Blöbaum and S. Shimizu. Estimation of interventional effects of features on prediction. In Proc. 2017 IEEE International Workshop on Machine Learning for Signal Processing (MLSP2017), pp. 1--6, Tokyo, Japan, 2017.
[pdf] [Google scholar]
A short introduction
Python code
[Proposes a new framework to understand the prediction mechanisms of predictive models based on causality.]
Causal discovery: LiNGAM
LiNGAM homepage
Links to LiNGAM-related papers
Reviews and tutorials
S. Shimizu. Statistical causal discovery: LiNGAM approach. SpringerBriefs in Statistics. Springer Tokyo, 2022.
[draft] [Google scholar]S. Shimizu and P. Blöbaum. Recent advances in semi-parametric methods for causal discovery. In Direction Dependence in Statistical Models: Methods of Analysis (W. Wiedermann, D. Kim, E. Sungur, and A. von Eye, eds.), pages xx–xx. Wiley, 2020.
[pdf] [Google scholar]S. Shimizu. LiNGAM: Non-Gaussian methods for estimating causal structures. Behaviormetrika, 41(1): 65--98, 2014.
[pdf] [Google scholar]S. Shimizu. Non-Gaussian Methods for Learning Linear Structural Equation Models: Part I. The 26th Conference on Uncertainty in Artificial Intelligence (UAI2010), Catalina Island, California, USA , 2010. Tutorial
[slides] [references]
Basic models with no hidden variables
Y. Zeng, S. Shimizu, H. Matsui, F. Sun. Causal Discovery for Linear Mixed Data. In Proc. First Conference on Causal Learning and Reasoning (CLeaR2022), PMLR 177, pages 994-1009, 2022.
[pdf] [Google scholar]
Python code
[Proposes an approach for inferring causal structure from mixed continuous and discrete data combining LiNGAM and logistic-type model.]A. Hyvärinen, K. Zhang, S. Shimizu, and P. O. Hoyer. Estimation of a structural vector autoregression model using non-Gaussianity. Journal of Machine Learning Research, 11: 1709−1731, 2010.
[pdf] [Google scholar]
Videolecture
R code by Doris Entner
Matlab code by Luca Faes
Python code
[Shows how LiNGAM and autoregressive models are combined to estimate a structural vector autoregression model for time series data.]K. Kadowaki, S. Shimizu, and T. Washio. Estimation of causal structures in longitudinal data using non-Gaussianity. In Proc. 23rd IEEE International Workshop on Machine Learning for Signal Processing (MLSP2013), pp. 1--6, Southampton, United Kingdom, 2013.
[pdf] [Python code] [Google scholar]
[Considers learning causal structures in longitudinal data that collects multiple samples over a period of time.]S. Shimizu. Joint estimation of linear non-Gaussian acyclic models. Neurocomputing, 81: 104-107, 2012.
[pdf] [Google scholar]
Python code
[Proposes a framework to perform LiNGAM analysis on heterogenous datasets.]S. Shimizu, T. Inazumi, Y. Sogawa, A. Hyvärinen, Y. Kawahara, T. Washio, P. O. Hoyer and K. Bollen. DirectLiNGAM: A direct method for learning a linear non-Gaussian structural equation model. Journal of Machine Learning Research, 12(Apr): 1225--1248, 2011.
[pdf] [Google scholar]
Python code
R code by Genta Kikuchi
[Proposes a new estimation algorithm for LiNGAM. The new estimation method called DirectLiNGAM requires no algorithmic parameters and is guaranteed to converge to the right solution within a small fixed number of steps if the data strictly follows the model, i.e., if all the model assumptions are met and the sample size is infinite.]S. Shimizu, P. O. Hoyer, A. Hyvärinen and A. Kerminen. A linear non-gaussian acyclic model for causal discovery. Journal of Machine Learning Research, 7: 2003--2030, 2006.
[pdf] [Matlab/Octave code] [Google scholar]
A short introduction
R code by Patrik O. Hoyer and Antti Hyttinen
R code by Doris Entner
R package: pcalg by Kalisch et al.
Python code
TETRAD IV
[Proposes a novel identifiable model (LiNGAM) for causal discovery and an ICA-based estimation algorithm to learn the model. Original article introducing LiNGAM.]
Hidden variable models
Y. Zeng, S. Shimizu, R. Cai, F. Xie, M. Yamamoto, Z. Hao. Causal discovery with multi-domain LiNGAM for latent factors. In Proc. the 30th International Joint Conference on Artificial Intelligence (IJCAI2021), pages xx-xx, Montreal-themed Virtual Reality, 2021.
[pdf] [Google scholar]
Python code
[Considers to estimate LiNGAM model for latent factors from multi-domain data.]T. N. Maeda and S. Shimizu. RCD: Repetitive causal discovery of linear non-Gaussian acyclic models with latent confounders. In JMLR Workshop and Conference Proceedings, AISTATS2020 (Proc. 23rd International Conference on Artificial Intelligence and Statistics), pages 735–745, Palermo, Sicily, Italy, 2020.
[pdf] [Google scholar]
Python code
[Proposes an extension of the LiNGAM model that allows hidden common causes.]T. Tashiro, S. Shimizu, A. Hyvärinen and T. Washio. ParceLiNGAM: A causal ordering method robust against latent confounders. Neural Computation, 26(1): 57--83, 2014.
[pdf] [Google scholar]
code
[Develops a variant of DirectLiNGAM that is robust against hidden common causes. ]P. O. Hoyer, S. Shimizu, A. Kerminen, and M. Palviainen. Estimation of causal effects using linear non-gaussian causal models with hidden variables. International Journal of Approximate Reasoning, 49(2): 362-378, 2008.
[pdf] (7.0MB) [doi] [Matlab code] [Google scholar]
[Proposes an extension of basic LiNGAM above to cases with latent common cause variables. The new model is called Latent variable LiNGAM (LvLiNGAM). ]
Nonlinearity
NEW D. Fujiwara, K. Koyama, K. Kiritoshi, T. Okawachi, T. Izumitani, and S. Shimizu. Causal Discovery for Non-stationary Non-linear Time Series Data Using Just-In-Time Modeling. In Proc. 2nd Conference on Causal Learning and Reasoning, PMLR 213: 880-894, 2023.
[pdf] [Google scholar]
[Proposes a causal discovery method JIT-LiNGAM, based on the Linear Non-Gaussian Acyclic Model (LiNGAM) and the Just-In-Time (JIT) framework to approximate an inherently globally non-linear model with local linear models.]K. Uemura, T. Takagi, T. Kambayashi, H. Yoshida, and S. Shimizu. A Multivariate Causal Discovery based on Post-Nonlinear Model. In Proc. First Conference on Causal Learning and Reasoning (CLeaR2022), PMLR 177, pages 826-839, 2022.
[pdf] [Google scholar]
Python code
[Proposes a multivariate estimation method for post-nonlinear causal model using an autoenconding structure.]T. N. Maeda and S. Shimizu. Causal additive models with unobserved variables. In Proc. 37th Conf. on Uncertainty in Artificial Intelligence (UAI2021), pages xx–xx, Online, 2021.
[pdf] [Google scholar]
Python code
Python code in causal-learn
[Proposes an additive nonlinear model that allows unobserved common causes and unobserved intermediate variables.]
Statistical reliability
Y. Komatsu, S. Shimizu, and H. Shimodaira. Assessing statistical reliability of LiNGAM via multiscale bootstrap. In Proc. 20th International Conference on Artificial Neural Networks (ICANN2010), pp.309--314, Thessaloniki, Greece, 2010.
[pdf] [doi] [Google scholar]
Related code: R code for multiscale bootstrap
[Proposes a method to evaluate statistical reliability of causal orderings estimated by LiNGAM.]
Model fit
S. Shimizu and Y. Kano. Use of non-normality in structural equation modeling: Application to direction of causation. Journal of Statistical Planning and Inference, 138: 3483--3491, 2008.
[pdf] [Google scholar]
[Proposes a test statistics to evaluate model fit using higher-order moments.]
Causal inference: misc.
NEW D. Fujiwara, K. Koyama, K. Kiritoshi, T. Okawachi, T. Izumitani, and S. Shimizu. Prospects of Continual Causality for Industrial Applications. In Proc. First AAAI Bridge Program on Continual Causality, PMLR 208:18-24, 2023.
[pdf] [Google scholar]高山正行, 小柴等, 前田高志ニコラス, 三内顕義, 清水昌平, 星野利彦. 博士課程進学率に関する因果モデルの構築. Jxiv, JST プレプリントサーバ, 2022.
[pdf] [Google scholar]Y. Zeng, Z. Hao, R. Cai, F. Xie, L. Huang, S. Shimizu. Nonlinear Causal Discovery for high-dimensional deterministic data. IEEE Transactions on Neural Networks and Learning Systems, xx: xx--xx, 2021.
[pdf] [Google scholar]
[Proposes a nonlinear method for estimating the causal structure of variables in deterministic cases.]P. Blöbaum, D. Janzing, T. Washio, S. Shimizu, B. Schölkopf. Cause-effect inference by comparing regression errors. In Proc. International Conference on Artificial Intelligence and Statistics (AISTATS2018), PMLR 84:900-909, 2018.
[pdf] [Google scholar]
[Proposes a nonlinear method for estimating the causal direction of two variables comparing the least-squares errors. ]R. Silva and S. Shimizu. Learning instrumental variables with structural and non-Gaussianity assumptions. Journal of Machine Learning Research, 18: 1--49, 2017.
[pdf] [Google scholar]
[Proposes a method for learning instrumental variables based on non-Gaussianity.]
Machine learning: misc.
K. Honjo, X. Zhou, S. Shimizu. CNN-GRU based deep learning model for demand forecast in retail industry. In Proc. International Joint Conference on Neural Networks (IJCNN2022), part of the 2022 IEEE World Congress on Computational Intelligence (WCCI2022)}, 1-8, 2022.
[pdf] [Google scholar]
[Constructs a deep learning model for demand forecasting in the retail industry.]
Software
NEW Y. Zheng, B. Huang, W. Chen, J. Ramsey, M. Gong, R. Cai, S. Shimizu, P. Spirtes, K. Zhang. Causal-learn: Causal Discovery in Python. Arxiv preprint arXiv:2307.16405, 2023.
[A Python package for performing causal discovery methods including conditonal-independence-based methods and LiNGAM methods.]
[pdf] [github] [Google scholar]T. Ikeuchi, M. Ide, Y. Zeng, T. N. Maeda, and S. Shimizu. Python package for causal discovery based on LiNGAM. Journal of Machine Learning Research, 24(14):1−8, 2023.
[pdf] [Google scholar]
Python package
[A Python package for performing causal discovery analysis based on LiNGAM approach.]
[LiNGAM Python package: Tutorial slides]
[LiNGAM Pythonパッケージでできること: 紹介スライド]