Causal Discovery and Inference
Foundational Machine Learning for Causal Discovery and Inference.
In the realm of ever-evolving machine learning (ML), while it is essential to stay abreast of trends, our focus must transcend mere trend-chasing. As scientists, we are committed to addressing problems that possess the potential to positively transform our world—a notion we can term as “impact”-and for which we have a reasonable line of attack. We believe decision making (under constrained and uncertain environments, and where decisions can impact the world) is one of those problems.
The ML community have built incredibly powerful models for prediction. However, to use these models for truly impactful decision making they need to be lifted from learning predictive relationships in data to learning causal structures about the world. In this project we will develop new methods that leverage modern foundational machine learning (mostly based on probabilistic approaches) to address decision-making problems in a unifying framework. Our main line of attack can be viewed through the lenses of causal inference and estimation. In other words, ultimately, we care about answering “what if” questions with appropriate level of uncertainty or confidence, i.e., what will be the effect of changing a subset of variables in a complex, difficult to control, system? Examples of this abound and we are already working on practical applications where our developments will be critical, for example, (1) modelling well-being and (2) climate change.
Recent Developments
Foundation Models for Causal Discovery & Expert-Knowledge Integration
- Arrow: a foundation model for causal discovery (Thompson et al., 2026)
- Causal preference elicitation (Bonilla et al., 2026)
Directed Acyclic Graph (DAG) Estimation
- Contextual DAGs (Thompson et al., 2024)
- Bayesian DAG estimation via permutation-based distributions (Bonilla et al., 2026) and projection-induced distributions (Thompson et al., 2025)
- Optimal transport approachs to Parameter DAG estimation (Vo et al., 2024) and Structure DAG learning (Vo et al., 2024)
- Bayesian Granger Causality (Zhao & Bonilla, 2024)
- Ordering-based causal discovery via generalized score matching (Vo et al., 2026)
- Hierarchical Bayesian nonparametric Granger causal discovery: HiBaNG (Zhao et al., 2026)
References
2026
- Arrow: A foundation model for causal discoveryarXiv preprint arXiv:2605.07204, 2026
- Causal Preference ElicitationIn International Conference on Machine Learning (ICML) , 2026
- Permutation-based Inference for Variational Learning of Directed Acyclic GraphsarXiv preprint arXiv:2402.02644, 2026
- Ordering-based Causal Discovery via Generalized Score MatchingIn SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) , 2026
- HiBaNG: Hierarchical Bayesian Nonparametric Granger Causal Discovery in Low-Data RegimesTransactions on Machine Learning Research (TMLR), 2026
2025
- ProDAG: Projected Variational Inference for Directed Acyclic GraphsIn Advances in Neural Information Processing Systems (NeurIPS) , 2025
2024
- Contextual directed acyclic graphsIn International Conference on Artificial Intelligence and Statistics (AISTATS) , 2024
- Parameter Estimation in DAGs from Incomplete Data via Optimal TransportIn Accepted for publication at International Conference on Machine Learning (ICML) , 2024
- Optimal Transport for Structure Learning Under Missing DataAccepted for publication at International Conference on Machine Learning (ICML), 2024
- Bayesian Factorised Granger-Causal Graphs For Multivariate Time-series DataarXiv preprint arXiv:2402.03614, 2024