Causal Discovery and Inference

Foundational Machine Learning for Causal Discovery and Inference.

In the realm of ever-evolving machine learning (ML), while it is essential to stay abreast of trends, our focus must transcend mere trend-chasing. As scientists, we are committed to addressing problems that possess the potential to positively transform our world—a notion we can term as “impact”-and for which we have a reasonable line of attack. We believe decision making (under constrained and uncertain environments, and where decisions can impact the world) is one of those problems.

The ML community have built incredibly powerful models for prediction. However, to use these models for truly impactful decision making they need to be lifted from learning predictive relationships in data to learning causal structures about the world. In this project we will develop new methods that leverage modern foundational machine learning (mostly based on probabilistic approaches) to address decision-making problems in a unifying framework. Our main line of attack can be viewed through the lenses of causal inference and estimation. In other words, ultimately, we care about answering “what if” questions with appropriate level of uncertainty or confidence, i.e., what will be the effect of changing a subset of variables in a complex, difficult to control, system? Examples of this abound and we are already working on practical applications where our developments will be critical, for example, (1) modelling well-being and (2) climate change.

Recent Developments

Foundation Models for Causal Discovery & Expert-Knowledge Integration

Directed Acyclic Graph (DAG) Estimation

References

2026

  1. Arrow: A foundation model for causal discovery
    Ryan Thompson, He Zhao, Daniel M Steinberg, and Edwin V Bonilla
    arXiv preprint arXiv:2605.07204, 2026
  2. Causal Preference Elicitation
    Edwin V Bonilla, He Zhao, and Daniel M Steinberg
    In International Conference on Machine Learning (ICML) , 2026
  3. Permutation-based Inference for Variational Learning of Directed Acyclic Graphs
    Edwin V Bonilla, Pantelis Elinas, He Zhao, Maurizio Filippone, Vassili Kitsios, and Terry O’Kane
    arXiv preprint arXiv:2402.02644, 2026
  4. Ordering-based Causal Discovery via Generalized Score Matching
    Vy Vo, He Zhao, Trung Le, Edwin V Bonilla, and Dinh Phung
    In SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) , 2026
  5. HiBaNG: Hierarchical Bayesian Nonparametric Granger Causal Discovery in Low-Data Regimes
    He Zhao, Vassili Kitsios, Terence O’Kane, and Edwin V Bonilla
    Transactions on Machine Learning Research (TMLR), 2026

2025

  1. ProDAG: Projected Variational Inference for Directed Acyclic Graphs
    Ryan Thompson, Edwin V Bonilla, and Robert Kohn
    In Advances in Neural Information Processing Systems (NeurIPS) , 2025

2024

  1. Contextual directed acyclic graphs
    Ryan Thompson, Edwin V Bonilla, and Robert Kohn
    In International Conference on Artificial Intelligence and Statistics (AISTATS) , 2024
  2. Parameter Estimation in DAGs from Incomplete Data via Optimal Transport
    Vy Vo, Trung Le, Long-Tung Vuong, He Zhao, Edwin Bonilla, and Dinh Phung
    In Accepted for publication at International Conference on Machine Learning (ICML) , 2024
  3. Optimal Transport for Structure Learning Under Missing Data
    Vy Vo, He Zhao, Trung Le, Edwin V Bonilla, and Dinh Phung
    Accepted for publication at International Conference on Machine Learning (ICML), 2024
  4. Bayesian Factorised Granger-Causal Graphs For Multivariate Time-series Data
    He Zhao, and Edwin V Bonilla
    arXiv preprint arXiv:2402.03614, 2024