Causal Discovery and Inference

Foundational Machine Learning for Causal Discovery and Inference.

In the realm of ever-evolving machine learning (ML), while it is essential to stay abreast of trends, our focus must transcend mere trend-chasing. As scientists, we are committed to addressing problems that possess the potential to positively transform our world—a notion we can term as “impact”-and for which we have a reasonable line of attack. We believe decision making (under constrained and uncertain environments, and where decisions can impact the world) is one of those problems.

The ML community have built incredibly powerful models for prediction. However, to use these models for truly impactful decision making they need to be lifted from learning predictive relationships in data to learning causal structures about the world. In this project we will develop new methods that leverage modern foundational machine learning (mostly based on probabilistic approaches) to address decision-making problems in a unifying framework. Our main line of attack can be viewed through the lenses of causal inference and estimation. In other words, ultimately, we care about answering “what if” questions with appropriate level of uncertainty or confidence, i.e., what will be the effect of changing a subset of variables in a complex, difficult to control, system? Examples of this abound and we are already working on practical applications where our developments will be critical, for example, (1) modelling well-being and (2) climate change.

Recent Developments

Directed Acyclic Graph (DAG) Estimation

References

2024

  1. Contextual directed acyclic graphs
    Ryan Thompson, Edwin V Bonilla, and Robert Kohn
    In International Conference on Artificial Intelligence and Statistics (AISTATS) , 2024
  2. Variational DAG Estimation via State Augmentation With Stochastic Permutations
    Edwin V Bonilla, Pantelis Elinas, He Zhao, Maurizio Filippone, Vassili Kitsios, and Terry O’Kane
    arXiv preprint arXiv:2402.02644, 2024
  3. ProDAG: Projection-induced variational inference for directed acyclic graphs
    Ryan Thompson, Edwin V Bonilla, and Robert Kohn
    arXiv preprint arXiv:2405.15167, 2024
  4. Optimal Transport for Structure Learning Under Missing Data
    Vy Vo, He Zhao, Trung Le, Edwin V Bonilla, and Dinh Phung
    Accepted for publication at International Conference on Machine Learning (ICML), 2024
  5. Bayesian Factorised Granger-Causal Graphs For Multivariate Time-series Data
    He Zhao, and Edwin V Bonilla
    arXiv preprint arXiv:2402.03614, 2024