LLMs as counterfactual reasoners
Next-token training rewards plausible text, so a model can answer three equivalent counterfactual questions three different ways without ever paying a penalty.
We develop learning frameworks for fundamental bottlenecks in modern AI, with particular emphasis on nonstandard targets in complex, unstructured, and often large-scale data. One such bottleneck is not data, compute, or model capacity, but the lack of a learning theory for questions about worlds that were never observed: what would happen under a different action, policy, or environment, and how reliably such alternatives can be learned from available evidence. These are the nonstandard targets we set out to learn — quantities that matter for a decision yet are never measured directly. Rather than treating familiar AI failures as isolated phenomena, we study them as one family of unresolved “what if?” questions and build methods that move beyond associational prediction while keeping statistical guarantees. This places our work at the intersection of AI transparency, safety, fairness, and robustness, aimed at reliable decisions under intervention, shift, and uncertainty.
Addressing these questions requires ideas that cut across fields such as statistics, mathematics, and computer science. Our projects range from foundational theory and methodology to applications in high-stakes domains such as healthcare, finance, marketing, public policy, and manufacturing. In our lab, each student is expected to take intellectual ownership of their work and lead the development of their own research papers.
Four representative projects currently underway in our lab, spanning counterfactual reasoning, evidence transport, safe decision-making, and scientific discovery
Next-token training rewards plausible text, so a model can answer three equivalent counterfactual questions three different ways without ever paying a penalty.
A trial reports one average effect, but the same treatment can help one subgroup and harm another, so effects must be transported to the population a clinician actually treats.
Deciding whether to deploy a new policy requires estimating its value from data collected under a different one, exactly where the logged data is thinnest.
The space of possible perturbations is vast, only a small fraction can be observed, and experiments are often costly to run. Discovery therefore depends on predicting the outcomes of experiments never performed.
International Conference on Learning Representations (ICLR), 2026
Conference on Uncertainty in Artificial Intelligence (UAI), 2026
IEEE Transactions on Industrial Informatics, 2026
Under review
Under review
Under review
Under review
Under review
Under review
In preparation
Under review
Under review
2026.09
2026
Hajin Lee's paper on topological causal effects accepted at ICLR.
2026
Hajin Lee's persistence-diagram clustering paper accepted at UAI.
2026
JungHyun Kim's fast-charging paper accepted at IEEE Transactions on Industrial Informatics.
2026
Samsung Science and Technology Foundation grant awarded, funding the group through 2029.