Auditing Path-Specific Fairness Across Causal Discovery Algorithms: A Heart Failure Case Study
Abstract
Causal discovery is increasingly applied to healthcare data, where the recovered relationships can encode biased pathways that propagate to downstream prediction.
Path-specific fairness analysis, through direct, indirect, and spurious effect decompositions along with fairness-utility ratio assessment allows bias quantification and associated prediction cost.
However, existing evaluations of causal discovery under fairness constraints have largely used non-clinical datasets and have not separated the contribution of confounders from that of mediators, leaving open how discovery-algorithm choice propagates through path-specific fairness to the utility trade-off in clinical settings.
This work addresses that gap by establishing an expert-elicited causal graph benchmark for the heart failure clinical records dataset and tracing discovery algorithms through composite, per-variable fairness decompositions and fairness-utility ratio.
ICA-LiNGAM achieves the lowest structural Hamming distance and highest recall, while GES achieves the highest precision.
For path-specific effects, there was a 1.2 percentage-point difference in the mediated effect on ejection fraction on overall causal fairness between the original and discovered graphs.
This ultimately led to variations in the fairness-utility ratio highlighting need for fine-grained evaluation.
These results indicate that discovery-aware, path-specific fairness evaluation is consequential in clinical settings and warrants inclusion in routine auditing of clinical risk models.