Integrating structural causal model ontologies with LIME for fair machine learning explanations in educational admissions

Research output: Contribution to journalArticlepeer-review

7 Downloads (Pure)

Abstract

This study employed knowledge discovery in databases (KDD) to extract and discover knowledge from the Benue State Polytechnic (Benpoly) admission database and used a structural causal model (SCM) ontological framework to represent the admission process in the Nigerian polytechnic education system. The SCM ontology identified important causal relations in features needed to model the admission process and was validated using the conditional independence test (CIT) criteria. The SCM ontology was further employed to identify and constrain input features causing bias in the local interpretable model-agnostic explanations (LIME) framework applied to machine learning (ML) black-box predictions. The ablation process produced more stable LIME explanations devoid of fairness bias compared to LIME without ablation, with higher prediction accuracy (91% vs. 89%) and F1 scores (95% vs. 94%). The study also compared the performance of different ML models, including Gaussian Naïve Bayes, Decision Trees, and Logistic Regression, before and after ablation. The limitation is that the SCM ontology is qualitative and context-specific, so the fair-LIME framework can only be extrapolated to similar contexts. Future work could compare other explanation frameworks like Shapley on the same dataset. Overall, this study demonstrates a novel approach to enforcing fairness in ML explanations by integrating qualitative SCM ontologies with quantitative ML/LIME methods.
Original languageEnglish
Pages (from-to)65-85
Number of pages21
JournalJournal of Computing Theories and Applications
Volume2
Issue number1
DOIs
Publication statusPublished - 25 Jun 2024

Keywords

  • Fairness
  • knowledge discovery in databases (KDD)
  • local interpretable model-agnostic explanations (LIME)
  • ontology
  • structural causal model (SCM)

Fingerprint

Dive into the research topics of 'Integrating structural causal model ontologies with LIME for fair machine learning explanations in educational admissions'. Together they form a unique fingerprint.

Cite this