Article
#1017
Issue
MathAI 2026 Selected Papers
Special Issue
Received
20 Apr 2026
Accepted
15 May 2026
Published
22 May 2026
Improving Fairness in AI-Powered Recrutiment: An Interpretable Resume Screening System
MathAI 2026 Selected Papers
Special Issue
algorithmic fairness
resume screening
bias mitigation
Integrated Gradients
BERT
interpretable machine learning
explainable AI
NLP
human resources
Abstract
Modern automated resume screening systems are typically based on neural text classification models that encode a resume as a feature representation and predict a discrete label corresponding to candidate category, suitability level, or job role. Such models commonly produce class logits parameterized by model weights, which are converted into class probabilities via the softmax function over the target classes. These models are typically trained using cross-entropy loss and deployed as the first stage of automated candidate filtering.
Despite their effectiveness, resume classifiers may encode implicit bias through correlations between predictions and non-job-related or proxy textual features. To study this effect, we analyze feature influence using Integrated Gradients, which assign an attribution score to each input feature based on the path integral of partial derivatives between a baseline representation and the actual input. This analysis reveals systematic dependencies on features that should be irrelevant to candidate evaluation.
Building on these observations, we evaluate multiple debiasing techniques and propose an interpretability-guided framework for bias mitigation. We compare six methods spanning in-processing approaches (GroupDRO, Focal Loss, Label Smoothing, Adversarial debiasing) and attribution-based approaches (Data Scrubbing, Attention Regularization) that leverage the interpretability findings directly. This allows explainable analysis to guide the development of fairer resume screening models.
Cite this article
Agapova, N. A.; Lukmanov, R. A. Improving Fairness in AI-Powered Recrutiment: An Interpretable Resume Screening System. Mathematics & AI 2026, 1, 14. https://enigma.ist/j/mathematics-ai/1/2/14