Customer Churn Prediction in the Banking Sector Using Sentence Transformers and a Stacking Ensemble Framework

Journal Title: Acadlore Transactions on AI and Machine Learning - Year 2025, Vol 4, Issue 2

Abstract

As market saturation and competitive pressure intensify within the banking sector, the mitigation of customer churn has emerged as a critical concern. Given that the cost of acquiring new clients substantially exceeds that of retaining existing ones, the development of highly accurate churn prediction models has become imperative. In this study, a hybrid customer churn prediction model was developed by integrating Sentence Transformers with a stacking ensemble learning architecture. Customer behavioral data containing textual content was transformed into dense vector representations through the use of Sentence Transformers, thereby capturing contextual and semantic nuances. These embeddings were combined with normalized structured features. To enhance predictive performance, a stacking ensemble method was employed to integrate the outputs of multiple base models, including random forest, Gradient Boosting Tree (GBT), and Support Vector Machine (SVM). Experimental evaluation was conducted on real-world banking data, and the proposed model demonstrated superior performance relative to conventional baseline approaches, achieving notable improvements in both accuracy and the area under the curve (AUC). Furthermore, the analysis of model outputs revealed several salient predictors of customer attrition, such as anomalous transaction behavior, prolonged inactivity, and indicators of dissatisfaction with customer service. These insights are expected to inform the development of targeted intervention strategies aimed at strengthening customer retention, improving satisfaction, and fostering long-term institutional growth and stability.

Authors and Affiliations

Jing Gao, Huiyi Wang, Yuanlin Lu, Lina Yu

Keywords

Related Articles

A Comparative Study on AI-Based Algorithms for Cost Prediction in Pharmaceutical Transport Logistics

Pharmaceutical transport logistics, especially in humanitarian and hospital contexts, is becoming increasingly essential with a growing need to monitor associated costs. In Morocco, however, studies focusing on the cost...

A Dual-Selective Channel Attention Network for Osteoporosis Prediction in Computed Tomography Images of Lumbar Spine

Osteoporosis is a common systemic bone disease with insidious onset and low treatment efficiency. Once it occurs, it will increase bone fragility and lead to fractures. Computed tomography (CT) is a non-invasive medical...

Enhanced Named Entity Recognition Based on Multi-Feature Fusion Using Dual Graph Neural Networks

Named Entity Recognition (NER), a pivotal task in information extraction, is aimed at identifying named entities of various types within text. Traditional NER methods, however, often fall short in providing sufficient se...

A Hybrid Graph-Attention and Contextual Sentiment Embedding Model for Sentiment Analysis in Legal Documents

Sentiment analysis in legal documents presents significant challenges due to the intricate structure, domain-specific terminology, and strong contextual dependencies inherent in legal texts. In this study, a novel hybrid...

Performance Comparison of Three Classifiers for Fetal Health Classification Based on Cardiotocographic Data

The global child mortality rate, which is steadily declining, will be around 26 fatalities per 1000 live births in 2022. Numerous Sustainable Development Goals of the United Nations take into account the declining child...

Download PDF file
  • EP ID EP767837
  • DOI https://doi.org/10.56578/ataiml040204
  • Views 16
  • Downloads 0

How To Cite

Jing Gao, Huiyi Wang, Yuanlin Lu, Lina Yu (2025). Customer Churn Prediction in the Banking Sector Using Sentence Transformers and a Stacking Ensemble Framework. Acadlore Transactions on AI and Machine Learning, 4(2), -. https://europub.co.uk/articles/-A-767837