Abstract: Text classification is a pivotal challenge in Natural Language Processing (NLP), particularly for underrepresented languages like Bangla, spoken by over 230 million native speakers.