Abstract: Recently, with the use of transformer-based models, a big progress has been achieved across many areas of Natural Language Processing (NLP) including text classification. However, such ...