Abstract: While pre-trained models on natural language processing, such as BERT and GPT, were proven to be versatile in their application over programming languages by becoming an important booster to ...