Abstract: In this study, we address the challenge of identifying multiple predominant instruments in polyphonic music using Compact Convolution Transformers (CCT). With the emergence of Transformers ...