Abstract: To transfer the representation capacity of large pre-trained models to lightweight models, knowledge distillation has been widely explored. However, conventional single-stage distillation ...

Abstract: In this paper, we propose a Siamese sleep transformer (SST) that effectively extracts features from singlechannel raw electroencephalogram signals for robust sleep stage scoring. Despite the ...