Abstract: Knowledge distillation (KD) is a predominant technique to streamline deep-learning-based recognition models for practical underwater deployments. However, existing KD methods for underwater ...