SpeechBrain looks promising for speaker recognition / diarization among other speech related features