Audio adversarial purification demo

Positive-Incentive Noise Predictor

Listen to two anonymized utterances under 50-step MI-FGSM and compare online purification outputs with matched spectrogram thumbnails. All purified samples are generated from the attacked adversarial utterance, not from the clean reference.

Sample 01

Reference, attack, and purification outputs

Reference

Clean
Clean spectrogram for Sample 01
Attacked / No defender
Attacked spectrogram for Sample 01

Proposed PnP purifiers

PnP-Diff
PnP-Diff spectrogram for Sample 01
PnP-Diff-2
PnP-Diff-2 spectrogram for Sample 01
PnP-Diff + AudioPure
PnP-Diff plus AudioPure spectrogram for Sample 01
PnP-Diff + DiffWavePnP
PnP-Diff plus DiffWavePnP spectrogram for Sample 01

Baseline purifiers

DAP
DAP spectrogram for Sample 01
AudioPure
AudioPure spectrogram for Sample 01
AudioPure+SSNI
AudioPure+SSNI spectrogram for Sample 01
Noise-0.005
Noise-0.005 spectrogram for Sample 01
Noise-0.01
Noise-0.01 spectrogram for Sample 01
Noise-0.02
Noise-0.02 spectrogram for Sample 01
SpeechTokenizer
SpeechTokenizer spectrogram for Sample 01
DAC
DAC spectrogram for Sample 01
AcademiCodec
AcademiCodec spectrogram for Sample 01

Additional PnP variant

PnP-Gaussian
PnP-Gaussian spectrogram for Sample 01

Sample 02

Reference, attack, and purification outputs

Reference

Clean
Clean spectrogram for Sample 02
Attacked / No defender
Attacked spectrogram for Sample 02

Proposed PnP purifiers

PnP-Diff
PnP-Diff spectrogram for Sample 02
PnP-Diff-2
PnP-Diff-2 spectrogram for Sample 02
PnP-Diff + AudioPure
PnP-Diff plus AudioPure spectrogram for Sample 02
PnP-Diff + DiffWavePnP
PnP-Diff plus DiffWavePnP spectrogram for Sample 02

Baseline purifiers

DAP
DAP spectrogram for Sample 02
AudioPure
AudioPure spectrogram for Sample 02
AudioPure+SSNI
AudioPure+SSNI spectrogram for Sample 02
Noise-0.005
Noise-0.005 spectrogram for Sample 02
Noise-0.01
Noise-0.01 spectrogram for Sample 02
Noise-0.02
Noise-0.02 spectrogram for Sample 02
SpeechTokenizer
SpeechTokenizer spectrogram for Sample 02
DAC
DAC spectrogram for Sample 02
AcademiCodec
AcademiCodec spectrogram for Sample 02

Additional PnP variant

PnP-Gaussian
PnP-Gaussian spectrogram for Sample 02