Audio adversarial purification demo

Positive-Incentive Noise Predictor

Listen to two anonymized utterances under 50-step MI-FGSM and compare online purification outputs with matched spectrogram thumbnails. All purified samples are generated from the attacked adversarial utterance, not from the clean reference.

Sample 01

Reference, attack, and purification outputs

Reference

Clean spectrogram for Sample 01 — Clean

Attacked spectrogram for Sample 01 — Attacked / No defender

Proposed PnP purifiers

PnP-Diff spectrogram for Sample 01 — PnP-Diff

PnP-Diff-2 spectrogram for Sample 01 — PnP-Diff-2

PnP-Diff plus AudioPure spectrogram for Sample 01 — PnP-Diff + AudioPure

PnP-Diff plus DiffWavePnP spectrogram for Sample 01 — PnP-Diff + DiffWavePnP

Baseline purifiers

DAP spectrogram for Sample 01 — DAP

AudioPure spectrogram for Sample 01 — AudioPure

AudioPure+SSNI spectrogram for Sample 01 — AudioPure+SSNI

Noise-0.005 spectrogram for Sample 01 — Noise-0.005

Noise-0.01 spectrogram for Sample 01 — Noise-0.01

Noise-0.02 spectrogram for Sample 01 — Noise-0.02

SpeechTokenizer spectrogram for Sample 01 — SpeechTokenizer

DAC spectrogram for Sample 01 — DAC

AcademiCodec spectrogram for Sample 01 — AcademiCodec

Additional PnP variant

PnP-Gaussian spectrogram for Sample 01 — PnP-Gaussian

Sample 02

Reference, attack, and purification outputs

Reference

Clean spectrogram for Sample 02 — Clean

Attacked spectrogram for Sample 02 — Attacked / No defender

Proposed PnP purifiers

PnP-Diff spectrogram for Sample 02 — PnP-Diff

PnP-Diff-2 spectrogram for Sample 02 — PnP-Diff-2

PnP-Diff plus AudioPure spectrogram for Sample 02 — PnP-Diff + AudioPure

PnP-Diff plus DiffWavePnP spectrogram for Sample 02 — PnP-Diff + DiffWavePnP

Baseline purifiers

DAP spectrogram for Sample 02 — DAP

AudioPure spectrogram for Sample 02 — AudioPure

AudioPure+SSNI spectrogram for Sample 02 — AudioPure+SSNI

Noise-0.005 spectrogram for Sample 02 — Noise-0.005

Noise-0.01 spectrogram for Sample 02 — Noise-0.01

Noise-0.02 spectrogram for Sample 02 — Noise-0.02

SpeechTokenizer spectrogram for Sample 02 — SpeechTokenizer

DAC spectrogram for Sample 02 — DAC

AcademiCodec spectrogram for Sample 02 — AcademiCodec

Additional PnP variant

PnP-Gaussian spectrogram for Sample 02 — PnP-Gaussian