CMGAN
Conformer-based metric GAN that pushed VCTK/DEMAND denoising to 3.41 PESQ by training the generator against a learned quality score.
About
CMGAN attacks speech enhancement from two directions at once. The generator is a conformer network — convolution-augmented transformers — applied in two stages so it can model dependencies across both time and frequency in the complex spectrogram, with magnitude and phase estimation decoupled in the decoder and then fused for reconstruction. The unusual part is the discriminator: instead of the usual real/fake judgment, it's a metric discriminator trained to predict an actual evaluation score (like PESQ), so the generator is optimized directly against the quality metric you'd grade it on. On the standard VoiceBank+DEMAND benchmark the authors report PESQ 3.41 and 11.10 dB segmental SNR — a clear margin over the previous generation at publication. The short version appeared at Interspeech 2022 with the longer writeup in IEEE/ACM TASLP, and the authors released the source (MIT) plus a demo page with audio samples. There is also a community causal variant for streamed audio. The caveat, as always: every number is author-reported, and as a non-causal GAN it is not a real-time model.
Specs
Context window
Pricing
Free quota
API access
Weights
Released
Benchmarks
- Paper (Interspeech 2022 / TASLP, author-reported): PESQ 3.41, SSNR 11.10 dB on VoiceBank+DEMAND
- No independent benchmark replication found
Provider-reported unless a source says otherwise. Benchmarks are marketing-adjacent by nature — treat them as directional.
Use cases
Trust score — 7/10
Scored 7/10 (TIER verified, metrics-v1). Evidence: peer-reviewed Interspeech 2022 paper with an extended TASLP version; MIT-licensed public code with audio demos; a genuine architectural contribution (metric discriminator + two-stage conformer). Strengths: strong author-reported numbers on the standard benchmark, clean reproducible design. Docked for: (1) all metrics are author-reported with no independent replication found; (2) non-causal, so no real-time use, and community adoption is thin compared to DeepFilterNet-class models. License: MIT.
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 6.0/10
- Maintenance · recency, releases, issue load
- 5.0/10
- Openness · license + docs
- 9.0/10
- Manual review · sanity read + red-flag check
- 7.0/10
- · Interspeech 2022 paper + IEEE/ACM TASLP extended version; arXiv 2209.11112
- · PESQ 3.41, SSNR 11.10 dB on VoiceBank+DEMAND (author-reported)
- · Metric discriminator optimizes the generator against a learned quality score; community causal variant exists