Skip to content
← Models
Open weightsWeNet Open Source Community/10 trustVerified

WeSpeaker

The research-to-production speaker toolkit from the WeNet community: state-of-the-art speaker embeddings (ResNet, ECAPA, CAM++) plus verification, recognition and diarization recipes in one Apache 2.0 package.

Visit official page →

About

WeSpeaker (wenet-e2e/wespeaker, ICASSP 2023, arXiv 2210.17016) is the speaker-modeling sibling of the WeNet speech-recognition toolkit, built by the same open-source community (X-LANCE Lab at Shanghai Jiao Tong, Tencent, AISpeech, Horizon Robotics, NVIDIA contributors). It focuses on one thing — learning high-quality speaker embeddings — and does it thoroughly: modern architectures (ResNet, ECAPA-TDNN, CAM++ and friends), a full menu of loss functions and scoring back-ends, structured recipes whose results were good enough for winning systems in speaker-verification challenges, and diarization shown as a downstream application of the embeddings. The production angle is real: a CLI (wespeaker --task diarization --audio_file audio.wav), a Python API (model.diarize('audio.wav')), CPU- and GPU-compatible deployment code, and an ONNX runtime, plus a Hugging Face demo. The license situation needs one careful read: the code is Apache 2.0, but the pretrained weights follow the license of their training dataset — e.g. VoxCeleb-trained models are CC-BY-4.0. If you want a Chinese-strong or challenge-grade embedding backbone for your own diarization or verification stack, this is the most complete open starting point.

Specs

Context window

Not applicable — utterance/window-level speaker embedding extraction; diarization via embedding + clustering recipe

Pricing

Free / open source — Apache 2.0 (code); pretrained weights follow dataset licenses (e.g. CC-BY-4.0 for VoxCeleb)

Free quota

Fully open — pip install from GitHub; CLI + Python API; HF and ModelScope demos

API access

No hosted API — self-host via pip/CLI/Python API; interactive demos on Hugging Face and ModelScope

Weights

Open weights

Released

Not disclosed

Benchmarks

  • Competitive results across VoxCeleb and CNCeleb verification recipes, adopted in challenge-winning systems (author-reported, ICASSP 2023)\n- Diarization demonstrated as a downstream recipe; no single published DER headline for it — evaluate on your own data

Provider-reported unless a source says otherwise. Benchmarks are marketing-adjacent by nature — treat them as directional.

Use cases

speaker-diarizationspeaker-verificationspeaker-recognitionvoice-authenticationresearch

Trust score — 8/10

/10 trustVerified

Scored 8/10 (TIER verified, metrics-v1). Evidence: ICASSP 2023 peer-reviewed paper (arXiv 2210.17016); recipes adopted in challenge-winning verification systems; actively maintained repo (pushed September 2026). Strengths: the most complete open speaker-embedding toolkit, genuine production deployment story (CLI, Python API, ONNX runtime), strong multi-institution community. Docked for: (1) diarization is a downstream recipe without its own published benchmark headline; (2) weights licensing is dataset-dependent and needs checking per model; (3) embedding-focused — the diarization recipe needs more assembly than pyannote's pipeline. License: Apache 2.0 (code); weights per dataset license.

How the trust score is built

Full methodology →
Adoption · stars/downloads, log-scaled vs peers
8.0/10
Maintenance · recency, releases, issue load
9.0/10
Openness · license + docs
8.0/10
Manual review · sanity read + red-flag check
8.0/10
  • · ICASSP 2023 paper; recipes adopted in challenge-winning speaker-verification systems.
  • · CLI + Python API + ONNX runtime; diarization is a downstream embedding-clustering recipe.
  • · No published DER headline for the diarization recipe itself — evaluate on own data.

Sources