Skip to content
← Models
Open weightsHugging Face/10 trustVerified

SmolVLM2

Tiny vision-language models (256M to 2.2B) that watch video and read documents on a laptop: Apache 2.0, MLX and ONNX ready.

Visit official page →

About

SmolVLM2 is Hugging Face's second-generation tiny vision-language family, built on the Idefics3 architecture with a SigLIP image encoder and SmolLM2 as the text decoder. It ships in three sizes, 256M, 500M and 2.2B, with video-capable instruct variants, and trains on 3.3 million samples drawn from ten datasets spanning images, multi-image sets, video and text. The 256M video model needs only about 1.38 GB of GPU RAM for video inference, which is the whole point: multimodal understanding that fits on a laptop or a phone-class device.

The provider's evaluation has the 2.2B model at 52.1 on Video-MME, 55.2 on MLVU and 46.3 on MVBench, with the smaller sizes trailing by roughly ten points, plus solid document and chart scores (DocVQA 79.7, ChartQA 71.6 at 2.2B). Checkpoints are Apache 2.0 with Transformers, MLX and ONNX support, so deployment options are wide. As with any tiny VLM, expect fluent descriptions and decent OCR rather than the reasoning depth of models ten times its size.

Specs

Context window

Interleaved text + image/video tokens; budget varies by size variant

Pricing

Free, self-hosted

Free quota

No quota; weights freely downloadable from Hugging Face

API access

No hosted API; Transformers, MLX and ONNX checkpoints on Hugging Face

Weights

Open weights

Released

Not disclosed

Benchmarks

  • 2.2B (provider-reported): Video-MME 52.1, MLVU 55.2, MVBench 46.27; MathVista 43.9, MMMU 38.3, OCRBench 65.5, ChartQA 71.6, DocVQA 79.7
  • 500M: Video-MME 42.2, MLVU 47.3, MVBench 39.73; 256M: Video-MME 33.7, MLVU 40.6, MVBench 32.7 (provider-reported)

Provider-reported unless a source says otherwise. Benchmarks are marketing-adjacent by nature — treat them as directional.

Use cases

video-understandingdocument-qaimage-captioningon-device-vision

Trust score — 8/10

/10 trustVerified

Scored 8/10 (verified tier, metrics-v1). Evidence: Apache 2.0 license, three model sizes, SigLIP + SmolLM2 architecture and 3.3M-sample training mix all confirmed on HuggingFaceTB model cards; benchmark tables cross-checked across the 256M and 500M video-instruct cards; training code in the public huggingface/smollm repo. Strengths: fully open weights and training recipe from a top-tier maintainer, rare video capability at this scale, broad runtime support. Docked for: (1) all benchmark figures are provider-reported; (2) tiny VLMs remain weak at multi-step visual reasoning versus larger models. License: Apache-2.0.

How the trust score is built

Full methodology →
Adoption · stars/downloads, log-scaled vs peers
8.0/10
Maintenance · recency, releases, issue load
8.0/10
Openness · license + docs
10.0/10
Manual review · sanity read + red-flag check
7.0/10
  • · Hugging Face; paper arXiv 2504.05299
  • · 256M/500M/2.2B sizes; 3.3M training samples
  • · Training code public in huggingface/smollm

Sources