SmolVLM2
Tiny vision-language models (256M to 2.2B) that watch video and read documents on a laptop: Apache 2.0, MLX and ONNX ready.
About
SmolVLM2 is Hugging Face's second-generation tiny vision-language family, built on the Idefics3 architecture with a SigLIP image encoder and SmolLM2 as the text decoder. It ships in three sizes, 256M, 500M and 2.2B, with video-capable instruct variants, and trains on 3.3 million samples drawn from ten datasets spanning images, multi-image sets, video and text. The 256M video model needs only about 1.38 GB of GPU RAM for video inference, which is the whole point: multimodal understanding that fits on a laptop or a phone-class device.
The provider's evaluation has the 2.2B model at 52.1 on Video-MME, 55.2 on MLVU and 46.3 on MVBench, with the smaller sizes trailing by roughly ten points, plus solid document and chart scores (DocVQA 79.7, ChartQA 71.6 at 2.2B). Checkpoints are Apache 2.0 with Transformers, MLX and ONNX support, so deployment options are wide. As with any tiny VLM, expect fluent descriptions and decent OCR rather than the reasoning depth of models ten times its size.
Specs
Context window
Pricing
Free quota
API access
Weights
Released
Benchmarks
- 2.2B (provider-reported): Video-MME 52.1, MLVU 55.2, MVBench 46.27; MathVista 43.9, MMMU 38.3, OCRBench 65.5, ChartQA 71.6, DocVQA 79.7
- 500M: Video-MME 42.2, MLVU 47.3, MVBench 39.73; 256M: Video-MME 33.7, MLVU 40.6, MVBench 32.7 (provider-reported)
Provider-reported unless a source says otherwise. Benchmarks are marketing-adjacent by nature — treat them as directional.
Use cases
Trust score — 8/10
Scored 8/10 (verified tier, metrics-v1). Evidence: Apache 2.0 license, three model sizes, SigLIP + SmolLM2 architecture and 3.3M-sample training mix all confirmed on HuggingFaceTB model cards; benchmark tables cross-checked across the 256M and 500M video-instruct cards; training code in the public huggingface/smollm repo. Strengths: fully open weights and training recipe from a top-tier maintainer, rare video capability at this scale, broad runtime support. Docked for: (1) all benchmark figures are provider-reported; (2) tiny VLMs remain weak at multi-step visual reasoning versus larger models. License: Apache-2.0.
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 8.0/10
- Maintenance · recency, releases, issue load
- 8.0/10
- Openness · license + docs
- 10.0/10
- Manual review · sanity read + red-flag check
- 7.0/10
- · Hugging Face; paper arXiv 2504.05299
- · 256M/500M/2.2B sizes; 3.3M training samples
- · Training code public in huggingface/smollm