Deforum
Open-source Stable Diffusion animation with frame-level prompt and camera control.
About
Deforum began as a Google Colab notebook and became one of the best-known open-source approaches to Stable Diffusion animation. Instead of generating a finished video in one request, it renders a sequence of diffusion frames while prompts, camera movement, zoom, rotation, and translation change over time via keyframe scheduling. It supports 2D and 3D motion, depth warping, hybrid video, and ffmpeg assembly.
The project is now best understood as an ecosystem: the original standalone notebook is no longer maintained and Deforum Studio is not accepting new accounts, so the practical entry points are community integrations such as the AUTOMATIC1111 WebUI extension and ComfyUI nodes. It offers unusually detailed control but requires a Stable Diffusion setup, compatible hardware or rented compute, and patience for a technical workflow.
What it can do
- Keyframe prompt and camera scheduling
- 2D/3D motion with depth warping
- Hybrid video and ffmpeg assembly
Setup
Use the AUTOMATIC1111 extension, ComfyUI nodes, or run a community fork notebook.
Prerequisites
A Stable Diffusion setup with a GPU or rented compute.
Use cases
Works with
Trust score — 7/10
Scored 7/10 (metrics tier, metrics-v1). Evidence: Verified via vendor site/docs/GitHub and reputable coverage, wave 77; Trending score 68/100 from researcher assessment.
Sources
Every fact above was checked against these sources. Where a claim comes from the provider and couldn't be independently verified, the text says so.