# FFmpeg

> FFmpeg, the open-source media toolkit under nearly every video pipeline: its libraries and tools, filter graphs, AI uses, license and current releases.

Source: https://metavert.io/ffmpeg  
Published: 2026-10-24  
Updated: 2026-10-24

**FFmpeg** is the free, open-source toolkit for decoding, encoding, converting, filtering and streaming audio and video. It is two things at once: a set of C libraries, and the command-line tools built on them. The libraries include libavcodec (encoders and decoders), libavformat (container formats), libavfilter (filter graphs), libswscale and libswresample (scaling and resampling), libavutil and libavdevice. The tools are `ffmpeg` for conversion and processing, `ffprobe` for inspecting media and `ffplay`, a simple player. FFmpeg runs inside applications such as VLC, Blender, HandBrake, Kodi, Plex and Chromium-based browsers, and inside nearly every programmatic and AI video pipeline. As of October 2026 the current stable branch is FFmpeg 9.0, "Lei"; version 9.0.2 was released on September 18, 2026.

### History

Fabrice Bellard started FFmpeg in 2000, at first under the pseudonym Gérard Lantau. Michael Niedermayer led the project from 2004 to 2015. In 2011 a group of developers forked it as Libav after a dispute over the project's leadership; Libav was declared abandoned in 2020. FFmpeg is developed on its own git server, with a Forgejo forge at code.ffmpeg.org since 2025, and its GitHub repository is a mirror (65,640 stars on October 24, 2026). Recent releases show where the project is heading. FFmpeg 8.0, "Huffman" (August 2025), added native decoders such as ProRes RAW and APV, Vulkan compute-based codecs and a Whisper filter for speech recognition. 8.1, "Hoare" (March 2026), added more Vulkan and hardware encoding paths. The 9.0 branch followed in August 2026.

### Why Video Pipelines Depend on It

- **Filter graphs.** One command can chain trimming, scaling, cropping, overlays, text, color adjustments and audio mixing. Pipelines that describe an edit as data often compile it to an FFmpeg filter graph; see [video as code vs nonlinear editing](https://metavert.io/compare/video-as-code-vs-nonlinear-editing).
- **Encoding for code-based renderers.** Frameworks that draw frames in a browser hand them to FFmpeg to encode. [HyperFrames](https://metavert.io/hyperframes) captures frames in headless Chrome and encodes them with FFmpeg, and [Remotion](https://metavert.io/remotion) has bundled a lightweight FFmpeg build since version 4.0.
- **Analysis and quality control.** `ffprobe` reports streams, codecs and durations as JSON. Filters find scene changes (the `select` filter's scene score and `scdet`; see [scene detection](https://metavert.io/scene-detection)), detect black frames, frozen video and silence, and measure and normalize loudness to EBU R 128 (`ebur128` and `loudnorm`; see [loudness normalization](https://metavert.io/loudness-normalization) and [video quality control](https://metavert.io/video-quality-control)).
- **A tool for agents.** AI coding agents can write FFmpeg commands directly, and agent pipelines lean on it. [OpenMontage](https://metavert.io/openmontage) uses FFmpeg for assembly, encoding, subtitle burn-in and mixing, and as a pan-and-zoom fallback renderer; VEED's OpenEdit checks for it on its first run. The Whisper filter brings [speech recognition](https://metavert.io/speech-recognition) into the same tool.

### License and Patents

FFmpeg is licensed under the GNU Lesser General Public License, version 2.1 or later. Some optional parts are covered by the GPL, version 2 or later, and if they are used the GPL applies to all of FFmpeg; the project offers no commercial license. Its legal page gives a checklist for staying within the LGPL: build without the GPL and "nonfree" options, link dynamically, distribute the matching source and configuration, and credit FFmpeg. Patents are a separate matter. FFmpeg's legal page notes that standards such as H.264 may be covered by patents in some countries, and that commercial products face more risk than personal use.

### How It Compares

FFmpeg is the layer most other video tools build on rather than a rival to them. GStreamer, another open-source multimedia framework, is organized around pipelines of plug-ins. Hosted video APIs such as Shotstack and Creatomate wrap similar operations as cloud services. Programmatic renderers such as Remotion, HyperFrames and [Motion Canvas](https://metavert.io/motion-canvas) generate the frames, and FFmpeg encodes and assembles them. For how FFmpeg fits into AI analysis of footage, see [video understanding](https://metavert.io/video-understanding).

## Related Topics

- [Video as Code](https://metavert.io/video-as-code) — Edits written as specifications and rendered
- [Video as Code vs Nonlinear Editing](https://metavert.io/compare/video-as-code-vs-nonlinear-editing) — Spec-and-render against the timeline
- [Scene Detection](https://metavert.io/scene-detection) — Finding cuts and shots automatically
- [Loudness Normalization](https://metavert.io/loudness-normalization) — Measuring and matching loudness
- [Video Quality Control](https://metavert.io/video-quality-control) — Automated checks before delivery
- [Video Understanding](https://metavert.io/video-understanding) — AI analysis of footage
- [Remotion](https://metavert.io/remotion) — A React video framework that bundles FFmpeg
- [HyperFrames](https://metavert.io/hyperframes) — HTML rendered to video and encoded with FFmpeg
- [OpenMontage](https://metavert.io/openmontage) — An agent pipeline built on FFmpeg
- [Whisper](https://metavert.io/whisper) — The speech model behind FFmpeg's Whisper filter

## Further Reading

- [FFmpeg](https://ffmpeg.org/) — the project site and news
- [FFmpeg downloads](https://ffmpeg.org/download.html) — current releases, including 9.0.2 "Lei"
- [FFmpeg license and legal considerations](https://ffmpeg.org/legal.html) — LGPL, optional GPL parts and patents
- [FFmpeg filters documentation](https://ffmpeg.org/ffmpeg-filters.html) — scene detection, loudness and quality-control filters
- [FFmpeg on Wikipedia](https://en.wikipedia.org/wiki/FFmpeg) — history, libraries and users
- [Remotion 4.0](https://www.remotion.dev/blog/4-0) — the release that bundled FFmpeg into Remotion
