Open sourceOpen-source releaseLarge Language Models · Image, Video & 3D Generation · Data & Datasets1 source · Oct 19, 2026

huggingface/transformers v5.20.2: Patch release v5.20.2

This patch notably solves an issue where some inputs could loose their original type inside prepareinputsforgeneration in generate, leading to problems with multimodal models.

Key points

  • It also fixes some other issues listed on the below commits.
  • Fix inputs dict casting in generate (#49731) by @Cyrilvallez
  • Fix zero expert gradients in bfloat16 with expert parallelism and epsize < fsdpsize (#49688) by @qgallouedec
  • Declare the input modalities of the VLMs that report text only (#49677) by @qgallouedec

Sources (1)

  • [1]huggingface/transformers v5.20.2: Patch release v5.20.2
    GitHub: huggingface/transformers · Oct 19, 05:45 PM
    This patch notably solves an issue where some inputs could loose their original type inside `prepare_inputs_for_generation` in `generate`, leading to problems with multimodal models.
    It also fixes some other issues listed on the below commits.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 17, 2026deepseek-ai/DeepSeek-V4.1-Flash-1017
  2. Oct 16, 2026nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-MXFP8
  3. Oct 16, 2026huggingface/transformers v5.20.1: Release v5.20.1
  4. Oct 16, 2026Welcome Beam: a 501B open model you can own, customize, and scale
  5. Oct 15, 2026I turned a transformer into a game console that runs Pong, Tetris, Space Invaders and 116 more games.
  6. Oct 15, 2026huggingface/transformers v5.20.0: Release v5.20.0

Related