Add Gemma4 12b unified model support in Fairseq2#1519

Merged

YunchaoYang merged 12 commits into

mainfrom

yy/gemma4-12b-unified

Jul 16, 2026

Commits on Jun 5, 2026

[gemma4] Add 12B (Unified family) arch and extend HF multimodal filter
ProfAI
committed

Commits on Jun 7, 2026

Commits on Jun 8, 2026

[gemma4] Wire audio embedder for Gemma 4 Unified family (12B)
ProfAI
committed
[gemma4] Co-locate 12B asset under /checkpoint/smallomnillm with the rest of the family
ProfAI
committed
[gemma4] Gemma4MultimodalAudioEmbedder: add cast_input_dtype flag
ProfAI
committed

Commits on Jun 16, 2026

[gemma4] Fix isort/black lint errors in __init__.py and tokenizer.py
Yunchao Yang
committed

Commits on Jun 24, 2026

[gemma4] Address PR review: hg:// 12B cards, Literal audio_mode, drop getattr
Yunchao Yang
committed