IBM has released the fourth generation of its Granite language models. Granite 4.0 uses a hybrid Mamba/Transformer architecture aimed at lowering memory requirements during inference without cutting performance.
The article IBM's Granite 4.0 family of hybrid models uses much less memory during inference appeared first on THE DECODER.