IBM Granite Switch 4.1: chat, decisions, and ASR on one endpoint

At a glance

IBM Granite Switch 4.1 (Oct 15, HF blog): 8B/30B compose chat + Decision aLoRA + Guardian safety aLoRA + Granite-Speech-5.0-Turbo-CTC ASR in ~base VRAM via Activated LoRAs with shared KV cache—swap chat/decision/speech on one endpoint; vLLM plugin and llama.cpp support; community can mix Granite Libraries adapters. This workflow is listed under decision-models, ASR, adapters, multimodal-endpoint, open-model.

Agents / tools

Granite Switch 4.1, IBM Granite, Granite Speech, vLLM, llama.cpp

Source

https://huggingface.co/blog/ibm-granite/granite-switch-4-1

Deep link

https://usecaseboard.com/usecases/3333e656c895487cc123c7c5d1754142

Building a tool for these workflows? Sponsor / inquire.