AI Runtime for Power
A Spyre card does nothing on its own. IBM requires Red Hat software to drive it, and that software needs a model to serve. These are the pieces that turn IBM Power silicon into a working AI system.
IBM Granite Models
IBM's own family of open language models, and the cargo an accelerator card is built to carry. You can download them free, run them on your own hardware, and nobody meters the tokens.
Model ServingRed Hat AI Inference Server
One of the two products IBM names as required before a Spyre card will do anything. It is the driver, the traffic controller, and the reason a 128 GB card can serve more than one person at a time.
AI PlatformRed Hat OpenShift AI
The other product IBM accepts for driving a Spyre card. It is the heavier option: a full container platform for teams running several models, several projects, and more than one server.
Foundation Model PlatformRed Hat Enterprise Linux AI (RHEL AI)
A bootable Linux image with IBM Granite models and the InstructLab tuning tools already inside. It is the shortest route from bare metal to a working model, and it is where Granite and Red Hat stop being two separate decisions.
Model TuningInstructLab
The open source project that lets the person who knows your business teach a model, without that person being a data scientist. For a shop whose knowledge lives in three people's heads, this is the interesting one.
Model ServingvLLM
The open source engine inside the product IBM requires for a Spyre card. Worth knowing by name, because it is the reason the same card can answer many people at once instead of queuing them.