Glossary

What Is ROCm?

ROCm is AMD's open-source software stack for GPU computing, covering drivers, compilers, math libraries and deep-learning framework support. On AMD Instinct accelerators it plays the role CUDA plays on NVIDIA platforms.

Updated November 12, 2026

In the measurements

All MI308X benchmarks on this site run on ROCm 7.2, with vLLM and LMCache built from sourceR1.

Related test reports

R1FX100 Comprehensive LLM Inference and Training Benchmark (8 × AMD MI308X)One report, five questions: how much the LMCache parallel-read patch helps, whether KV tiering scales across GPUs, how much faster 8 GPUs load models concurrently, how effective utilization changes under frequent model switching, and how much faster concurrent training checkpoint writes become. Test models are Qwen2.5-32B and 7B.2026-07-03
8 × AMD Instinct MI308X · ROCm 7.2

Nearby terms

MoE (mixture of experts)
MoE (mixture of experts) is a model architecture in which each layer contains several expert sub-networks and each token activates only a few of them. It lets a model grow very large without a proportional increase in compute per token, at the cost of a very large set of weights.
Checkpoint
A checkpoint is a snapshot of model state saved to storage at intervals during training, used for failure recovery and for keeping results. Training usually pauses while it is written, so the slower the write, the longer the GPUs sit idle.

All terms

Test jointly first, decide afterwards

Every engagement starts with a gated joint test of about 10 weeks. Four gates are passed in sequence; if one is missed, the project stops there, so you never pay for a benefit that was not demonstrated.

Book a joint test See the evidence

Contact: Wang Limin
Phone: +86 131 6181 8898
Email: mingxin@agentmail.to
The inbox is monitored and triaged by AI around the clock