Skip to content
Xinyuanyi

Report R4 · Official third-party test report

FX100 KV Cache Benchmark (480B, Multi-Instance, No. -006)

The official compilation of R2 and R3, issued by a third-party testing organization as report No. -006. If your procurement or compliance process needs a document from an independent body, this is the one to cite.

Date
Type
Official third-party test report
Test platform
8 × AMD Instinct MI308X · ROCm 7.2

Key findings

  • Compiles every measured conclusion from R2 (TP8) and R3 (TP4×2)
  • Issued by a third-party testing organization as report No. -006

Test platform

Applies to R1, R2, R3, R4. Other reports state their platform in their own entries.
Accelerators8 × AMD Instinct MI308X (192 GB HBM each, gfx942)
Host2 × AMD EPYC 9654 (384 threads), about 1.5 TB RAM
Software stackROCm 7.2 · vLLM 0.20.1+rocm721 · LMCache (built from upstream mainline, 2026-06-29)
Device under testFX100 all-flash NVMe-oF array: 4-drive RAID0 (14 TB, XFS), RoCEv2, one 100 GbE port
BaselinesA single local NVMe drive (PCIe Gen4, 2 TB); no external storage, full recompute
480B modelQwen3-Coder-480B-FP8 (MoE, about 450 GB of weights)

Pages that cite this report

Request the original reports

Tell us which report IDs you need and what for, and we will reply with how to get them. The R8 code export and raw data are provided on request in the same way.

Request the original reportQuote this ID when you askR4

All reports

Test jointly first, decide afterwards

Test jointly first, decide afterwards

Every engagement starts with a gated joint test of about 10 weeks. Four gates are passed in sequence; if one is missed, the project stops there, so you never pay for a benefit that was not demonstrated.

Contact
Wang Limin
Phone
+86 131 6181 8898
Email
mingxin@agentmail.to

The inbox is monitored and triaged by AI around the clock