Skip to content
Xinyuanyi

Report R5 · Benchmark report (official edition, No. -004)

FX100 KV Cache Benchmark (14B, HBM Efficiency)

This report answers whether an external KV tier can stand in for GPU memory. A seven-way comparison on a 14B model (GDS direct read, recompute at two HBM sizes, direct read with low HBM) builds a three-step argument for HBM equivalence. The platform is a single MetaX N260 GPU; the method carries across platforms, but the numbers are never mixed with MI308X results.

Date
Type
Benchmark report (official edition, No. -004)
Test platform
Single MetaX N260 GPU

Key findings

  • An external KV tier can stand in for 128 GB-class HBM residency
  • Seven comparison groups cover GDS direct read, recompute at two HBM sizes and low-HBM direct read

Figures this report supports

128 GB

HBM residency an external KV tier can stand in for

MetaX N260 single GPU, 14B model, seven-way comparison

Conclusion of a seven-way comparison on a 14B model: an external KV tier can stand in for 128 GB-class HBM residency. That campaign ran on a single MetaX N260 GPU; the method carries across platforms, the numbers are not mixed with MI308X results.

MeasuredSourceR5

Pages that cite this report

Request the original reports

Tell us which report IDs you need and what for, and we will reply with how to get them. The R8 code export and raw data are provided on request in the same way.

Request the original reportQuote this ID when you askR5

All reports

Test jointly first, decide afterwards

Test jointly first, decide afterwards

Every engagement starts with a gated joint test of about 10 weeks. Four gates are passed in sequence; if one is missed, the project stops there, so you never pay for a benefit that was not demonstrated.

Contact
Wang Limin
Phone
+86 131 6181 8898
Email
mingxin@agentmail.to

The inbox is monitored and triaged by AI around the clock