128 GB
HBM residency an external KV tier can stand in for
MetaX N260 single GPU, 14B model, seven-way comparison
Conclusion of a seven-way comparison on a 14B model: an external KV tier can stand in for 128 GB-class HBM residency. That campaign ran on a single MetaX N260 GPU; the method carries across platforms, the numbers are not mixed with MI308X results.
MeasuredSourceR5