Article

INT8 but no speedup: the time eaten by the memory wall on RK3588

On RK3588, converting a model to INT8 does not speed up inference; the bottleneck comes from the memory wall rather than compute. The article analyzes the portion of time consumed by memory access in this phenomenon, explaining that quantization gains are limited by bandwidth rather than computational precision.

This page provides a summary and source link only.