Infrastructure & Agents

What Is INT8 Quantization?

INT8 quantization converts a model's numbers from floating point to 8-bit integers, reducing memory use and often speeding up inference. It can slightly affect accuracy, so techniques exist to minimize the loss.