-
gausah-arm authored
[Feat] Allow symmetric_no_clipping_error for KleidiAI kernels, update Readme and validate Kleidi INT4 quantization path (#2570) * [Feat] Restore and validate KleidiAI INT4 quantization path using updated quantizer API - Switched to quantize_() with Int8DynamicActivationIntxWeightConfig - Validated the move of packed_linear_int8_dynamic_activation_intx_weight_layout.py in torchao/dtypes/uintx - Fixed handling of SYMMETRIC_NO_CLIPPING_ERR mapping type - Validated INT4 path on a 2-layer nn.Sequential model with torch.int4 weights - Compared SYMMETRIC vs SYMMETRIC_NO_CLIPPING_ERR across PerAxis and PerGroup granularities * [Fix]: Allow "SYMMETRIC_NO_CLIPPING_ERR" in Int8DynamicActivationIntxWeightConfig * [FEAT]: Add SYMMETRIC_NO_CLIPPING_ERR to tests * Update test_int8_dynamic_activation_intx_weight.py * Update test_int8_dynamic_activation_intx_weight.py * Update test_int8_dynamic_activation_intx_weight.py --------- Co-authored-by:
Scott Roy <161522778+metascroy@users.noreply.github.com>ebfe1736
This project is licensed under the Other.
Learn more