• gausah-arm's avatar
    [Feat] Allow symmetric_no_clipping_error for KleidiAI kernels, update Readme... · ebfe1736
    gausah-arm authored
    
    [Feat] Allow symmetric_no_clipping_error for KleidiAI kernels, update Readme and validate Kleidi INT4 quantization path  (#2570)
    
    * [Feat] Restore and validate KleidiAI INT4 quantization path using updated quantizer API
    
    - Switched to quantize_() with Int8DynamicActivationIntxWeightConfig
    - Validated the move of
      packed_linear_int8_dynamic_activation_intx_weight_layout.py in torchao/dtypes/uintx
    - Fixed handling of SYMMETRIC_NO_CLIPPING_ERR mapping type
    - Validated INT4 path on a 2-layer nn.Sequential model with torch.int4 weights
    - Compared SYMMETRIC vs SYMMETRIC_NO_CLIPPING_ERR across PerAxis and PerGroup granularities
    
    * [Fix]: Allow "SYMMETRIC_NO_CLIPPING_ERR" in Int8DynamicActivationIntxWeightConfig
    
    * [FEAT]: Add SYMMETRIC_NO_CLIPPING_ERR to tests
    
    * Update test_int8_dynamic_activation_intx_weight.py
    
    * Update test_int8_dynamic_activation_intx_weight.py
    
    * Update test_int8_dynamic_activation_intx_weight.py
    
    ---------
    Co-authored-by: default avatarScott Roy <161522778+metascroy@users.noreply.github.com>
    ebfe1736
This project is licensed under the Other. Learn more