🚀 The feature, motivation and pitch
Int8DynActInt4WeightQuantizer for -qmode 8da4w is no longer being developed by ao and doesn't support bias. Migrate to the new quantize_ api which can take in int8_dynamic_activation_int4_weight.
Alternatives
No response
Additional context
No response
RFC (Optional)
No response
cc @mergennachin @iseeyuan @lucylq @helunwencser @tarun292 @kimishpatel @cccclai
🚀 The feature, motivation and pitch
Int8DynActInt4WeightQuantizerfor-qmode 8da4wis no longer being developed by ao and doesn't support bias. Migrate to the newquantize_api which can take inint8_dynamic_activation_int4_weight.Alternatives
No response
Additional context
No response
RFC (Optional)
No response
cc @mergennachin @iseeyuan @lucylq @helunwencser @tarun292 @kimishpatel @cccclai