Open
Description
Thanks for composing this code, I am using quantize.py to quantize my model.
And I meet the following issues:
- model.register_buffer(n, p): string n cannnot include '.', so I replce all the '.' with '_'. then problem solved.
2.q_x.scale * (q_x.tensor.float() - q_x.zero_point): Maybe before quantization, the bytetensor should be converted to float tensor?
Metadata
Metadata
Assignees
Labels
No labels