Running the example script llm-compressor/examples/quantization_w4a4_fp4/llama3_example.py results in a runtime error. Full traceback is included below.

Hi, thanks for the amazing work. I need some help understanding how to choose the layers for specific models, especially those without examples. I am currently looking at Qwen3-32b, which I see only ...

Abstract: We construct a randomized vector quantizer which has a smaller maximum error compared to all known lattice quantizers with the same entropy for dimensions 5 ...