[BugFix] Fix Marlin24 Bug

[dsikka]

Summary

• Fix the check for permutations which have been incorrectly been running for the channel-wise case
• Idk how this ever worked for group quant

Generations Using Group Quantization in vLLM:

[' Paris and it is located in the north-west of the country.\nThe population of', ' the leader of the executive branch of the federal government, and thus the head of', ' Liz. I live in a small town in the middle of a prairie.']

[rahul-tuli]

Whaaaaaaaaaaaaaaaaaaat 🥲

[kylesayrs]

This should just be a syntax warning? Not sure if I see why this would raise an error

[rahul-tuli]

This should just be a syntax warning? Not sure if I see why this would raise an error

This doesn't raise an error, but before this diff the group quantized models with marlin_24 compressor were giving 0 accuracy