Skip to content

Latest commit

 

History

History
4 lines (2 loc) · 271 Bytes

README.md

File metadata and controls

4 lines (2 loc) · 271 Bytes
Raw

Activation Channel Scales

We provide the activation channel scales for OPT and BLOOM models. We get those scales with 512 random sentences in the Pile validation set. You can use ../examples/smoothquant_opt_demo.ipynb to test smoothing and quantizing those models.