Commit graph

5 commits

Author SHA1 Message Date
oobabooga 7dfb6e9c57 Add quantization options (bnb and quanto) 2025-12-01 17:05:42 -08:00
oobabooga cecb172d2c Add the code for 4-bit quantization 2025-11-27 18:29:32 -08:00
oobabooga 742db85de0 Hardcode 8-bit quantization for now 2025-11-27 18:23:36 -08:00
oobabooga 822e74ac97 Lint 2025-11-27 18:15:15 -08:00
oobabooga 9e33c6bfb7 Add missing files 2025-11-27 15:56:58 -08:00