 Kai Wu
|
2ea7f57991
convertion missing preprocessor_config.json.
|
1 gadu atpakaļ |
 Matthias Reso
|
e2f77dbc21
fix quant config
|
1 gadu atpakaļ |
|
Matthias Reso
|
6ef9a78458
Fix issues with quantization_config == None
|
1 gadu atpakaļ |
|
Matthias Reso
|
0920b1a415
Fix quantization for inference
|
1 gadu atpakaļ |
 Hamid Shojanazeri
|
d51d2cce9c
adding sdpa for flash attn
|
1 gadu atpakaļ |
|
Hamid Shojanazeri
|
db8af96ff0
update the model load with native flash attn
|
1 gadu atpakaļ |
|
Matthias Reso
|
4c9cc7d223
Move modules into separate src folder
|
2 gadi atpakaļ |
