mirror of
https://github.com/microsoft/BitNet.git
synced 2026-08-23 09:26:33 +00:00
isHuangXin
3b04140a54
- Add quantize_to_i2_s() for direct ternary-to-I2_S packing in conversion script - Support offline-quantized models (uint8 packed weights + weight_scale) - Fix weight_quant double-quantization bug for offline-quantized models - Fix I2_S scale computation to use first nonzero absolute value - Add I2_S ftype mapping and BitNetForCausalLM registration - Refactor ggml-bitnet-lut T-MAC wrapper with proper mul_mat implementation - Update llama.cpp submodule with I2_S ftype and 2B model type support
22 lines
171 B
INI
22 lines
171 B
INI
[Kernels_0]
|
|
m = 3200
|
|
k = 8640
|
|
bm = 160
|
|
bk = 96
|
|
bmm = 32
|
|
|
|
[Kernels_1]
|
|
m = 3200
|
|
k = 3200
|
|
bm = 320
|
|
bk = 96
|
|
bmm = 32
|
|
|
|
[Kernels_2]
|
|
m = 8640
|
|
k = 3200
|
|
bm = 320
|
|
bk = 96
|
|
bmm = 32
|
|
|