isHuangXin 69bf64d373 Add bitnet-embeddings-0.6b model adaptation with F16 and I2_S GGUF conversion ...

- Add GGUF conversion tool for bitnet-embeddings-0.6b (safetensors -> F16/I2_S GGUF)
- Add Qwen3 architecture support in llama.cpp submodule with per-projection RMSNorm
- Add I2_S ternary quantization (2-bit packed -1/0/+1) for lossless precision
- Add f16 norm weight support for correct embedding inference
- Guard bitnet-lut-kernels.h include with TL1/TL2 preprocessor checks
- Update llama.cpp submodule to dev-bitnet-embedding-0.6b branch
- Document F16 (from multilingual-e5-0.6b) and I2_S (from bitnet-embeddings-0.6b) conversion process

2026-07-12 04:10:30 +02:00

..

codegen_tl1.py

initial commit

2024-10-17 21:21:10 +08:00

codegen_tl2.py

Fix compiler errors on GCC

2024-10-25 16:23:01 +02:00

convert-bitnet-embedding-to-gguf.py

Add bitnet-embeddings-0.6b model adaptation with F16 and I2_S GGUF conversion

2026-07-12 04:10:30 +02:00

convert-helper-bitnet.py

[modify] update README; [feat] some test script in utils

2026-01-22 06:33:03 +00:00

convert-hf-to-gguf-bitnet.py

add falcon-e support

2025-05-14 17:07:05 +04:00

convert-ms-to-gguf-bitnet.py

[fix] convert pt to gguf

2026-02-03 05:24:24 +00:00

convert.py

[fix] convert pt to gguf

2026-02-03 05:24:24 +00:00

e2e_benchmark.py

Fix llama-bench path error on Windows

2024-10-31 16:50:47 +08:00

generate-dummy-bitnet-model.py

initial commit

2024-10-17 21:21:10 +08:00

preprocess-huggingface-bitnet.py

Enable conversion from .safetensors checkpoints to gguf files

2025-05-23 16:19:29 +08:00

quantize_embeddings.py

[modify] update README; [feat] some test script in utils

2026-01-22 06:33:03 +00:00

test_gemm_kernel.sh

[modify] some utils test script

2026-01-24 08:40:36 +00:00

test_perplexity.py

[modify] update README; [feat] some test script in utils

2026-01-22 06:33:03 +00:00

test_power.sh

[modify] some test picture and add power test script

2026-01-25 06:51:33 +00:00

tune_gemm_config.py

[modify] some utils test script

2026-01-24 08:40:36 +00:00