5 Commits

Include renames

Author	SHA1	Message	Date
isHuangXin	b6a21be4e0	Add BitNet Embeddings 0.6B/270M I2_S conversion guide and update README ... - Add docs/bitnet-embeddings-i2s-guide.md with model overview, I2_S GGUF conversion details, accuracy verification, inference performance benchmarks, and quick start examples for both 0.6B (Qwen3) and 270M (Gemma3) models - Add embedding quantization chart (fig1_quant_per_task.png) - Remove old docs/bitnet-embeddings-gguf-conversion.md (replaced by new guide) - Add bitnet-embedding-0.6b and bitnet-embedding-270m to supported HF models in setup_env.py - Update README.md What's New section with link to the new guide	2026-07-16 17:29:40 +02:00
isHuangXin	ce530b0fd0	Add bitnet-embeddings-270m model adaptation with F16 and I2_S GGUF conversion ... - Add LLM_ARCH_GEMMA3 in llama.cpp for gemma3_text model type (embedding scaling, GELU, post-attn/post-FFN norms, GQA) - Add GGUF conversion support for Gemma3-based 270m models (SPM tokenizer, RMSNorm w+1 offset, arch-specific tensor mapping) - Add tokenizer hash for multilingual-e5-0.6b-260311 - Add conversion documentation	2026-07-15 08:29:16 +02:00
isHuangXin	69bf64d373	Add bitnet-embeddings-0.6b model adaptation with F16 and I2_S GGUF conversion ... - Add GGUF conversion tool for bitnet-embeddings-0.6b (safetensors -> F16/I2_S GGUF) - Add Qwen3 architecture support in llama.cpp submodule with per-projection RMSNorm - Add I2_S ternary quantization (2-bit packed -1/0/+1) for lossless precision - Add f16 norm weight support for correct embedding inference - Guard bitnet-lut-kernels.h include with TL1/TL2 preprocessor checks - Update llama.cpp submodule to dev-bitnet-embedding-0.6b branch - Document F16 (from multilingual-e5-0.6b) and I2_S (from bitnet-embeddings-0.6b) conversion process	2026-07-12 04:10:30 +02:00
Jason Davies	b384804b95	Fix typos.	2024-10-17 21:00:15 +01:00
potassiummmm	6cfd8831fd	initial commit	2024-10-17 21:21:10 +08:00