Add BitNet Embeddings 0.6B/270M I2_S conversion guide and update README

Browse Source

- Add docs/bitnet-embeddings-i2s-guide.md with model overview, I2_S GGUF
  conversion details, accuracy verification, inference performance benchmarks,
  and quick start examples for both 0.6B (Qwen3) and 270M (Gemma3) models
- Add embedding quantization chart (fig1_quant_per_task.png)
- Remove old docs/bitnet-embeddings-gguf-conversion.md (replaced by new guide)
- Add bitnet-embedding-0.6b and bitnet-embedding-270m to supported HF models
  in setup_env.py
- Update README.md What's New section with link to the new guide

...

This commit is contained in:

isHuangXin

2026-07-16 17:29:40 +02:00

parent 10dca87a5d

commit b6a21be4e0

5 changed files with 544 additions and 411 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

docs/fig1_quant_per_task.png

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 61 KiB