Microsoft just released BitNet b1.58, a 1-bit LLM with 2B parameters that can run on CPUs including Apple M2. BitNet b1.58 2B4T outperforms fp LLaMA 3.2 1B while using only 0.4GB memory versus 2GB and processes tokens 40% faster.
Microsoft just released BitNet b1.58, a 1-bit LLM with 2B parameters that can run on CPUs including Apple M2. BitNet b1.58 2B4T outperforms fp LLaMA 3.2 1B while using only 0.4GB memory versus 2GB and processes tokens 40% faster.
