BitNet-Transformers
lastmod 2024-03-07created 2024-03-071 edits
0๏ธโฃ1๏ธโฃ๐ค BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture
Documentation
- https://arxiv.org/pdf/2402.17764.pdf
- The Era of 1-bit LLMs - All Large Language Models are in 1.58 Bits