PrismML Bonsai — Does a 1.15GB 8B Model Actually Make Sense?
PrismML Bonsai, built by a Caltech-founded team, is a 1-bit LLM that represents weights using only {-1, +1}. An 8B model fits in 1.15GB and reportedly runs 8x faster than full precision.
Tags
1 post
PrismML Bonsai, built by a Caltech-founded team, is a 1-bit LLM that represents weights using only {-1, +1}. An 8B model fits in 1.15GB and reportedly runs 8x faster than full precision.