0xBitNet

Loading model...

BitNet in the Browser. That's it.

import { BitNet } from "0xbitnet";

const model = await BitNet.load(url);

for await (const token of model.generate(messages)) {
  process.stdout.write(token);
}

Try It — Load BitNet 2B-4T (~700 MB)

npm install 0xbitnet — GitHub · npm

Send