dustynv/bitsandbytes repository overview

To start the container, you can use jetson-containers run⁠ and autotag⁠, or manually put together a docker run⁠ command:

# automatically pull or build a compatible container image
jetson-containers run $(autotag bitsandbytes)

# or explicitly specify one of the container images above
jetson-containers run dustynv/bitsandbytes:r35.2.1

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/bitsandbytes:r35.2.1

To mount your own directories into the container, use the -v⁠ or --volume⁠ flags:

jetson-containers run -v /path/on/host:/path/in/container $(autotag bitsandbytes)

To launch the container running a command, as opposed to an interactive shell:

jetson-containers run $(autotag bitsandbytes) my_app --abc xyz

You can pass any options to it that you would to docker run⁠, and it'll print out the full command that it constructs before executing it.

If you use ⁠autotag⁠ as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup⁠, then run:

jetson-containers build bitsandbytes

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help⁠ for build options.