cryptolabinc/heaan-encrypted-llm-experience repository overview

⁠HEaaN Encrypted LLM Experience

HEaaN Encrypted LLM Experience enables developers to build encrypted LLMs with custom functions—such as tailored softmax—while leveraging homomorphic encryption for secure computations, and it is designed to encourage developers to share their experiences and ideas.

To learn more about HEaaN Encrypted LLM Experience and how to use it, please visit ckks.org⁠, and check out the Latest Development Update. Once you agree to CryptoLab's Software License Agreemet on the website, you'll receive access to our Installation Guide, covering download, configuration, and execution, along with additional sections including In-Depth Usage instructions, an API reference, example code, and more.

If you have any question, please visit our discord, and join the #encrypted-llm-experience channel: discord⁠

⁠License

Encrypted LLM Experience is licensed under CryptoLab's Software License Agreement, strictly for non-commercial purposes. Usage is permitted solely for Encrypted LLM Experience. Any other uses, including commercial applications or alternate purposes, are expressly prohibited.

The full license text is available here: license⁠

⁠Memory Requirement

HEaaN Encrypted LLM Experience requires a minimum of 16GB VRAM. However, it is recommended to use at least 24 GB VRAM for optimal performance and to prevent any memory-related issues.