BigDL-LLM Key Features

You may run the LLMs using bigdl-llm through one of the following APIs:

• PyTorch API

• Hugging Face transformers Format .. * Native Format

• LangChain API

• GPU Supports

  • Inference on GPU

  • Finetune (QLoRA)

  • Multi GPUs selection