Ctrl+K
Logo image Logo image
latest

Site Navigation

  • User guide
  • Powered by
  • LLM
  • Orca
  • Nano
  • DLlib
  • Chronos
  • Friesian
  • PPML
  • Contributor guide
  • Cluster serving
  • Presentations
  • Blogs

Site Navigation

  • User guide
  • Powered by
  • LLM
  • Orca
  • Nano
  • DLlib
  • Chronos
  • Friesian
  • PPML
  • Contributor guide
  • Cluster serving
  • Presentations
  • Blogs
Back to Homepage ↵

Section Navigation

  • BigDL-LLM Document
  • Installation
    • CPU
    • GPU
  • Quickstart
    • Install BigDL-LLM on Windows
    • Use Text Generation WebUI on Windows
    • BigDL-LLM Benchmarking
  • Key Features
    • PyTorch API
    • Hugging Face transformers Format
    • LangChain API
    • GPU Supports
      • Inference on GPU
      • Finetune (QLoRA)
      • Multi Intel GPUs selection
  • API Reference
    • BigDL-LLM PyTorch API
    • BigDL-LLM transformers-style API
    • BigDL-LLM LangChain API
  • FAQ

BigDL-LLM API#

  • BigDL-LLM PyTorch API
    • Optimize Model
    • Load Optimized Model
  • BigDL-LLM transformers-style API
    • Hugging Face transformers AutoModel
      • AutoModelForCausalLM
      • AutoModel
      • AutoModelForSpeechSeq2Seq
      • AutoModelForSeq2SeqLM
    • Native Model
  • BigDL-LLM LangChain API
    • LLM Wrapper of LangChain
      • Hugging Face transformers Format
      • Native Model
    • Embeddings Wrapper of LangChain
      • Hugging Face transformers AutoModel
      • Native Model

previous

Multi Intel GPUs selection

next

BigDL-LLM PyTorch API

Show Source

© Copyright 2020, BigDL Authors.

Created using Sphinx 4.5.0.