Ctrl+K
Logo image Logo image
latest

Site Navigation

  • IPEX-LLM Document

Site Navigation

  • IPEX-LLM Document
Back to Homepage ↵

Section Navigation

  • IPEX-LLM Document
  • LLM in 5 minutes
  • Installation
    • CPU
    • GPU
  • Quickstart
    • bigdl-llm Migration Guide
    • Install IPEX-LLM on Linux with Intel GPU
    • Install IPEX-LLM on Windows with Intel GPU
    • Install IPEX-LLM in Docker on Windows with Intel GPU
    • Use Text Generation WebUI on Windows with Intel GPU
    • IPEX-LLM Benchmarking
    • Use llama.cpp with IPEX-LLM on Intel GPU
  • Key Features
    • PyTorch API
    • transformers-style API
      • Hugging Face transformers Format
      • Native Format
    • LangChain API
    • GPU Supports
      • Inference on GPU
      • Finetune (QLoRA)
      • Multi Intel GPUs selection
  • Examples
    • CPU
    • GPU
  • API Reference
    • IPEX-LLM PyTorch API
    • IPEX-LLM transformers-style API
    • IPEX-LLM LangChain API
  • FAQ

transformers-style API#

You may run the LLMs using transformers-style API in ipex-llm.

  • Hugging Face transformers Format

  • Native Format

previous

PyTorch API

next

Hugging Face transformers Format
Show Source

© Copyright 2024, IPEX-LLM Authors.

Created using Sphinx 4.5.0.