IPEX-LLM LangChain API

LLM Wrapper of LangChain

Hugging Face transformers Format

IPEX-LLM provides TransformersLLM and TransformersPipelineLLM, which implement the standard interface of LLM wrapper of LangChain.

AutoModelpipeline

Native Model

For llama/bloom/gptneox/starcoder model families, you could also use the following LLM wrappers with the native (cpp) implementation for maximum performance.

LlamaBloomGptneoxStarcoder

Embeddings Wrapper of LangChain

Hugging Face transformers AutoModel

Native Model

For llama/bloom/gptneox/starcoder model families, you could also use the following wrappers.

LlamaBloomGptneoxStarcoder