LlamaIndex

Custom llm

LlamaIndex

API Reference
Agent
Callbacks
Chat engines
Embeddings
Evaluation
Extractors
Graph rag
Indices
Ingestion
Instrumentation
Llms
Llms
- Ai21
- Aibadgr
- Alephalpha
- Alibabacloud aisearch
- Anthropic
- Anyscale
- Apertis
- Asi
- Azure inference
- Azure openai
- Baseten
- Bedrock
- Bedrock converse
- Cerebras
- Clarifai
- Cleanlab
- Cloudflare ai gateway
- Cohere
- Cometapi
- Contextual
- Cortex
- Custom llm
- Dashscope
- Databricks
- Deepinfra
- Deepseek
- Everlyai
- Featherlessai
- Fireworks
- Friendli
- Gaudi
- Gigachat
- Google genai
- Groq
- Helicone
- Heroku
- Huggingface
- Huggingface api
- Ibm
- Keywordsai
- Konko
- Langchain
- Litellm
- Llama api
- Llama cpp
- Llamafile
- Lmstudio
- Localai
- Maritalk
- Meta
- Minimax
- Mistral rs
- Mistralai
- Mlx
- Modelscope
- Modelslab
- Monsterapi
- Mymagic
- Nebius
- Netmind
- Neutrino
- Novita
- Nvidia
- Nvidia tensorrt
- Nvidia triton
- Oci data science
- Oci genai
- Octoai
- Ollama
- Opea
- Openai
- Openai like
- Openrouter
- Openvino
- Openvino genai
- Ovhcloud
- Paieas
- Perplexity
- Pipeshift
- Portkey
- Predibase
- Premai
- Qianfan
- Reka
- Replicate
- Rungpt
- Sagemaker endpoint
- Sambanovasystems
- Sarvam
- Servam
- Sglang
- Siliconflow
- Stepfun
- Together
- Upstage
- Vercel ai gateway
- Vertex
- Vllm
- Xinference
- Yi
- You
- Zhipuai
Memory
Node parser
Node parsers
Objects
Observability
Output parsers
Postprocessor
Program
Prompts
Protocols
Query engine
Question gen
Readers
Response synthesizers
Retrievers
Schema
Selectors
Sparse embeddings
Storage
Tools
Voice agents

Custom llm

::: llama_index.core.llms.custom.CustomLLM