> ## Documentation Index
> Fetch the complete documentation index at: https://portkey-docs-chore-bedrock-service-tier-support.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Portkey connects with all major LLM providers and orchestration frameworks.

## Supported AI Providers

<CardGroup cols={3}>
  <Card title="OpenAI" href="/integrations/llms/openai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/open-ai.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=97fe941a4c1f61155e5119ae9dc188ff" alt="OpenAI" width="245" height="138" data-path="images/supported-llm/open-ai.avif" />
    </Frame>
  </Card>

  <Card title="Anthropic" href="/integrations/llms/anthropic">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/l1jPbRNiL-6ch0TY/images/supported-llm/anthroic.avif?fit=max&auto=format&n=l1jPbRNiL-6ch0TY&q=85&s=aa8cb0c4919ff3bd0c02e3fb59a1add6" alt="Anthropic" width="245" height="138" data-path="images/supported-llm/anthroic.avif" />
    </Frame>
  </Card>

  <Card title="Azure OpenAI" href="/integrations/llms/azure-openai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/microsoft-assure.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=dc7db8b6429d9cfadba236d1c1fd9f00" alt="Azure OpenAI" width="245" height="138" data-path="images/supported-llm/microsoft-assure.avif" />
    </Frame>
  </Card>

  <Card title="AWS Bedrock" href="/integrations/llms/aws-bedrock">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/l1jPbRNiL-6ch0TY/images/supported-llm/amazon.avif?fit=max&auto=format&n=l1jPbRNiL-6ch0TY&q=85&s=5a5b7cdffc1db9e4207262a14c170b82" alt="AWS Bedrock" width="245" height="138" data-path="images/supported-llm/amazon.avif" />
    </Frame>
  </Card>

  <Card title="Cerebras" href="/integrations/llms/cerebras">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/aYI2r76zHyIV4KjW/images/llms/cerebras.avif?fit=max&auto=format&n=aYI2r76zHyIV4KjW&q=85&s=671fedc39ca0597f8c68041d818e43db" alt="Cerebras" width="770" height="480" data-path="images/llms/cerebras.avif" />
    </Frame>
  </Card>

  <Card title="Google Gemini" href="/integrations/llms/gemini">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/google-gemini.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=f4ab28d1b43ee6ba636fb0835c2d254d" alt="Google Gemini" width="245" height="138" data-path="images/supported-llm/google-gemini.avif" />
    </Frame>
  </Card>

  <Card title="Vertex AI" href="/integrations/llms/vertex-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/vertex-ai.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=4e0e8933bd56a40b20e55cfabc122c0f" alt="Vertex AI" width="245" height="138" data-path="images/supported-llm/vertex-ai.avif" />
    </Frame>
  </Card>

  <Card title="Cohere" href="/integrations/llms/cohere">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/cohere.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=043adb4e2f6a2a9be4b84713c4548a23" alt="Cohere" width="245" height="138" data-path="images/supported-llm/cohere.avif" />
    </Frame>
  </Card>

  <Card title="Perplexity AI" href="/integrations/llms/perplexity-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/perplexity-ai.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=715500a870d84167b732b27d9f2b67d1" alt="Perplexity AI" width="245" height="138" data-path="images/supported-llm/perplexity-ai.avif" />
    </Frame>
  </Card>

  <Card title="AI21" href="/integrations/llms/ai21">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/l1jPbRNiL-6ch0TY/images/supported-llm/ai21.avif?fit=max&auto=format&n=l1jPbRNiL-6ch0TY&q=85&s=f4851a6365e682a5a0d0407ceb6c98ef" alt="AI21" width="245" height="138" data-path="images/supported-llm/ai21.avif" />
    </Frame>
  </Card>

  <Card title="Anyscale" href="/integrations/llms/anyscale-llama2-mistral-zephyr">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/l1jPbRNiL-6ch0TY/images/supported-llm/anyscale.avif?fit=max&auto=format&n=l1jPbRNiL-6ch0TY&q=85&s=5f21d72a3f7049d5dae51f1464c9bc2e" alt="Anyscale" width="245" height="138" data-path="images/supported-llm/anyscale.avif" />
    </Frame>
  </Card>

  <Card title="Byollm" href="/integrations/llms/byollm" />

  <Card title="Dashscope" href="/integrations/llms/dashscope">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/dashscope.jpeg?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=d70f18c6355f5ff39f303cef76b01d60" alt="Dashscope" width="128" height="128" data-path="images/supported-llm/dashscope.jpeg" />
    </Frame>
  </Card>

  <Card title="Deepbricks" href="/integrations/llms/deepbricks">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/deepbricks.jpeg?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=5904a1d2fd009b8180c88e2b6ec85370" alt="Deepbricks" width="225" height="225" data-path="images/supported-llm/deepbricks.jpeg" />
    </Frame>
  </Card>

  <Card title="DeepInfra" href="/integrations/llms/deepinfra">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/deepinfa.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=bd92b431f7f21026c72754f0cebfca8e" alt="DeepInfra" width="245" height="138" data-path="images/supported-llm/deepinfa.avif" />
    </Frame>
  </Card>

  <Card title="DeepSeek" href="/integrations/llms/deepseek">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/deepseek.webp?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=746dccd5fbd5ad59043009a357f1df81" alt="DeepSeek" width="780" height="165" data-path="images/supported-llm/deepseek.webp" />
    </Frame>
  </Card>

  <Card title="Fireworks AI" href="/integrations/llms/fireworks">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/fireworks.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=d0b70d1e27dfe4984c5a80161175f99d" alt="Fireworks AI" width="240" height="136" data-path="images/supported-llm/fireworks.png" />
    </Frame>
  </Card>

  <Card title="Featherless AI" href="/integrations/llms/featherless">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/featherless.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=dc3801ebcd9c32620687bb636379a7b0" alt="featherless-AI" width="225" height="225" data-path="images/supported-llm/featherless.png" />
    </Frame>
  </Card>

  <Card title="Github Models" href="/integrations/llms/github">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/aYI2r76zHyIV4KjW/images/llms/github.png?fit=max&auto=format&n=aYI2r76zHyIV4KjW&q=85&s=8f08310404a0b05d4aaedd9c0424489b" alt="Github" width="954" height="482" data-path="images/llms/github.png" />
    </Frame>
  </Card>

  <Card title="Google Palm" href="/integrations/llms/google-palm">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/google-palm.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=29b8ea7df5899c94f7788edbeb09d838" alt="Google Palm" width="245" height="138" data-path="images/supported-llm/google-palm.avif" />
    </Frame>
  </Card>

  <Card title="Groq" href="/integrations/llms/groq">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/groq.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=784123ff46702f1f63cbe61041baf3fe" alt="Groq" width="245" height="138" data-path="images/supported-llm/groq.avif" />
    </Frame>
  </Card>

  <Card title="Jina AI" href="/integrations/llms/jina-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/jina.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=cc446aa3cb9121568bdbee47fe0a889f" alt="Jina AI" width="225" height="225" data-path="images/supported-llm/jina.png" />
    </Frame>
  </Card>

  <Card title="Lambda" href="/integrations/llms/lambda">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/lambda.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=71b75ccd3da5168b5e5e49e6706b3ed1" alt="Lambda" width="225" height="225" data-path="images/supported-llm/lambda.png" />
    </Frame>
  </Card>

  <Card title="Lemonfox AI" href="/integrations/llms/lemon-fox">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/lemonfox-ai.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=9e108a8348ce63895e06c7caef32bfd7" alt="Lemonfox AI" width="225" height="225" data-path="images/supported-llm/lemonfox-ai.png" />
    </Frame>
  </Card>

  <Card title="Lepton AI" href="/integrations/llms/lepton">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/lepton.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=d1079122900817aaaa9d5bb02a92752a" alt="Lepton AI" width="311" height="85" data-path="images/supported-llm/lepton.png" />
    </Frame>
  </Card>

  <Card title="Lingyi (01.ai)" href="/integrations/llms/lingyi-01.ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/lingyi.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=0e5576b9ec15cacb2a5274de2c368087" alt="Lingyi (01.ai)" width="200" height="200" data-path="images/supported-llm/lingyi.png" />
    </Frame>
  </Card>

  <Card title="LocalAI" href="/integrations/llms/local-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/local.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=fcc1c3e82c75dd83a9b57e6bc3191168" alt="LocalAI" width="245" height="132" data-path="images/supported-llm/local.avif" />
    </Frame>
  </Card>

  <Card title="Mistral AI" href="/integrations/llms/mistral-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/mistral.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=90cd36a423d0ee0bb080bd5d30911d28" alt="Mistral AI" width="245" height="138" data-path="images/supported-llm/mistral.avif" />
    </Frame>
  </Card>

  <Card title="MonsterAPI" href="/integrations/llms/monster-api">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/monster.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=72ecbea5ba87c2e1fb49aff9cd05c6de" alt="MonsterAPI" width="245" height="138" data-path="images/supported-llm/monster.avif" />
    </Frame>
  </Card>

  <Card title="Moonshot" href="/integrations/llms/moonshot">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/moonshoot.jpg?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=55343b4ce0216f7b550f721d171d2355" alt="Moonshot" width="224" height="224" data-path="images/supported-llm/moonshoot.jpg" />
    </Frame>
  </Card>

  <Card title="nCompass" href="/integrations/llms/ncompass">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/aYI2r76zHyIV4KjW/images/llms/ncompass.jpeg?fit=max&auto=format&n=aYI2r76zHyIV4KjW&q=85&s=cae660f70d14ca44f7716225817a5401" alt="nCompass" width="200" height="200" data-path="images/llms/ncompass.jpeg" />
    </Frame>
  </Card>

  <Card title="Nebius" href="/integrations/llms/nebius">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/nebius.jpeg?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=cdf3b64fa16f88a3a4a927fea51ffb42" alt="Nebius" width="200" height="200" data-path="images/supported-llm/nebius.jpeg" />
    </Frame>
  </Card>

  <Card title="Nomic AI" href="/integrations/llms/nomic">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/nomic.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=4db6f4c5642910ebe20b189f6f0f11bf" alt="Nomic AI" width="245" height="138" data-path="images/supported-llm/nomic.avif" />
    </Frame>
  </Card>

  <Card title="Nscale" href="/integrations/llms/nscale">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/nscale.jpeg?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=5a72aadddd970b6b4f5891041c43e252" alt="Nscale" width="259" height="194" data-path="images/supported-llm/nscale.jpeg" />
    </Frame>
  </Card>

  <Card title="Ollama" href="/integrations/llms/ollama">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/ollama.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=8eba8fd64d1e956410837055a3468584" alt="Ollama" width="245" height="138" data-path="images/supported-llm/ollama.avif" />
    </Frame>
  </Card>

  <Card title="Openrouter" href="/integrations/llms/openrouter">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/openrouter.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=581423820263224a9a5fba7b59ba8afe" alt="Openrouter" width="224" height="224" data-path="images/supported-llm/openrouter.png" />
    </Frame>
  </Card>

  <Card title="Predibase" href="/integrations/llms/predibase">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/predise.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=edc7b08051476852129e142283e4fdd2" alt="Predibase" width="245" height="132" data-path="images/supported-llm/predise.avif" />
    </Frame>
  </Card>

  <Card title="Recraft AI" href="/integrations/llms/recraft-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/aYI2r76zHyIV4KjW/images/llms/recraft.jpeg?fit=max&auto=format&n=aYI2r76zHyIV4KjW&q=85&s=7ae5f0dfd31f1789756e31af33429f8b" alt="Recraft" width="200" height="200" data-path="images/llms/recraft.jpeg" />
    </Frame>
  </Card>

  <Card title="Siliconflow" href="/integrations/llms/siliconflow">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/siliconflow.jpeg?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=353edd31f10bbf1f1da6fe4a81fc4364" alt="Siliconflow" width="200" height="200" data-path="images/supported-llm/siliconflow.jpeg" />
    </Frame>
  </Card>

  <Card title="Snowflake Cortex" href="/integrations/llms/snowflake-cortex">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/aYI2r76zHyIV4KjW/images/llms/Snowflake%20Cortex%20Logo.png?fit=max&auto=format&n=aYI2r76zHyIV4KjW&q=85&s=f11e5d6e8a0c572dab31b5fedfecf720" alt="Snowflake" width="225" height="225" data-path="images/llms/Snowflake Cortex Logo.png" />
    </Frame>
  </Card>

  <Card title="Stability AI" href="/integrations/llms/stability-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/stability.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=8a90f6380da12bf0ede6c4f5de6dd134" alt="Stability AI" width="245" height="138" data-path="images/supported-llm/stability.avif" />
    </Frame>
  </Card>

  <Card title="Together AI" href="/integrations/llms/together-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/together-ai.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=070cfa0dcb67cc66c8989e79f29b2821" alt="Together AI" width="245" height="138" data-path="images/supported-llm/together-ai.avif" />
    </Frame>
  </Card>

  <Card title="Triton" href="/integrations/llms/triton">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/triton.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=a7c0f7566ac1170dbff059ba9b3da2cc" alt="Triton" width="254" height="198" data-path="images/supported-llm/triton.png" />
    </Frame>
  </Card>

  <Card title="Upstage" href="/integrations/llms/upstage">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/upstage.jpeg?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=1e2c058042d2bddff526bce74a217ee4" alt="Upstage" width="200" height="200" data-path="images/supported-llm/upstage.jpeg" />
    </Frame>
  </Card>

  <Card title="Voyage-AI" href="/integrations/llms/voyage-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/voyage.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=acdf15ed16671318fafce59534f96a23" alt="Voyage-AI" width="314" height="160" data-path="images/supported-llm/voyage.png" />
    </Frame>
  </Card>

  <Card title="Workers AI" href="/integrations/llms/workers-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/worksai.jpg?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=74251a9e7a740447f5f21048eea809d5" alt="Workers AI" width="225" height="225" data-path="images/supported-llm/worksai.jpg" />
    </Frame>
  </Card>

  <Card title="ZhipuAI" href="/integrations/llms/zhipu">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/zhipu.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=efb513ce9f386e4f17ff59406dc311f3" alt="ZhipuAI" width="245" height="132" data-path="images/supported-llm/zhipu.avif" />
    </Frame>
  </Card>

  <Card title="Z AI" href="/integrations/llms/z-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/z-ai.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=e705bb72049a03bed4cb1ff65fc9eebd" alt="Z-AI" width="250" height="250" data-path="images/supported-llm/z-ai.png" />
    </Frame>
  </Card>
</CardGroup>

## Endpoints Supported

For a detailed breakdown of supported endpoints and features per provider, refer to the table below:

<Card title="Supported Providers" href="/provider-endpoints/supported-providers" />

## Supported Frameworks

Portkey has native integrations with the following frameworks. Click to read their getting started guides.

<CardGroup cols={3}>
  <Card title="Langchain" href="/integrations/libraries/langchain-python">
    <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/langchain.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=b40d024904f9e70a71a213851a48b327" alt="Langchain" width="245" height="138" data-path="images/supported-llm/langchain.avif" />
  </Card>

  <Card title="LlamaIndex" href="/integrations/libraries/llama-index-python">
    <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/llama.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=42b7e601ab78f134252f3548bc69ddff" alt="LlamaIndex" width="245" height="138" data-path="images/supported-llm/llama.avif" />
  </Card>

  <Card title="Autogen" href="/integrations/libraries/autogen">
    <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/l1jPbRNiL-6ch0TY/images/supported-llm/autogen.avif?fit=max&auto=format&n=l1jPbRNiL-6ch0TY&q=85&s=c30dc560aae1a0a95e94673ac9e8f878" alt="Autogen" width="245" height="138" data-path="images/supported-llm/autogen.avif" />
  </Card>

  <Card title="Vercel" href="/integrations/libraries/vercel">
    <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/vercel.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=10c007d94bde4b55bac196c0c2e2014d" alt="Vercel" width="245" height="132" data-path="images/supported-llm/vercel.avif" />
  </Card>

  <Card title="Instructor" href="/integrations/libraries/instructor">
    <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/instructor.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=5b7e8e495aaf2a40f8e9146f90626077" alt="Instructor" width="245" height="132" data-path="images/supported-llm/instructor.avif" />
  </Card>

  <Card title="DSPy" href="/integrations/libraries/dspy">
    <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/dspy.png?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=198bafad688f77fe170c30f213ac37af" alt="DSPy" width="300" height="168" data-path="images/supported-llm/dspy.png" />
  </Card>

  <Card title="Promptfoo" href="/integrations/libraries/promptfoo">
    <img src="https://mintcdn.com/portkey-docs-chore-bedrock-service-tier-support/6h1CRTKc-PKdQTUp/images/supported-llm/prompftoo.avif?fit=max&auto=format&n=6h1CRTKc-PKdQTUp&q=85&s=aa0bbfe864bd4f6e18e5c7612e384ea2" alt="Promptfoo" width="245" height="132" data-path="images/supported-llm/prompftoo.avif" />
  </Card>
</CardGroup>

Have a suggestion for an integration with Portkey? Tell us on [Discord](https://discord.gg/DD7vgKK299), or drop a message on [support@portkey.ai](mailto:support@portkey.ai).

While you're here, why not [give us a star](https://git.new/ai-gateway-docs)? It helps us a lot!