# Inferencing

Pegasus APIs for Inferencing.

## OpenAI-compatible chat completions endpoint

 - [POST /inferencing/openai/v1/chat/completions](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/chat_completions_openai_v1_chat_completions_post.md): Creates a response for the given chat conversation.

## OpenAI-compatible embeddings endpoint

 - [POST /inferencing/openai/v1/embeddings](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/create_embeddings_openai_v1_embeddings_post.md): Creates an embedding vector for the input text.

## OpenAI-compatible models endpoint

 - [GET /inferencing/openai/v1/models](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/list_models_openai_v1_models_get.md): Lists available LLMs, VLMs and embedders for inference.

## Ranker endpoint

 - [POST /inferencing/uniphore/v1/ranker](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/ranker_uniphore_v1_ranker_post.md): Order documents based on their relevance to the query.

## Nemoguard Jailbreak Detect endpoint

 - [POST /inferencing/uniphore/v1/nemoguard-jailbreak-detect](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/nemoguard_jailbreak_detect_uniphore_v1_nemoguard_jailbreak_detect_post.md): Detect attempts to jailbreak LLMs.

## Show available models

 - [GET /inferencing/uniphore/v1/models](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/list_models_uniphore_v1_models_get.md): List all available models.

## Show available setups

 - [GET /inferencing/uniphore/v1/setups](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/list_setups_uniphore_v1_setups_get.md): List all setups for a specific model.

## Show available LLMs

 - [GET /inferencing/uniphore/v1/models/llms](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/list_llms_uniphore_v1_models_llms_get.md): List all available LLMs.

## Show available VLMs

 - [GET /inferencing/uniphore/v1/models/vlms](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/list_vlms_uniphore_v1_models_vlms_get.md): List all available VLMs.

## Show available embedders

 - [GET /inferencing/uniphore/v1/models/embedders](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/list_embedders_uniphore_v1_models_embedders_get.md): List all available embedders.

## Show available rankers

 - [GET /inferencing/uniphore/v1/models/rankers](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/list_rankers_uniphore_v1_models_rankers_get.md): List all available rankers.

## Show available guardrails

 - [GET /inferencing/uniphore/v1/models/guardrails](https://docs.businessai.uniphorecloud.com/api-reference/api/inferencing/list_guardrails_uniphore_v1_models_guardrails_get.md): List all available guardrails (subtype == 'guardrail').