Passthrough LLM API endpoint

This section describes how to use the Prompt Passthrough endpoints in the GenAI application.

As part of the GenAI service, the Passthrough LLM API provides direct access to selected large language models. Before accessing the Passthrough endpoints, ensure you are assigned the following security role:

IONAPI-Admin

You can access the Passthrough LLM API by navigating to API Gateway > APIs > GenAI Suite > GENAI/chatsvc Endpoint . These values are displayed:

/api/v1/prompt for a single prompt to be submitted to the LLM.
/api/v1/models for a list that provides details on all supported LLMs in the GenAI Assistant.