> ## Documentation Index
> Fetch the complete documentation index at: https://koreai.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Custom LLM Model in GenAI

The Disposition Summary (end-of-conversation summary) in Agent AI is auto-generated using a GenAI model. By default, the **OOTB Kore Summarization** model is used. You can configure your own model by creating a **Custom LLM** and selecting it for conversation summaries.

***

## Create a Custom LLM

1. Sign in to **AI for Service**.

2. Go to **Agent AI** > **Generative AI Tools** from the left navigation.

3. Select **Models Library** > **New Model** > **Custom Integration**.

   ![New Model](https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/new-model-1.png?fit=max\&auto=format\&n=WVamVF5cb5NyLVNj\&q=85\&s=d8948dac6643f15aee08f446d7adbc46)

4. Select **Configurations** on the Custom Integration page.

   ![Configurations](https://mintcdn.com/koreai/tihOjy93yEv5YdgF/ai-for-service/agentai/configuration/custom-llm-genai/configurations-2.png?fit=max\&auto=format\&n=tihOjy93yEv5YdgF\&q=85\&s=e7575b3deb8b80d7769bca64ec6bf5b9)

5. Enter the following details:

   | Field | Description |
   | - | - |
   | **Integration Name** | A name identifying the provider or LLM Models group. |
   | **Model Name** | The LLM name for this integration. Multiple models can use the same endpoint. |
   | **Endpoint (POST)** | The URL to connect to the LLM via API requests. |

6. Select **Headers** and enter the key-value credentials:
   * **Key**: For example, `api-key`.
   * **Value**: For example, `3d4f1cOdxxxxxxxxxxxxxxx`.

7. Select the **LLM and Generative Policy guidelines** checkbox.

8. Select **Next**.

   ![Configuration Details Next](https://mintcdn.com/koreai/tihOjy93yEv5YdgF/ai-for-service/agentai/configuration/custom-llm-genai/configuration-details-next-3.png?fit=max\&auto=format\&n=tihOjy93yEv5YdgF\&q=85\&s=bbb5bb8ac4d087c202af4933f3e00cb2)

9. Enter a JSON request body (model, prompt, or other parameters) and select **Test**.

   ![Request Prompt Test](https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/request-prompt-test-4.png?fit=max\&auto=format\&n=WVamVF5cb5NyLVNj\&q=85\&s=6f49e04f20ab2a2242f3ec37c704274c)

10. Select **Save**.

    ![Connection Save](https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/connection-save-5.png?fit=max\&auto=format\&n=WVamVF5cb5NyLVNj\&q=85\&s=34708ebbbfef987901038f53a87949ae)

11. Select **Create a Custom Prompt**.

    ![Create a Custom Prompt](https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/create-a-custom-prompt-6.png?fit=max\&auto=format\&n=WVamVF5cb5NyLVNj\&q=85\&s=e7bee215f6729520ce7beafcf510b6da)

12. On the **Conversation Summary** page, fill in the following:

    | Field | Description |
    | - | - |
    | **Name** | A name for the prompt. For example, *Summary Prompt*. |
    | **Feature** | Select **Conversation Summary**. |
    | **Choose Model** | Select the custom model you created. For example, *Custom test mode - gpt-4o*. |
    | **JSON** | Enter your JSON content. |

    ![Conversation Summary Page](https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/conversation-summary-page-7.png?fit=max\&auto=format\&n=WVamVF5cb5NyLVNj\&q=85\&s=d9b14ad8178b0ced20628d4adcfd470a)

    1. Select **Test**.
    2. Enter the response path in **Text Response Path**. For example, `choices[0].message.content`.
    3. Select **Lookup Path**. The summary is generated.
    4. Select **Save**.

    ![Lookup Path Save](https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/lookup-path-save-8.png?fit=max\&auto=format\&n=WVamVF5cb5NyLVNj\&q=85\&s=d5f0cb34b09b538a008fbfc9cd77cd54)

***

## Select the Custom Model

1. Sign in to **AI for Service**.
2. Go to **Agent AI** > **Generative AI Tools** > **GenAI Features**.
3. Search for `conversation summary` in the search box.
4. Select your model and prompt from the **MODEL** and **PROMPT** dropdowns.

   ![GenAI Features Model Selection](https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/genai-features-model-selection-9.png?fit=max\&auto=format\&n=WVamVF5cb5NyLVNj\&q=85\&s=c8d2cee7ba73b3880d6c7a87d21940f2)

***


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.