> ## Documentation Index
> Fetch the complete documentation index at: https://koreai-ai-for-work-dev.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Custom LLM Model in GenAI

The Disposition Summary (end-of-conversation summary) in Agent AI is auto-generated using a GenAI model. By default, the **OOTB Kore Summarization** model is used. You can configure your own model by creating a **Custom LLM** and selecting it for conversation summaries.

***

## Create a Custom LLM

1. Sign in to **AI for Service**.

2. Go to **Agent AI** > **Generative AI Tools** from the left navigation.

3. Select **Models Library** > **New Model** > **Custom Integration**.

   <img src="https://mintcdn.com/koreai-ai-for-work-dev/VKQOtD2DtJ8AqEcL/ai-for-service/agentai/configuration/custom-llm-genai/new-model-1.png?fit=max&auto=format&n=VKQOtD2DtJ8AqEcL&q=85&s=4aa9abd4ef78dfa9977f73ef1a0532c4" alt="New Model" width="1895" height="383" data-path="ai-for-service/agentai/configuration/custom-llm-genai/new-model-1.png" />

4. Select **Configurations** on the Custom Integration page.

   <img src="https://mintcdn.com/koreai-ai-for-work-dev/ogfmF_WtYdJANlvz/ai-for-service/agentai/configuration/custom-llm-genai/configurations-2.png?fit=max&auto=format&n=ogfmF_WtYdJANlvz&q=85&s=aeb53b7833008599adaea73a9707328c" alt="Configurations" width="695" height="882" data-path="ai-for-service/agentai/configuration/custom-llm-genai/configurations-2.png" />

5. Enter the following details:

   | Field                | Description                                                                   |
   | -------------------- | ----------------------------------------------------------------------------- |
   | **Integration Name** | A name identifying the provider or LLM Models group.                          |
   | **Model Name**       | The LLM name for this integration. Multiple models can use the same endpoint. |
   | **Endpoint (POST)**  | The URL to connect to the LLM via API requests.                               |

6. Select **Headers** and enter the key-value credentials:
   * **Key**: For example, `api-key`.
   * **Value**: For example, `3d4f1cOdxxxxxxxxxxxxxxx`.

7. Select the **LLM and Generative Policy guidelines** checkbox.

8. Select **Next**.

   <img src="https://mintcdn.com/koreai-ai-for-work-dev/ogfmF_WtYdJANlvz/ai-for-service/agentai/configuration/custom-llm-genai/configuration-details-next-3.png?fit=max&auto=format&n=ogfmF_WtYdJANlvz&q=85&s=77f2a6918f42e4e75d0f2e0051820f2c" alt="Configuration Details Next" width="710" height="882" data-path="ai-for-service/agentai/configuration/custom-llm-genai/configuration-details-next-3.png" />

9. Enter a JSON request body (model, prompt, or other parameters) and select **Test**.

   <img src="https://mintcdn.com/koreai-ai-for-work-dev/VKQOtD2DtJ8AqEcL/ai-for-service/agentai/configuration/custom-llm-genai/request-prompt-test-4.png?fit=max&auto=format&n=VKQOtD2DtJ8AqEcL&q=85&s=1b8a3753f5aa144d9908f183f5ff5477" alt="Request Prompt Test" width="933" height="697" data-path="ai-for-service/agentai/configuration/custom-llm-genai/request-prompt-test-4.png" />

10. Select **Save**.

    <img src="https://mintcdn.com/koreai-ai-for-work-dev/VKQOtD2DtJ8AqEcL/ai-for-service/agentai/configuration/custom-llm-genai/connection-save-5.png?fit=max&auto=format&n=VKQOtD2DtJ8AqEcL&q=85&s=1891d1cd00badd951fba629287509940" alt="Connection Save" width="615" height="604" data-path="ai-for-service/agentai/configuration/custom-llm-genai/connection-save-5.png" />

11. Select **Create a Custom Prompt**.

    <img src="https://mintcdn.com/koreai-ai-for-work-dev/VKQOtD2DtJ8AqEcL/ai-for-service/agentai/configuration/custom-llm-genai/create-a-custom-prompt-6.png?fit=max&auto=format&n=VKQOtD2DtJ8AqEcL&q=85&s=decb96fa4275560bd5924fc9b8ac2e4b" alt="Create a Custom Prompt" width="609" height="389" data-path="ai-for-service/agentai/configuration/custom-llm-genai/create-a-custom-prompt-6.png" />

12. On the **Conversation Summary** page, fill in the following:

    | Field            | Description                                                                    |
    | ---------------- | ------------------------------------------------------------------------------ |
    | **Name**         | A name for the prompt. For example, *Summary Prompt*.                          |
    | **Feature**      | Select **Conversation Summary**.                                               |
    | **Choose Model** | Select the custom model you created. For example, *Custom test mode - gpt-4o*. |
    | **JSON**         | Enter your JSON content.                                                       |

    <img src="https://mintcdn.com/koreai-ai-for-work-dev/VKQOtD2DtJ8AqEcL/ai-for-service/agentai/configuration/custom-llm-genai/conversation-summary-page-7.png?fit=max&auto=format&n=VKQOtD2DtJ8AqEcL&q=85&s=db12440346744d9451638f1cf6a772ac" alt="Conversation Summary Page" width="1851" height="2075" data-path="ai-for-service/agentai/configuration/custom-llm-genai/conversation-summary-page-7.png" />

    1. Select **Test**.
    2. Enter the response path in **Text Response Path**. For example, `choices[0].message.content`.
    3. Select **Lookup Path**. The summary is generated.
    4. Select **Save**.

    <img src="https://mintcdn.com/koreai-ai-for-work-dev/VKQOtD2DtJ8AqEcL/ai-for-service/agentai/configuration/custom-llm-genai/lookup-path-save-8.png?fit=max&auto=format&n=VKQOtD2DtJ8AqEcL&q=85&s=cca36c1463fb4a85fa3ff66c95e2e5bd" alt="Lookup Path Save" width="995" height="500" data-path="ai-for-service/agentai/configuration/custom-llm-genai/lookup-path-save-8.png" />

***

## Select the Custom Model

1. Sign in to **AI for Service**.
2. Go to **Agent AI** > **Generative AI Tools** > **GenAI Features**.
3. Search for `conversation summary` in the search box.
4. Select your model and prompt from the **MODEL** and **PROMPT** dropdowns.

   <img src="https://mintcdn.com/koreai-ai-for-work-dev/VKQOtD2DtJ8AqEcL/ai-for-service/agentai/configuration/custom-llm-genai/genai-features-model-selection-9.png?fit=max&auto=format&n=VKQOtD2DtJ8AqEcL&q=85&s=b2a31213d5c72dbf39891ad6242888bb" alt="GenAI Features Model Selection" width="1006" height="227" data-path="ai-for-service/agentai/configuration/custom-llm-genai/genai-features-model-selection-9.png" />

***
