> ## Documentation Index
> Fetch the complete documentation index at: https://relevanceai.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# How to handle too much text in a prompt

> Ways of managing too large context when working with LLMs

LLMs have a limit on the context size they can take as input.
Relevance has provided you with great features to help you manage context size and prevent facing run-time error.

## Handling large content

In an LLM component and under "Advanced options", you can see a section for `How to handle too much content`.
All variables that are included in the prompt should be listed in this section with an `Edit` button in the front.

<img src="https://mintcdn.com/relevanceai/c92n16pLC3iTZmPg/images/build-custom-tools/tool-step/llm-adv.png?fit=max&auto=format&n=c92n16pLC3iTZmPg&q=85&s=f2474058e07c6ce204d91cb0cefe937b" alt="LLM step" width="1894" height="2036" data-path="images/build-custom-tools/tool-step/llm-adv.png" />

Small contents can be fed to LLMs directly but for large contents such as a Knowledge, Relevance provide you with two
options:

* Summarize the content
* Select the most relevant content to the query/goal (Vector search)

Clicking on `Edit`, you will access the options.

<Frame caption="Screenshot of the modal on how to handle too much text">
  <img src="https://mintcdn.com/relevanceai/c92n16pLC3iTZmPg/images/build-custom-tools/tool-step/how-to-handle-large-content.png?fit=max&auto=format&n=c92n16pLC3iTZmPg&q=85&s=3e4fe38243c3102b6dce2765dd4fd99d" width="1346" height="1008" data-path="images/build-custom-tools/tool-step/how-to-handle-large-content.png" />
</Frame>

### Summarize

This option reads the provided content and produce a summary.
Under advanced setting you can provide a prompt for better and more guided summarization.
For example you can note the objective or goal of the analysis.
You can also specify the large language model you wish to use for summarization.

<img src="https://mintcdn.com/relevanceai/c92n16pLC3iTZmPg/images/build-custom-tools/tool-step/how-to-handle-large-content-summary.png?fit=max&auto=format&n=c92n16pLC3iTZmPg&q=85&s=d4db0aa580fc7b966179adb8ca1bf5df" alt="LLM step" width="1472" height="1540" data-path="images/build-custom-tools/tool-step/how-to-handle-large-content-summary.png" />

### Most relevant data

This option will run a semantic search through the data to extract the most relevant parts to
the provided query.

<img src="https://mintcdn.com/relevanceai/c92n16pLC3iTZmPg/images/build-custom-tools/tool-step/how-to-handle-large-content-most-relevant.png?fit=max&auto=format&n=c92n16pLC3iTZmPg&q=85&s=be047976cb0fba2a3daf2463273a43b0" alt="LLM step" width="1326" height="1564" data-path="images/build-custom-tools/tool-step/how-to-handle-large-content-most-relevant.png" />

There are some useful advances options:

* **Query**:
  By default, we extract the query from the original prompt. However, it is highly recommended to
  set a custom value for the search query. You can type in a query or use `{{}}` to include a variable,
  for example `{{ question }}` or `{{ search_query }}`.

* **Query type**: You can select between vector and keyword search

* **Columns**
  By default, all columns from the row of data are included in the results. However, you can
  specify a subset of columns in order to exclude unnecessary data.

* **Page\_size**
  This parameter indicates the number of matching entries to be fetched as the search results. It is set to 100 by default.

### Full

This option will return the entire content (e.g. the whole knowledge base).
Note that too large content can cause run-time error and this option is not recommended when
working with large data.