> For the complete documentation index, see [llms.txt](https://learn-with-nathan.gitbook.io/learnwithnathan/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://learn-with-nathan.gitbook.io/learnwithnathan/ai-concepts/latency.md).

# Latency

Latency is the time taken by the AI to process a request and generate a response.

**Detailed Explanation:**

* **Factors:** Model size, server load, and network speed affect latency.
* **Trade-off:** Larger models with higher accuracy often have longer response times.
* **Optimization:** Smaller models or caching frequent queries can reduce latency.

**Example:**\
A delay of 5 seconds might occur when querying a large model like GPT-4 for detailed outputs.