content-web-scraping-the-fetch-tool-truncates-response-to-a-max-length--a8d61137

THEN Use the start_index parameter to fetch content in chunks. After each fetch, if the target information is not found, increment start_index by the previous max_length and re-fetch. Continue until the information is found or the end of document is reached.

```python
index = 0
while True:
    response = call_tool('fetch', url=url, max_length=5000, start_index=index)
    process(response)
    if '<!-- end of document -->' in response:
        break
    index += 5000
```