content-compliance-by-default-the-fetch-server-obeys-robots-txt-for-t-1e461761

THEN If you need to bypass robots.txt restrictions for legitimate purposes (e.g., testing), add the --ignore-robots-txt argument to the server configuration. Note: use with caution as it may violate site policies.

```json
{
  "mcpServers": {
    "fetch": {
      "command": "uvx",
      "args": ["mcp-server-fetch", "--ignore-robots-txt"]
    }
  }
}
```