performance-concurrent-crawling-need-to-scrape-many-pages-concurrently-with-pause--6fc4c1f7

THEN Implement a Spider class with `start_urls` and an async `parse` method, then start the spider. Scrapling handles concurrent sessions, pause/resume, and automatic proxy rotation.

from scrapling.spiders import Spider, Response
class MySpider(Spider):
  name = "demo"
  start_urls = ["https://example.com/"]
  async def parse(self, response: Response):
      for item in response.css('.product'):
          yield {"title": item.css('h2::text').get()}
MySpider().start()