2024-10-07 18:51:44 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: catalog_extraction) 2024-10-07 18:51:44 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.10 (main, Sep 27 2024, 06:09:21) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-6.4.10-dirty-x86_64-with-glibc2.36 2024-10-07 18:51:44 [scrapy.addons] INFO: Enabled addons: [] 2024-10-07 18:51:44 [scrapy.extensions.telnet] INFO: Telnet Password: 2a77fa632ad2ea6c 2024-10-07 18:51:44 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.closespider.CloseSpider', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon'] 2024-10-07 18:51:44 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'catalog_extraction', 'CONCURRENT_ITEMS': 250, 'CONCURRENT_REQUESTS': 8, 'FEED_EXPORT_ENCODING': 'utf-8', 'HTTPPROXY_ENABLED': False, 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/webstaurant/2ebcafbc84dd11efa4fd4200a9fe0102.log', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'catalog_extraction.spiders', 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter', 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7', 'RETRY_TIMES': 5, 'SPIDER_MODULES': ['catalog_extraction.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor', 'USER_AGENT': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, ' 'like Gecko) Chrome/129.0.0.0 Safari/537.36'} 2024-10-07 18:51:45 [scrapy_poet.injection] INFO: Loading providers: [, , , , , , ] 2024-10-07 18:51:45 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy_poet.InjectionMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy_poet.DownloaderStatsMiddleware'] 2024-10-07 18:51:45 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy_poet.RetryMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2024-10-07 18:51:45 [scrapy.middleware] INFO: Enabled item pipelines: ['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline', 'scraping_utils.pipelines.AttachSupplierPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline'] 2024-10-07 18:51:45 [scrapy.core.engine] INFO: Spider opened 2024-10-07 18:51:45 [scrapy.extensions.closespider] INFO: Spider will stop when no items are produced after 1800 seconds. 2024-10-07 18:51:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 18:51:45 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2024-10-07 18:51:45 [scrapy-playwright] INFO: Starting download handler 2024-10-07 18:51:45 [scrapy-playwright] INFO: Starting download handler 2024-10-07 18:51:50 [webstaurant] WARNING: Using CDP Playwright 2024-10-07 18:51:50 [webstaurant] INFO: Batch query job with batch size 2000 and offset 10000 2024-10-07 18:51:52 [scrapy-playwright] INFO: Connecting using CDP: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222 2024-10-07 18:51:53 [scrapy-playwright] INFO: Connected using CDP: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222 2024-10-07 18:51:55 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Protocol error (Page.navigate): Missing Credentials (missing_credentials) Call log: navigating to "https://www.webstaurantstore.com/6-lb-imported-canned-corned-beef-case/871220001C.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: Page.goto: Protocol error (Page.navigate): Missing Credentials (missing_credentials) Call log: navigating to "https://www.webstaurantstore.com/6-lb-imported-canned-corned-beef-case/871220001C.html", waiting until "domcontentloaded" 2024-10-07 18:51:55 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Protocol error (Page.navigate): Missing Credentials (missing_credentials) Call log: navigating to "https://www.webstaurantstore.com/6-lb-imported-canned-corned-beef/999220001.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: Page.goto: Protocol error (Page.navigate): Missing Credentials (missing_credentials) Call log: navigating to "https://www.webstaurantstore.com/6-lb-imported-canned-corned-beef/999220001.html", waiting until "domcontentloaded" 2024-10-07 18:51:55 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Protocol error (Page.navigate): Missing Credentials (missing_credentials) Call log: navigating to "https://www.webstaurantstore.com/6-lb-iqf-bias-sliced-pre-fried-plantains-case/877WHI408279.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: Page.goto: Protocol error (Page.navigate): Missing Credentials (missing_credentials) Call log: navigating to "https://www.webstaurantstore.com/6-lb-iqf-bias-sliced-pre-fried-plantains-case/877WHI408279.html", waiting until "domcontentloaded" 2024-10-07 18:51:56 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: Page.goto: Protocol error (Page.navigate): Missing Credentials (missing_credentials) Call log: navigating to "https://www.webstaurantstore.com/6-lb-imported-canned-corned-beef-case/871220001C.html", waiting until "domcontentloaded" 2024-10-07 18:51:56 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: Page.goto: Protocol error (Page.navigate): Missing Credentials (missing_credentials) Call log: navigating to "https://www.webstaurantstore.com/6-lb-imported-canned-corned-beef/999220001.html", waiting until "domcontentloaded" 2024-10-07 18:51:56 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: Page.goto: Protocol error (Page.navigate): Missing Credentials (missing_credentials) Call log: navigating to "https://www.webstaurantstore.com/6-lb-iqf-bias-sliced-pre-fried-plantains-case/877WHI408279.html", waiting until "domcontentloaded" 2024-10-07 18:52:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 18:53:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lane-universal-pusher-glide-bottle-organizer-for-32-oz-to-1-liter-bottles-cans/1906LVF32OZ.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lane-universal-pusher-glide-bottle-organizer-for-32-oz-to-1-liter-bottles-cans/1906LVF32OZ.html", waiting until "domcontentloaded" 2024-10-07 18:53:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-brown-kraft-paper-cookie-coffee-donut-bag-with-window-case/4336LBCBKR.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-brown-kraft-paper-cookie-coffee-donut-bag-with-window-case/4336LBCBKR.html", waiting until "domcontentloaded" 2024-10-07 18:53:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-brown-kraft-paper-cookie-coffee-donut-bag-with-window-pack/9996LBCBKR.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-brown-kraft-paper-cookie-coffee-donut-bag-with-window-pack/9996LBCBKR.html", waiting until "domcontentloaded" 2024-10-07 18:53:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-natural-kraft-waxed-paper-bag-case/150206.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-natural-kraft-waxed-paper-bag-case/150206.html", waiting until "domcontentloaded" 2024-10-07 18:53:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-ivory-american-white-scalloped-edge-china-saucer-with-gold-band-case/303TSC2G.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-ivory-american-white-scalloped-edge-china-saucer-with-gold-band-case/303TSC2G.html", waiting until "domcontentloaded" 2024-10-07 18:53:25 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lane-universal-pusher-glide-bottle-organizer-for-32-oz-to-1-liter-bottles-cans/1906LVF32OZ.html", waiting until "domcontentloaded" 2024-10-07 18:53:26 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-brown-kraft-paper-cookie-coffee-donut-bag-with-window-case/4336LBCBKR.html", waiting until "domcontentloaded" 2024-10-07 18:53:26 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-brown-kraft-paper-cookie-coffee-donut-bag-with-window-pack/9996LBCBKR.html", waiting until "domcontentloaded" 2024-10-07 18:53:26 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-natural-kraft-waxed-paper-bag-case/150206.html", waiting until "domcontentloaded" 2024-10-07 18:53:26 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-ivory-american-white-scalloped-edge-china-saucer-with-gold-band-case/303TSC2G.html", waiting until "domcontentloaded" 2024-10-07 18:53:27 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-part-skim-milk-mozzarella-cheese-8-case/875RE100287.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-part-skim-milk-mozzarella-cheese-8-case/875RE100287.html", waiting until "domcontentloaded" 2024-10-07 18:53:27 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-waxed-paper-bag-case/150296.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-waxed-paper-bag-case/150296.html", waiting until "domcontentloaded" 2024-10-07 18:53:27 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-white-paper-cookie-coffee-donut-bag-with-window-case/4336LBCBWH.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-white-paper-cookie-coffee-donut-bag-with-window-case/4336LBCBWH.html", waiting until "domcontentloaded" 2024-10-07 18:53:28 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-part-skim-milk-mozzarella-cheese-8-case/875RE100287.html", waiting until "domcontentloaded" 2024-10-07 18:53:28 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-waxed-paper-bag-case/150296.html", waiting until "domcontentloaded" 2024-10-07 18:53:28 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-white-paper-cookie-coffee-donut-bag-with-window-case/4336LBCBWH.html", waiting until "domcontentloaded" 2024-10-07 18:53:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 18:54:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 18:54:58 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-white-paper-cookie-coffee-donut-bag-with-window-pack/9996LBCBWH.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-white-paper-cookie-coffee-donut-bag-with-window-pack/9996LBCBWH.html", waiting until "domcontentloaded" 2024-10-07 18:54:58 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-medium-weight-cornstarch-fork-case/130BDGFORKMED.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-medium-weight-cornstarch-fork-case/130BDGFORKMED.html", waiting until "domcontentloaded" 2024-10-07 18:54:58 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-atlantic-salmon-10-lb/872SLMATL6.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-atlantic-salmon-10-lb/872SLMATL6.html", waiting until "domcontentloaded" 2024-10-07 18:54:58 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-classic-polycarbonate-scoop/21110296.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-classic-polycarbonate-scoop/21110296.html", waiting until "domcontentloaded" 2024-10-07 18:54:58 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-clear-round-pet-jar-with-label-panel/500PJRL06.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-clear-round-pet-jar-with-label-panel/500PJRL06.html", waiting until "domcontentloaded" 2024-10-07 18:54:58 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-lb-white-paper-cookie-coffee-donut-bag-with-window-pack/9996LBCBWH.html", waiting until "domcontentloaded" 2024-10-07 18:54:58 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-medium-weight-cornstarch-fork-case/130BDGFORKMED.html", waiting until "domcontentloaded" 2024-10-07 18:54:58 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-atlantic-salmon-10-lb/872SLMATL6.html", waiting until "domcontentloaded" 2024-10-07 18:54:58 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-classic-polycarbonate-scoop/21110296.html", waiting until "domcontentloaded" 2024-10-07 18:54:58 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-clear-round-pet-jar-with-label-panel/500PJRL06.html", waiting until "domcontentloaded" 2024-10-07 18:54:59 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-blue-led-light-case/300BCR6BL.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-blue-led-light-case/300BCR6BL.html", waiting until "domcontentloaded" 2024-10-07 18:55:00 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-orange-led-light-case/300BCR6OG.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-orange-led-light-case/300BCR6OG.html", waiting until "domcontentloaded" 2024-10-07 18:55:00 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-green-led-light-case/300BCR6GR.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-green-led-light-case/300BCR6GR.html", waiting until "domcontentloaded" 2024-10-07 18:55:00 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-blue-led-light-case/300BCR6BL.html", waiting until "domcontentloaded" 2024-10-07 18:55:00 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-orange-led-light-case/300BCR6OG.html", waiting until "domcontentloaded" 2024-10-07 18:55:00 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-green-led-light-case/300BCR6GR.html", waiting until "domcontentloaded" 2024-10-07 18:55:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 18:56:30 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-pink-led-light-case/300BCR6PK.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-pink-led-light-case/300BCR6PK.html", waiting until "domcontentloaded" 2024-10-07 18:56:30 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-purple-led-light-case/300BCR6PL.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-purple-led-light-case/300BCR6PL.html", waiting until "domcontentloaded" 2024-10-07 18:56:30 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-red-led-light-case/300BCR6RD.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-red-led-light-case/300BCR6RD.html", waiting until "domcontentloaded" 2024-10-07 18:56:30 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-white-led-light-case/300BCR6.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-white-led-light-case/300BCR6.html", waiting until "domcontentloaded" 2024-10-07 18:56:30 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-yellow-led-light-case/300BCR6YW.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-yellow-led-light-case/300BCR6YW.html", waiting until "domcontentloaded" 2024-10-07 18:56:31 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-pink-led-light-case/300BCR6PK.html", waiting until "domcontentloaded" 2024-10-07 18:56:31 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-purple-led-light-case/300BCR6PL.html", waiting until "domcontentloaded" 2024-10-07 18:56:31 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-red-led-light-case/300BCR6RD.html", waiting until "domcontentloaded" 2024-10-07 18:56:31 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-white-led-light-case/300BCR6.html", waiting until "domcontentloaded" 2024-10-07 18:56:31 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-plastic-rocks-cup-with-yellow-led-light-case/300BCR6YW.html", waiting until "domcontentloaded" 2024-10-07 18:56:32 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-polypropylene-scoop-with-short-handle-case/500SCP06OZN.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-polypropylene-scoop-with-short-handle-case/500SCP06OZN.html", waiting until "domcontentloaded" 2024-10-07 18:56:32 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-star-chiefs-choice-cc28-6oz-all-in-one-popcorn-kit-case/793CC286OZ.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-star-chiefs-choice-cc28-6oz-all-in-one-popcorn-kit-case/793CC286OZ.html", waiting until "domcontentloaded" 2024-10-07 18:56:32 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-vented-clamshell-produce-container-case/434H160.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-vented-clamshell-produce-container-case/434H160.html", waiting until "domcontentloaded" 2024-10-07 18:56:32 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-polypropylene-scoop-with-short-handle-case/500SCP06OZN.html", waiting until "domcontentloaded" 2024-10-07 18:56:32 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-star-chiefs-choice-cc28-6oz-all-in-one-popcorn-kit-case/793CC286OZ.html", waiting until "domcontentloaded" 2024-10-07 18:56:32 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-oz-vented-clamshell-produce-container-case/434H160.html", waiting until "domcontentloaded" 2024-10-07 18:56:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 18:57:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 18:58:03 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-beer-bottle-carrier-case/433096554618.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-beer-bottle-carrier-case/433096554618.html", waiting until "domcontentloaded" 2024-10-07 18:58:03 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-beer-bottle-carrier-pack/999096554618.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-beer-bottle-carrier-pack/999096554618.html", waiting until "domcontentloaded" 2024-10-07 18:58:03 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-wine-bottle-carrier-case/433097199598.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-wine-bottle-carrier-case/433097199598.html", waiting until "domcontentloaded" 2024-10-07 18:58:03 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-wine-bottle-carrier-pack/999097199598.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-wine-bottle-carrier-pack/999097199598.html", waiting until "domcontentloaded" 2024-10-07 18:58:03 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pan-aluminum-end-load-sheet-bun-pan-rack-unassembled/190PANRCK6.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pan-aluminum-end-load-sheet-bun-pan-rack-unassembled/190PANRCK6.html", waiting until "domcontentloaded" 2024-10-07 18:58:03 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-beer-bottle-carrier-case/433096554618.html", waiting until "domcontentloaded" 2024-10-07 18:58:03 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-beer-bottle-carrier-pack/999096554618.html", waiting until "domcontentloaded" 2024-10-07 18:58:03 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-wine-bottle-carrier-case/433097199598.html", waiting until "domcontentloaded" 2024-10-07 18:58:03 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pack-cardboard-wine-bottle-carrier-pack/999097199598.html", waiting until "domcontentloaded" 2024-10-07 18:58:03 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-pan-aluminum-end-load-sheet-bun-pan-rack-unassembled/190PANRCK6.html", waiting until "domcontentloaded" 2024-10-07 18:58:04 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-piece-hotel-kitchen-cooking-kit/492HKCKIT.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-piece-hotel-kitchen-cooking-kit/492HKCKIT.html", waiting until "domcontentloaded" 2024-10-07 18:58:04 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-piece-nylon-bristle-pastry-basting-brush-set/407WDPSET6NY.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-piece-nylon-bristle-pastry-basting-brush-set/407WDPSET6NY.html", waiting until "domcontentloaded" 2024-10-07 18:58:04 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-power-cord-with-nema-5-15p-plug-120v/190REPLCORD.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-power-cord-with-nema-5-15p-plug-120v/190REPLCORD.html", waiting until "domcontentloaded" 2024-10-07 18:58:04 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-piece-hotel-kitchen-cooking-kit/492HKCKIT.html", waiting until "domcontentloaded" 2024-10-07 18:58:04 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-piece-nylon-bristle-pastry-basting-brush-set/407WDPSET6NY.html", waiting until "domcontentloaded" 2024-10-07 18:58:05 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-power-cord-with-nema-5-15p-plug-120v/190REPLCORD.html", waiting until "domcontentloaded" 2024-10-07 18:58:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 18:59:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-power-cord-with-nema-6-20p-plug-240v/190REPLCORD2.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-power-cord-with-nema-6-20p-plug-240v/190REPLCORD2.html", waiting until "domcontentloaded" 2024-10-07 18:59:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-silver-foil-lace-doily-case/477112006.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-silver-foil-lace-doily-case/477112006.html", waiting until "domcontentloaded" 2024-10-07 18:59:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-power-cord-with-nema-6-20p-plug-240v/190REPLCORD2.html", waiting until "domcontentloaded" 2024-10-07 18:59:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-stainless-steel-surface-mount-beer-drip-tray-with-rinser/190BDT6SR.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-stainless-steel-surface-mount-beer-drip-tray-with-rinser/190BDT6SR.html", waiting until "domcontentloaded" 2024-10-07 18:59:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-speaker-grill-combo/783SPG66T.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-speaker-grill-combo/783SPG66T.html", waiting until "domcontentloaded" 2024-10-07 18:59:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-stainless-steel-asian-cleaver-with-riveted-wood-handle/407OW189.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-stainless-steel-asian-cleaver-with-riveted-wood-handle/407OW189.html", waiting until "domcontentloaded" 2024-10-07 18:59:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-silver-foil-lace-doily-case/477112006.html", waiting until "domcontentloaded" 2024-10-07 18:59:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-stainless-steel-surface-mount-beer-drip-tray-with-rinser/190BDT6SR.html", waiting until "domcontentloaded" 2024-10-07 18:59:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-speaker-grill-combo/783SPG66T.html", waiting until "domcontentloaded" 2024-10-07 18:59:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-stainless-steel-asian-cleaver-with-riveted-wood-handle/407OW189.html", waiting until "domcontentloaded" 2024-10-07 18:59:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-traffic-cone-with-9-lb-base/466066000.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-traffic-cone-with-9-lb-base/466066000.html", waiting until "domcontentloaded" 2024-10-07 18:59:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-ts-b-0222-heavy-duty-deck-mounted-swivel-faucet-with-8-centers/510B222.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-ts-b-0222-heavy-duty-deck-mounted-swivel-faucet-with-8-centers/510B222.html", waiting until "domcontentloaded" 2024-10-07 18:59:37 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-ts-b-1115-wall-mounted-swivel-faucet-with-4-centers/510B1115.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-ts-b-1115-wall-mounted-swivel-faucet-with-4-centers/510B1115.html", waiting until "domcontentloaded" 2024-10-07 18:59:37 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-traffic-cone-with-9-lb-base/466066000.html", waiting until "domcontentloaded" 2024-10-07 18:59:37 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-ts-b-0222-heavy-duty-deck-mounted-swivel-faucet-with-8-centers/510B222.html", waiting until "domcontentloaded" 2024-10-07 18:59:37 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-ts-b-1115-wall-mounted-swivel-faucet-with-4-centers/510B1115.html", waiting until "domcontentloaded" 2024-10-07 18:59:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:00:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:01:08 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-black-parking-stopper/466PBSW6X.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-black-parking-stopper/466PBSW6X.html", waiting until "domcontentloaded" 2024-10-07 19:01:08 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-black-parking-stopper/466PBSW6X.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-circular-melamine-coated-wood-cake-board-with-feet/245MDFRD6.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-circular-melamine-coated-wood-cake-board-with-feet/245MDFRD6.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-cake-pizza-circle-case/2456CCC.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-cake-pizza-circle-case/2456CCC.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-cake-pizza-circle-pack/9996CCC.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-cake-pizza-circle-pack/9996CCC.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-pizza-circle-case/2456PIZCIR.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-pizza-circle-case/2456PIZCIR.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-circular-melamine-coated-wood-cake-board-with-feet/245MDFRD6.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-cake-pizza-circle-case/2456CCC.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-cake-pizza-circle-pack/9996CCC.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-pizza-circle-case/2456PIZCIR.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-pizza-circle-pack/9996PIZCIR.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-pizza-circle-pack/9996PIZCIR.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-steel-peg-hook-for-grid-go-displays/8912201W.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-steel-peg-hook-for-grid-go-displays/8912201W.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-uncoated-paper-plate-case/433602.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-uncoated-paper-plate-case/433602.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-corrugated-pizza-circle-pack/9996PIZCIR.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-uncoated-paper-plate-case/433602.html", waiting until "domcontentloaded" 2024-10-07 19:01:09 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-steel-peg-hook-for-grid-go-displays/8912201W.html", waiting until "domcontentloaded" 2024-10-07 19:01:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:02:40 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-uncoated-paper-plate-pack/999602.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-uncoated-paper-plate-pack/999602.html", waiting until "domcontentloaded" 2024-10-07 19:02:40 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-white-uncoated-paper-plate-pack/999602.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-20-mil-fire-retardant-clear-vinyl-tarp/466CVTFR610.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-20-mil-fire-retardant-clear-vinyl-tarp/466CVTFR610.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-20-mil-super-heavy-duty-clear-vinyl-tarp/466CVT20610.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-20-mil-super-heavy-duty-clear-vinyl-tarp/466CVT20610.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-30-mil-super-heavy-duty-clear-vinyl-tarp/466CVT30610.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-30-mil-super-heavy-duty-clear-vinyl-tarp/466CVT30610.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-20-mil-fire-retardant-clear-vinyl-tarp/466CVTFR610.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-chamber-vacuum-packaging-pouches-bags-3-mil-case/186CVB610C.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-chamber-vacuum-packaging-pouches-bags-3-mil-case/186CVB610C.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-20-mil-super-heavy-duty-clear-vinyl-tarp/466CVT20610.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-pint-size-full-mesh-external-vacuum-packaging-pouches-bags-3-mil-pack/186EVB610C.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-pint-size-full-mesh-external-vacuum-packaging-pouches-bags-3-mil-pack/186EVB610C.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-30-mil-super-heavy-duty-clear-vinyl-tarp/466CVT30610.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-12-x-4-1-2-white-open-top-corrugated-bin-case/442WOT6124.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-12-x-4-1-2-white-open-top-corrugated-bin-case/442WOT6124.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-chamber-vacuum-packaging-pouches-bags-3-mil-case/186CVB610C.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-18-x-4-1-2-white-open-top-corrugated-bin-case/442WOT6184.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-18-x-4-1-2-white-open-top-corrugated-bin-case/442WOT6184.html", waiting until "domcontentloaded" 2024-10-07 19:02:41 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-10-pint-size-full-mesh-external-vacuum-packaging-pouches-bags-3-mil-pack/186EVB610C.html", waiting until "domcontentloaded" 2024-10-07 19:02:42 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-12-x-4-1-2-white-open-top-corrugated-bin-case/442WOT6124.html", waiting until "domcontentloaded" 2024-10-07 19:02:42 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-18-x-4-1-2-white-open-top-corrugated-bin-case/442WOT6184.html", waiting until "domcontentloaded" 2024-10-07 19:02:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:03:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:04:12 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-2-3-4-plastic-sign-holder-for-pegboard-gondola-merchandisers/8914465.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-2-3-4-plastic-sign-holder-for-pegboard-gondola-merchandisers/8914465.html", waiting until "domcontentloaded" 2024-10-07 19:04:13 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-2-3-4-plastic-sign-holder-for-pegboard-gondola-merchandisers/8914465.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-20-16-mil-brown-poly-tarp/466BHD620A.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-20-16-mil-brown-poly-tarp/466BHD620A.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-20-20-mil-super-heavy-duty-clear-vinyl-tarp/466CVT20620.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-20-20-mil-super-heavy-duty-clear-vinyl-tarp/466CVT20620.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-20-brown-white-20-mil-tarps-waterproof/466UHD620X.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-20-brown-white-20-mil-tarps-waterproof/466UHD620X.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-20-16-mil-brown-poly-tarp/466BHD620A.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-24-x-4-1-2-white-open-top-corrugated-bin-case/442WOT6244.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-24-x-4-1-2-white-open-top-corrugated-bin-case/442WOT6244.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-20-20-mil-super-heavy-duty-clear-vinyl-tarp/466CVT20620.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-15-clear-plastic-low-density-vented-produce-bag-case/130VTD063515.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-15-clear-plastic-low-density-vented-produce-bag-case/130VTD063515.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-18-clear-plastic-low-density-vented-produce-bag-case/130VTD063518.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-18-clear-plastic-low-density-vented-produce-bag-case/130VTD063518.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-20-brown-white-20-mil-tarps-waterproof/466UHD620X.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-18-white-bread-bag-case/15091532.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-18-white-bread-bag-case/15091532.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-24-x-4-1-2-white-open-top-corrugated-bin-case/442WOT6244.html", waiting until "domcontentloaded" 2024-10-07 19:04:14 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-15-clear-plastic-low-density-vented-produce-bag-case/130VTD063515.html", waiting until "domcontentloaded" 2024-10-07 19:04:15 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-18-clear-plastic-low-density-vented-produce-bag-case/130VTD063518.html", waiting until "domcontentloaded" 2024-10-07 19:04:15 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-18-white-bread-bag-case/15091532.html", waiting until "domcontentloaded" 2024-10-07 19:04:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:05:44 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-20-white-bread-bag-case/15091533.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-20-white-bread-bag-case/15091533.html", waiting until "domcontentloaded" 2024-10-07 19:05:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:05:45 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-2-x-20-white-bread-bag-case/15091533.html", waiting until "domcontentloaded" 2024-10-07 19:05:47 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-4-x-1-1-8-1-piece-5-oz-white-candy-box-case/245049.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-4-x-1-1-8-1-piece-5-oz-white-candy-box-case/245049.html", waiting until "domcontentloaded" 2024-10-07 19:05:47 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-4-x-1-1-8-1-piece-5-oz-white-candy-box-with-triangular-window-case/245049W.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-4-x-1-1-8-1-piece-5-oz-white-candy-box-with-triangular-window-case/245049W.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-4-x-1-1-8-1-piece-5-oz-white-candy-box-case/245049.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-3-4-probe-housing-assembly/135107239.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-3-4-probe-housing-assembly/135107239.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-1-4-x-1-1-8-1-piece-5-oz-white-candy-box-with-triangular-window-case/245049W.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-1-2-x-2-3-4-pink-cake-bakery-box-bundle/245653CBP.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-1-2-x-2-3-4-pink-cake-bakery-box-bundle/245653CBP.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-1-2-x-2-3-4-pink-cake-bakery-box-pack/999653CBP.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-1-2-x-2-3-4-pink-cake-bakery-box-pack/999653CBP.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-3-4-x-2-1-2-white-customizable-microwavable-paper-8-take-outcontainer-case/7950208.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-3-4-x-2-1-2-white-customizable-microwavable-paper-8-take-outcontainer-case/7950208.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-foam-round-cake-dummy/246CDRD46.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-foam-round-cake-dummy/246CDRD46.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-3-3-4-probe-housing-assembly/135107239.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-1-2-x-2-3-4-pink-cake-bakery-box-bundle/245653CBP.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-1-2-x-2-3-4-pink-cake-bakery-box-pack/999653CBP.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-3-4-x-2-1-2-white-customizable-microwavable-paper-8-take-outcontainer-case/7950208.html", waiting until "domcontentloaded" 2024-10-07 19:05:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-foam-round-cake-dummy/246CDRD46.html", waiting until "domcontentloaded" 2024-10-07 19:06:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:07:16 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-x-20-98-mil-black-thank-you-heavy-duty-liquor-bag-case/433NHT203.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-x-20-98-mil-black-thank-you-heavy-duty-liquor-bag-case/433NHT203.html", waiting until "domcontentloaded" 2024-10-07 19:07:17 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-x-20-98-mil-black-thank-you-heavy-duty-liquor-bag-case/433NHT203.html", waiting until "domcontentloaded" 2024-10-07 19:07:20 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-x-4-kraft-shipping-box-bundle/328UFS644.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-x-4-kraft-shipping-box-bundle/328UFS644.html", waiting until "domcontentloaded" 2024-10-07 19:07:20 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-4-x-4-kraft-shipping-box-bundle/328UFS644.html", waiting until "domcontentloaded" 2024-10-07 19:07:20 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-50-4-7oz-per-sq-yd-privacy-screen-fence/466PS650G.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-50-4-7oz-per-sq-yd-privacy-screen-fence/466PS650G.html", waiting until "domcontentloaded" 2024-10-07 19:07:20 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-1-compartment-microwaveable-black-plastic-hinged-take-out-container-case/126MF663B1C.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-1-compartment-microwaveable-black-plastic-hinged-take-out-container-case/126MF663B1C.html", waiting until "domcontentloaded" 2024-10-07 19:07:20 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-1-compartment-microwaveable-white-plastic-hinged-take-out-container-case/126MF663W1C.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-1-compartment-microwaveable-white-plastic-hinged-take-out-container-case/126MF663W1C.html", waiting until "domcontentloaded" 2024-10-07 19:07:20 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-50-4-7oz-per-sq-yd-privacy-screen-fence/466PS650G.html", waiting until "domcontentloaded" 2024-10-07 19:07:21 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-plastic-lip-and-tape-resealable-sandwich-bag-case/130PSB661.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-plastic-lip-and-tape-resealable-sandwich-bag-case/130PSB661.html", waiting until "domcontentloaded" 2024-10-07 19:07:21 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-seal-top-plastic-food-bag-box/130H07RC1M.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-seal-top-plastic-food-bag-box/130H07RC1M.html", waiting until "domcontentloaded" 2024-10-07 19:07:21 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-white-square-melamine-coated-wood-cake-board-with-feet/245MDFSQ6.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-white-square-melamine-coated-wood-cake-board-with-feet/245MDFSQ6.html", waiting until "domcontentloaded" 2024-10-07 19:07:21 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-1-compartment-microwaveable-black-plastic-hinged-take-out-container-case/126MF663B1C.html", waiting until "domcontentloaded" 2024-10-07 19:07:21 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-1-compartment-microwaveable-white-plastic-hinged-take-out-container-case/126MF663W1C.html", waiting until "domcontentloaded" 2024-10-07 19:07:21 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-plastic-lip-and-tape-resealable-sandwich-bag-case/130PSB661.html", waiting until "domcontentloaded" 2024-10-07 19:07:21 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-seal-top-plastic-food-bag-box/130H07RC1M.html", waiting until "domcontentloaded" 2024-10-07 19:07:21 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-white-square-melamine-coated-wood-cake-board-with-feet/245MDFSQ6.html", waiting until "domcontentloaded" 2024-10-07 19:07:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:08:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:08:48 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-2-1-2-white-pie-bakery-box-bundle/245662CB.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-2-1-2-white-pie-bakery-box-bundle/245662CB.html", waiting until "domcontentloaded" 2024-10-07 19:08:49 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-2-1-2-white-pie-bakery-box-bundle/245662CB.html", waiting until "domcontentloaded" 2024-10-07 19:08:52 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-2-1-2-white-pie-bakery-box-pack/999662CB.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-2-1-2-white-pie-bakery-box-pack/999662CB.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-2-1-2-white-pie-bakery-box-pack/999662CB.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-3-white-cake-bakery-box-bundle/245663CB.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-3-white-cake-bakery-box-bundle/245663CB.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-3-white-cake-bakery-box-pack/999663CB.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-3-white-cake-bakery-box-pack/999663CB.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-3-white-paper-clamshell-take-out-container-case/1508086.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-3-white-paper-clamshell-take-out-container-case/1508086.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-4-foam-square-cake-dummy/246CDSQ46.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-4-foam-square-cake-dummy/246CDSQ46.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-4-kraft-shipping-box-bundle/328UFS664.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-4-kraft-shipping-box-bundle/328UFS664.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-6-kraft-shipping-box-bundle/328UFS666.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-6-kraft-shipping-box-bundle/328UFS666.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-3-white-cake-bakery-box-bundle/245663CB.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-3-white-cake-bakery-box-pack/999663CB.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-3-white-paper-clamshell-take-out-container-case/1508086.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-4-foam-square-cake-dummy/246CDSQ46.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-4-kraft-shipping-box-bundle/328UFS664.html", waiting until "domcontentloaded" 2024-10-07 19:08:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-6-kraft-shipping-box-bundle/328UFS666.html", waiting until "domcontentloaded" 2024-10-07 19:09:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:10:20 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-6-white-cake-bakery-box-bundle/245666CB.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-6-white-cake-bakery-box-bundle/245666CB.html", waiting until "domcontentloaded" 2024-10-07 19:10:24 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-6-white-cake-bakery-box-bundle/245666CB.html", waiting until "domcontentloaded" 2024-10-07 19:10:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-10-oz-green-heavy-duty-canvas-tarp/466CTG1068.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-10-oz-green-heavy-duty-canvas-tarp/466CTG1068.html", waiting until "domcontentloaded" 2024-10-07 19:10:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-10-oz-olive-drab-heavy-duty-canvas-tarp/466CTOD1068.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-10-oz-olive-drab-heavy-duty-canvas-tarp/466CTOD1068.html", waiting until "domcontentloaded" 2024-10-07 19:10:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-10-oz-tan-heavy-duty-canvas-tarp/466CTT1068.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-10-oz-tan-heavy-duty-canvas-tarp/466CTT1068.html", waiting until "domcontentloaded" 2024-10-07 19:10:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-12-oz-tan-heavy-duty-canvas-tarp/466CTT1268X.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-12-oz-tan-heavy-duty-canvas-tarp/466CTT1268X.html", waiting until "domcontentloaded" 2024-10-07 19:10:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-16-mil-brown-poly-tarp/466BHD68A.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-16-mil-brown-poly-tarp/466BHD68A.html", waiting until "domcontentloaded" 2024-10-07 19:10:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-20-mil-fire-retardant-clear-vinyl-tarp/466CVTFR68.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-20-mil-fire-retardant-clear-vinyl-tarp/466CVTFR68.html", waiting until "domcontentloaded" 2024-10-07 19:10:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-20-mil-super-heavy-duty-clear-vinyl-tarp/466CVT2068.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-20-mil-super-heavy-duty-clear-vinyl-tarp/466CVT2068.html", waiting until "domcontentloaded" 2024-10-07 19:10:26 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-10-oz-green-heavy-duty-canvas-tarp/466CTG1068.html", waiting until "domcontentloaded" 2024-10-07 19:10:27 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-10-oz-olive-drab-heavy-duty-canvas-tarp/466CTOD1068.html", waiting until "domcontentloaded" 2024-10-07 19:10:27 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-10-oz-tan-heavy-duty-canvas-tarp/466CTT1068.html", waiting until "domcontentloaded" 2024-10-07 19:10:27 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-12-oz-tan-heavy-duty-canvas-tarp/466CTT1268X.html", waiting until "domcontentloaded" 2024-10-07 19:10:27 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-16-mil-brown-poly-tarp/466BHD68A.html", waiting until "domcontentloaded" 2024-10-07 19:10:27 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-20-mil-fire-retardant-clear-vinyl-tarp/466CVTFR68.html", waiting until "domcontentloaded" 2024-10-07 19:10:28 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-20-mil-super-heavy-duty-clear-vinyl-tarp/466CVT2068.html", waiting until "domcontentloaded" 2024-10-07 19:10:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:11:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:12:14 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-220-gsm-multi-purpose-heavy-duty-mesh-tarp/466BMT68.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-220-gsm-multi-purpose-heavy-duty-mesh-tarp/466BMT68.html", waiting until "domcontentloaded" 2024-10-07 19:12:14 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-220-gsm-multi-purpose-heavy-duty-mesh-tarp/466BMT68.html", waiting until "domcontentloaded" 2024-10-07 19:12:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-30-mil-super-heavy-duty-clear-vinyl-tarp/466CVT3068.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-30-mil-super-heavy-duty-clear-vinyl-tarp/466CVT3068.html", waiting until "domcontentloaded" 2024-10-07 19:12:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-brown-white-20-mil-tarps-waterproof/466UHD68X.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-brown-white-20-mil-tarps-waterproof/466UHD68X.html", waiting until "domcontentloaded" 2024-10-07 19:12:25 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-30-mil-super-heavy-duty-clear-vinyl-tarp/466CVT3068.html", waiting until "domcontentloaded" 2024-10-07 19:12:26 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-brown-white-20-mil-tarps-waterproof/466UHD68X.html", waiting until "domcontentloaded" 2024-10-07 19:12:31 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-chamber-vacuum-packaging-pouches-bags-3-mil-case/186CVB68C.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-chamber-vacuum-packaging-pouches-bags-3-mil-case/186CVB68C.html", waiting until "domcontentloaded" 2024-10-07 19:12:31 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-heavy-blue-brown-tarp-tarp-7-mil/466BTH68X.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-heavy-blue-brown-tarp-tarp-7-mil/466BTH68X.html", waiting until "domcontentloaded" 2024-10-07 19:12:31 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-chamber-vacuum-packaging-pouches-bags-3-mil-case/186CVB68C.html", waiting until "domcontentloaded" 2024-10-07 19:12:31 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-8-heavy-blue-brown-tarp-tarp-7-mil/466BTH68X.html", waiting until "domcontentloaded" 2024-10-07 19:12:31 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-heavyweight-canvas-drop-cloth-case/161DP6910CS.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-heavyweight-canvas-drop-cloth-case/161DP6910CS.html", waiting until "domcontentloaded" 2024-10-07 19:12:31 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-heavyweight-canvas-drop-cloth/161DP6910EA.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-heavyweight-canvas-drop-cloth/161DP6910EA.html", waiting until "domcontentloaded" 2024-10-07 19:12:31 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-medium-weight-canvas-drop-cloth-case/161DP698CS.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-medium-weight-canvas-drop-cloth-case/161DP698CS.html", waiting until "domcontentloaded" 2024-10-07 19:12:32 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-heavyweight-canvas-drop-cloth-case/161DP6910CS.html", waiting until "domcontentloaded" 2024-10-07 19:12:32 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-medium-weight-canvas-drop-cloth-case/161DP698CS.html", waiting until "domcontentloaded" 2024-10-07 19:12:32 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-heavyweight-canvas-drop-cloth/161DP6910EA.html", waiting until "domcontentloaded" 2024-10-07 19:12:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:13:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:13:45 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-medium-weight-canvas-drop-cloth/161DP698EA.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-medium-weight-canvas-drop-cloth/161DP698EA.html", waiting until "domcontentloaded" 2024-10-07 19:13:46 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-medium-weight-canvas-drop-cloth/161DP698EA.html", waiting until "domcontentloaded" 2024-10-07 19:13:57 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-rounded-corner-customizable-waterproof-menu/658WTP69R.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-rounded-corner-customizable-waterproof-menu/658WTP69R.html", waiting until "domcontentloaded" 2024-10-07 19:13:57 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-squared-corner-customizable-waterproof-menu/658WTRPR69S.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-squared-corner-customizable-waterproof-menu/658WTRPR69S.html", waiting until "domcontentloaded" 2024-10-07 19:13:57 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-rounded-corner-customizable-waterproof-menu/658WTP69R.html", waiting until "domcontentloaded" 2024-10-07 19:13:58 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-squared-corner-customizable-waterproof-menu/658WTRPR69S.html", waiting until "domcontentloaded" 2024-10-07 19:14:03 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-x-4-1-2-white-open-top-corrugated-bin-case/442WOT694.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-x-4-1-2-white-open-top-corrugated-bin-case/442WOT694.html", waiting until "domcontentloaded" 2024-10-07 19:14:03 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-yellow-black-parking-stopper/466PBS6X.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-yellow-black-parking-stopper/466PBS6X.html", waiting until "domcontentloaded" 2024-10-07 19:14:03 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-9-x-4-1-2-white-open-top-corrugated-bin-case/442WOT694.html", waiting until "domcontentloaded" 2024-10-07 19:14:03 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-yellow-black-parking-stopper/466PBS6X.html", waiting until "domcontentloaded" 2024-10-07 19:14:04 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-yellow-black-speed-bump/466RSH6X.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-yellow-black-speed-bump/466RSH6X.html", waiting until "domcontentloaded" 2024-10-07 19:14:04 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-band-saw-blade-for-boneless-meat/190BSB222060.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-band-saw-blade-for-boneless-meat/190BSB222060.html", waiting until "domcontentloaded" 2024-10-07 19:14:04 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-band-saw-blade-for-frozen-meat-and-general-use/190BSB422060.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-band-saw-blade-for-frozen-meat-and-general-use/190BSB422060.html", waiting until "domcontentloaded" 2024-10-07 19:14:04 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-yellow-black-speed-bump/466RSH6X.html", waiting until "domcontentloaded" 2024-10-07 19:14:04 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-band-saw-blade-for-boneless-meat/190BSB222060.html", waiting until "domcontentloaded" 2024-10-07 19:14:04 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-band-saw-blade-for-frozen-meat-and-general-use/190BSB422060.html", waiting until "domcontentloaded" 2024-10-07 19:14:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:15:17 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-band-saw-blade-for-general-use/190BSB322060.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-band-saw-blade-for-general-use/190BSB322060.html", waiting until "domcontentloaded" 2024-10-07 19:15:18 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-band-saw-blade-for-general-use/190BSB322060.html", waiting until "domcontentloaded" 2024-10-07 19:15:29 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-long-handle-case/500SCP600NL.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-long-handle-case/500SCP600NL.html", waiting until "domcontentloaded" 2024-10-07 19:15:29 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-long-handle-pack/999SCP600NL.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-long-handle-pack/999SCP600NL.html", waiting until "domcontentloaded" 2024-10-07 19:15:30 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-long-handle-case/500SCP600NL.html", waiting until "domcontentloaded" 2024-10-07 19:15:30 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-long-handle-pack/999SCP600NL.html", waiting until "domcontentloaded" 2024-10-07 19:15:35 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-medium-handle-case/500SCP600NM.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-medium-handle-case/500SCP600NM.html", waiting until "domcontentloaded" 2024-10-07 19:15:35 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-medium-handle-case/500SCP600NM.html", waiting until "domcontentloaded" 2024-10-07 19:15:35 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-short-handle-case/500SCP600NS.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-short-handle-case/500SCP600NS.html", waiting until "domcontentloaded" 2024-10-07 19:15:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-short-handle-case/500SCP600NS.html", waiting until "domcontentloaded" 2024-10-07 19:15:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-short-handle-pack/999SCP600NS.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-short-handle-pack/999SCP600NS.html", waiting until "domcontentloaded" 2024-10-07 19:15:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-clear-bridal-gown-garment-bag/904BB60.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-clear-bridal-gown-garment-bag/904BB60.html", waiting until "domcontentloaded" 2024-10-07 19:15:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-gallon-38-x-58-compostable-trash-can-liner-1-mils-case/501COMPBS60G.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-gallon-38-x-58-compostable-trash-can-liner-1-mils-case/501COMPBS60G.html", waiting until "domcontentloaded" 2024-10-07 19:15:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-cc-polypropylene-scoop-with-short-handle-pack/999SCP600NS.html", waiting until "domcontentloaded" 2024-10-07 19:15:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-clear-bridal-gown-garment-bag/904BB60.html", waiting until "domcontentloaded" 2024-10-07 19:15:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-gallon-38-x-58-compostable-trash-can-liner-1-mils-case/501COMPBS60G.html", waiting until "domcontentloaded" 2024-10-07 19:15:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:16:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:16:49 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-gas-appliance-connector-powder-coated-efv-xl/320XL30CKIT60B.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-gas-appliance-connector-powder-coated-efv-xl/320XL30CKIT60B.html", waiting until "domcontentloaded" 2024-10-07 19:16:50 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-gas-appliance-connector-powder-coated-efv-xl/320XL30CKIT60B.html", waiting until "domcontentloaded" 2024-10-07 19:17:01 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-gas-appliance-connector-powder-coated-efv/32020C4KIT60B.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-gas-appliance-connector-powder-coated-efv/32020C4KIT60B.html", waiting until "domcontentloaded" 2024-10-07 19:17:01 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-hood-orifice-3-8-27uns-thread/351ORIFICE60.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-hood-orifice-3-8-27uns-thread/351ORIFICE60.html", waiting until "domcontentloaded" 2024-10-07 19:17:02 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-gas-appliance-connector-powder-coated-efv/32020C4KIT60B.html", waiting until "domcontentloaded" 2024-10-07 19:17:02 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-hood-orifice-3-8-27uns-thread/351ORIFICE60.html", waiting until "domcontentloaded" 2024-10-07 19:17:07 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6.html", waiting until "domcontentloaded" 2024-10-07 19:17:07 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6.html", waiting until "domcontentloaded" 2024-10-07 19:17:07 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6015.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6015.html", waiting until "domcontentloaded" 2024-10-07 19:17:08 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6015.html", waiting until "domcontentloaded" 2024-10-07 19:17:08 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6017.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6017.html", waiting until "domcontentloaded" 2024-10-07 19:17:08 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH602.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH602.html", waiting until "domcontentloaded" 2024-10-07 19:17:08 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH603.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH603.html", waiting until "domcontentloaded" 2024-10-07 19:17:08 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6017.html", waiting until "domcontentloaded" 2024-10-07 19:17:08 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH603.html", waiting until "domcontentloaded" 2024-10-07 19:17:08 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH602.html", waiting until "domcontentloaded" 2024-10-07 19:17:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:18:21 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH604.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH604.html", waiting until "domcontentloaded" 2024-10-07 19:18:22 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH604.html", waiting until "domcontentloaded" 2024-10-07 19:18:34 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6046.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6046.html", waiting until "domcontentloaded" 2024-10-07 19:18:34 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6049.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6049.html", waiting until "domcontentloaded" 2024-10-07 19:18:34 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6046.html", waiting until "domcontentloaded" 2024-10-07 19:18:34 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6049.html", waiting until "domcontentloaded" 2024-10-07 19:18:40 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH605.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH605.html", waiting until "domcontentloaded" 2024-10-07 19:18:40 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6057.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6057.html", waiting until "domcontentloaded" 2024-10-07 19:18:40 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH605.html", waiting until "domcontentloaded" 2024-10-07 19:18:40 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6058.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6058.html", waiting until "domcontentloaded" 2024-10-07 19:18:40 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6057.html", waiting until "domcontentloaded" 2024-10-07 19:18:40 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH607.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH607.html", waiting until "domcontentloaded" 2024-10-07 19:18:40 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6080.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6080.html", waiting until "domcontentloaded" 2024-10-07 19:18:40 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6058.html", waiting until "domcontentloaded" 2024-10-07 19:18:40 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH607.html", waiting until "domcontentloaded" 2024-10-07 19:18:40 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6080.html", waiting until "domcontentloaded" 2024-10-07 19:18:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:19:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:19:53 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6099.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6099.html", waiting until "domcontentloaded" 2024-10-07 19:19:54 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-120-volt-low-profile-heat-strip/922FC4SH6099.html", waiting until "domcontentloaded" 2024-10-07 19:20:06 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH600.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH600.html", waiting until "domcontentloaded" 2024-10-07 19:20:06 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH601.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH601.html", waiting until "domcontentloaded" 2024-10-07 19:20:06 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH600.html", waiting until "domcontentloaded" 2024-10-07 19:20:06 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH601.html", waiting until "domcontentloaded" 2024-10-07 19:20:12 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6012.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6012.html", waiting until "domcontentloaded" 2024-10-07 19:20:12 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6024.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6024.html", waiting until "domcontentloaded" 2024-10-07 19:20:12 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6026.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6026.html", waiting until "domcontentloaded" 2024-10-07 19:20:12 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6012.html", waiting until "domcontentloaded" 2024-10-07 19:20:12 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6033.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6033.html", waiting until "domcontentloaded" 2024-10-07 19:20:12 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6024.html", waiting until "domcontentloaded" 2024-10-07 19:20:12 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6035.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6035.html", waiting until "domcontentloaded" 2024-10-07 19:20:12 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6026.html", waiting until "domcontentloaded" 2024-10-07 19:20:12 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6033.html", waiting until "domcontentloaded" 2024-10-07 19:20:13 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6035.html", waiting until "domcontentloaded" 2024-10-07 19:20:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:21:25 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6042.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6042.html", waiting until "domcontentloaded" 2024-10-07 19:21:26 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6042.html", waiting until "domcontentloaded" 2024-10-07 19:21:38 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH606.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH606.html", waiting until "domcontentloaded" 2024-10-07 19:21:38 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6064.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6064.html", waiting until "domcontentloaded" 2024-10-07 19:21:38 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH606.html", waiting until "domcontentloaded" 2024-10-07 19:21:38 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6064.html", waiting until "domcontentloaded" 2024-10-07 19:21:44 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6072.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6072.html", waiting until "domcontentloaded" 2024-10-07 19:21:44 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6075.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6075.html", waiting until "domcontentloaded" 2024-10-07 19:21:44 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH608.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH608.html", waiting until "domcontentloaded" 2024-10-07 19:21:44 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6072.html", waiting until "domcontentloaded" 2024-10-07 19:21:44 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH609.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH609.html", waiting until "domcontentloaded" 2024-10-07 19:21:44 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-led-string-lights-with-24-s14-bulbs-120v-24w-2200k/566S8032.html", waiting until "domcontentloaded" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-led-string-lights-with-24-s14-bulbs-120v-24w-2200k/566S8032.html", waiting until "domcontentloaded" 2024-10-07 19:21:44 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH6075.html", waiting until "domcontentloaded" 2024-10-07 19:21:45 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH608.html", waiting until "domcontentloaded" 2024-10-07 19:21:45 [scrapy.extensions.closespider] INFO: Closing spider since no items were produced in the last 1800 seconds. 2024-10-07 19:21:45 [scrapy.core.engine] INFO: Closing spider (closespider_timeout_no_item) 2024-10-07 19:21:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:21:45 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-inch-208-volt-low-profile-heat-strip/922FC4SH609.html", waiting until "domcontentloaded" 2024-10-07 19:21:45 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 90000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/60-led-string-lights-with-24-s14-bulbs-120v-24w-2200k/566S8032.html", waiting until "domcontentloaded" 2024-10-07 19:21:53 [scrapy-playwright] INFO: Connecting using CDP: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222 2024-10-07 19:21:53 [scrapy-playwright] INFO: Connecting using CDP: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222 2024-10-07 19:21:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 397, in _download_request_with_retry page = await self._create_page(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 296, in _create_page ctx_wrapper = await self._create_browser_context( File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 249, in _create_browser_context await self._maybe_connect_remote_devtools() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 214, in _maybe_connect_remote_devtools self.browser = await self.browser_type.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 14314, in connect_over_cdp await self._impl_obj.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_browser_type.py", line 172, in connect_over_cdp response = await self._channel.send_return_as_dict("connectOverCDP", params) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 64, in send_return_as_dict return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: BrowserType.connect_over_cdp: WebSocket error: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 Call log: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ error WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ code=1006 reason= 2024-10-07 19:21:53 [scrapy-playwright] INFO: Connecting using CDP: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222 2024-10-07 19:21:53 [scrapy-playwright] INFO: Connecting using CDP: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222 2024-10-07 19:21:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 397, in _download_request_with_retry page = await self._create_page(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 296, in _create_page ctx_wrapper = await self._create_browser_context( File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 249, in _create_browser_context await self._maybe_connect_remote_devtools() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 214, in _maybe_connect_remote_devtools self.browser = await self.browser_type.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 14314, in connect_over_cdp await self._impl_obj.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_browser_type.py", line 172, in connect_over_cdp response = await self._channel.send_return_as_dict("connectOverCDP", params) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 64, in send_return_as_dict return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: BrowserType.connect_over_cdp: WebSocket error: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 Call log: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ error WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ code=1006 reason= 2024-10-07 19:21:53 [scrapy-playwright] INFO: Connecting using CDP: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222 2024-10-07 19:21:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 397, in _download_request_with_retry page = await self._create_page(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 296, in _create_page ctx_wrapper = await self._create_browser_context( File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 249, in _create_browser_context await self._maybe_connect_remote_devtools() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 214, in _maybe_connect_remote_devtools self.browser = await self.browser_type.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 14314, in connect_over_cdp await self._impl_obj.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_browser_type.py", line 172, in connect_over_cdp response = await self._channel.send_return_as_dict("connectOverCDP", params) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 64, in send_return_as_dict return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: BrowserType.connect_over_cdp: WebSocket error: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 Call log: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ error WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ code=1006 reason= 2024-10-07 19:21:53 [scrapy-playwright] INFO: Connecting using CDP: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222 2024-10-07 19:21:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 397, in _download_request_with_retry page = await self._create_page(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 296, in _create_page ctx_wrapper = await self._create_browser_context( File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 249, in _create_browser_context await self._maybe_connect_remote_devtools() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 214, in _maybe_connect_remote_devtools self.browser = await self.browser_type.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 14314, in connect_over_cdp await self._impl_obj.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_browser_type.py", line 172, in connect_over_cdp response = await self._channel.send_return_as_dict("connectOverCDP", params) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 64, in send_return_as_dict return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: BrowserType.connect_over_cdp: WebSocket error: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 Call log: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ error WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ code=1006 reason= 2024-10-07 19:21:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 397, in _download_request_with_retry page = await self._create_page(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 296, in _create_page ctx_wrapper = await self._create_browser_context( File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 249, in _create_browser_context await self._maybe_connect_remote_devtools() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 214, in _maybe_connect_remote_devtools self.browser = await self.browser_type.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 14314, in connect_over_cdp await self._impl_obj.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_browser_type.py", line 172, in connect_over_cdp response = await self._channel.send_return_as_dict("connectOverCDP", params) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 64, in send_return_as_dict return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: BrowserType.connect_over_cdp: WebSocket error: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 Call log: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ error WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ code=1006 reason= 2024-10-07 19:21:53 [scrapy-playwright] INFO: Connecting using CDP: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222 2024-10-07 19:21:54 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 397, in _download_request_with_retry page = await self._create_page(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 296, in _create_page ctx_wrapper = await self._create_browser_context( File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 249, in _create_browser_context await self._maybe_connect_remote_devtools() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 214, in _maybe_connect_remote_devtools self.browser = await self.browser_type.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 14314, in connect_over_cdp await self._impl_obj.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_browser_type.py", line 172, in connect_over_cdp response = await self._channel.send_return_as_dict("connectOverCDP", params) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 64, in send_return_as_dict return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: BrowserType.connect_over_cdp: WebSocket error: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 Call log: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ error WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ code=1006 reason= 2024-10-07 19:21:54 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 397, in _download_request_with_retry page = await self._create_page(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 296, in _create_page ctx_wrapper = await self._create_browser_context( File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 249, in _create_browser_context await self._maybe_connect_remote_devtools() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 214, in _maybe_connect_remote_devtools self.browser = await self.browser_type.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 14314, in connect_over_cdp await self._impl_obj.connect_over_cdp( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_browser_type.py", line 172, in connect_over_cdp response = await self._channel.send_return_as_dict("connectOverCDP", params) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 64, in send_return_as_dict return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: BrowserType.connect_over_cdp: WebSocket error: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 Call log: wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ 401 Auth Failed (ip_blacklisted: 34.96.45.0/24) Auth Failed ip_blacklisted: 34.96.45.0/24 - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ error WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ WebSocket was closed before the connection was established - wss://brd-customer-hl_13cda1e4-zone-main_scraping_browser:l9p73ctebkrc@brd.superproxy.io:9222/ code=1006 reason= 2024-10-07 19:21:54 [webstaurant] INFO: [Spidermon] ------------------------------ MONITORS ------------------------------ 2024-10-07 19:21:54 [scrapy.utils.signal] ERROR: Error caught on signal handler: > Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 348, in maybeDeferred_coro result = f(*args, **kw) File "/usr/local/lib/python3.11/site-packages/pydispatch/robustapply.py", line 55, in robustApply return receiver(*arguments, **named) File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/extensions.py", line 130, in spider_closed self._run_suites(spider, self.spider_closed_suites) File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/extensions.py", line 231, in _run_suites runner.run(suite, **data) File "/usr/local/lib/python3.11/site-packages/spidermon/runners.py", line 29, in run return self.run_suite() File "/usr/local/lib/python3.11/site-packages/spidermon/runners.py", line 44, in run_suite self.run_monitors() File "/usr/local/lib/python3.11/site-packages/spidermon/runners.py", line 51, in run_monitors self.suite(self.result) File "/usr/local/lib/python3.11/unittest/suite.py", line 84, in __call__ return self.run(*args, **kwds) File "/usr/local/lib/python3.11/unittest/suite.py", line 122, in run test(result) File "/usr/local/lib/python3.11/unittest/suite.py", line 84, in __call__ return self.run(*args, **kwds) File "/usr/local/lib/python3.11/unittest/suite.py", line 122, in run test(result) File "/usr/local/lib/python3.11/unittest/case.py", line 678, in __call__ return self.run(*args, **kwds) File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 151, in run raise NotConfigured( spidermon.exceptions.NotConfigured: Configure SPIDERMON_MIN_ITEMS to your project settings to use Extracted Items Monitor. 2024-10-07 19:21:54 [scrapy.extensions.feedexport] INFO: No data to insert into BigQuery - closing feed storage 2024-10-07 19:21:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (0 items) in: bq://response-elt.dev_scrapers.catalog_item_scrape/batch:1 2024-10-07 19:21:54 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'big_query/url': 162, 'downloader/exception_count': 162, 'downloader/exception_type_count/playwright._impl._errors.Error': 10, 'downloader/exception_type_count/playwright._impl._errors.TimeoutError': 152, 'downloader/request_bytes': 56884, 'downloader/request_count': 162, 'downloader/request_method_count/GET': 162, 'elapsed_time_seconds': 1809.205365, 'feedexport/success_count/BigQueryFeedStorage': 1, 'finish_reason': 'closespider_timeout_no_item', 'finish_time': datetime.datetime(2024, 10, 7, 19, 21, 54, 296038, tzinfo=datetime.timezone.utc), 'log_count/ERROR': 163, 'log_count/INFO': 58, 'log_count/WARNING': 156, 'memusage/max': 134914048, 'memusage/startup': 121544704, 'playwright/browser_count': 1, 'playwright/context_count': 1, 'playwright/context_count/max_concurrent': 1, 'playwright/context_count/persistent/False': 1, 'playwright/context_count/remote/True': 1, 'playwright/page_count': 162, 'playwright/page_count/closed': 155, 'playwright/page_count/max_concurrent': 8, 'playwright/request_count': 159, 'playwright/request_count/method/GET': 159, 'playwright/request_count/navigation': 159, 'playwright/request_count/resource_type/document': 159, 'scheduler/dequeued': 162, 'scheduler/dequeued/memory': 162, 'scheduler/enqueued': 162, 'scheduler/enqueued/memory': 162, 'spidermon/validation/validators': 1, 'spidermon/validation/validators/item/jsonschema': True, 'start_requests/big_query': 162, 'start_time': datetime.datetime(2024, 10, 7, 18, 51, 45, 90673, tzinfo=datetime.timezone.utc)} 2024-10-07 19:21:54 [scrapy.core.engine] INFO: Spider closed (closespider_timeout_no_item) 2024-10-07 19:21:54 [scrapy-playwright] INFO: Closing download handler 2024-10-07 19:21:54 [scrapy-playwright] INFO: Closing download handler