2024-10-07 19:58:58 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: catalog_extraction) 2024-10-07 19:58:58 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.10 (main, Sep 27 2024, 06:09:21) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-6.4.10-dirty-x86_64-with-glibc2.36 2024-10-07 19:58:58 [scrapy.addons] INFO: Enabled addons: [] 2024-10-07 19:58:58 [scrapy.extensions.telnet] INFO: Telnet Password: 84c8189259c8074b 2024-10-07 19:58:59 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.closespider.CloseSpider', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon'] 2024-10-07 19:58:59 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'catalog_extraction', 'CONCURRENT_ITEMS': 250, 'CONCURRENT_REQUESTS': 32, 'FEED_EXPORT_ENCODING': 'utf-8', 'HTTPPROXY_ENABLED': False, 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/webstaurant/93f0087684e611efa4fd4200a9fe0102.log', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'catalog_extraction.spiders', 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter', 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7', 'RETRY_TIMES': 5, 'SPIDER_MODULES': ['catalog_extraction.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor', 'USER_AGENT': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, ' 'like Gecko) Chrome/129.0.0.0 Safari/537.36'} 2024-10-07 19:58:59 [scrapy_poet.injection] INFO: Loading providers: [, , , , , , ] 2024-10-07 19:58:59 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy_poet.InjectionMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy_poet.DownloaderStatsMiddleware'] 2024-10-07 19:58:59 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy_poet.RetryMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2024-10-07 19:58:59 [scrapy.middleware] INFO: Enabled item pipelines: ['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline', 'scraping_utils.pipelines.AttachSupplierPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline'] 2024-10-07 19:58:59 [scrapy.core.engine] INFO: Spider opened 2024-10-07 19:58:59 [scrapy.extensions.closespider] INFO: Spider will stop when no items are produced after 7200 seconds. 2024-10-07 19:58:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 19:58:59 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2024-10-07 19:58:59 [scrapy-playwright] INFO: Starting download handler 2024-10-07 19:58:59 [scrapy-playwright] INFO: Starting download handler 2024-10-07 19:59:04 [webstaurant] INFO: Batch query job with batch size 2000 and offset 10000 2024-10-07 19:59:05 [scrapy-playwright] INFO: Launching browser firefox 2024-10-07 19:59:06 [scrapy-playwright] INFO: Browser firefox launched 2024-10-07 19:59:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:00:08 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:00:09 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:00:09 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:00:09 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:00:10 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:00:10 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:00:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:01:14 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:01:14 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:01:14 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:01:14 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:01:16 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:01:16 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:01:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:02:22 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:02:22 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:02:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:02:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:02:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:02:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:02:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:03:16 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:03:16 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:03:32 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:03:33 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:03:39 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:03:39 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:03:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:04:09 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:04:10 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:04:26 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:04:26 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:04:52 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:04:52 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:04:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:04:59 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:04:59 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:05:18 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:05:18 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:05:52 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:05:52 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:05:52 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:05:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:05:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:06:04 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:06:04 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:06:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:07:12 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:07:12 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:07:27 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:07:28 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:07:28 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:07:28 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:07:58 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:07:58 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:07:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:08:20 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:08:20 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:08:26 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:08:26 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:08:49 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:08:49 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:08:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:09:10 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:09:10 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:09:29 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:09:29 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:09:51 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:09:51 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:09:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:09:59 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:10:00 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:10:18 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:10:18 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:10:47 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:10:47 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:10:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:11:02 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:11:02 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:11:09 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:11:10 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:11:53 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:11:53 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:11:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:12:15 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:12:15 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:12:43 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:12:43 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:12:47 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-power-cord-with-nema-6-20p-plug-240v/190REPLCORD2.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-power-cord-with-nema-6-20p-plug-240v/190REPLCORD2.html", waiting until "networkidle" 2024-10-07 20:12:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-power-cord-with-nema-6-20p-plug-240v/190REPLCORD2.html", waiting until "networkidle" 2024-10-07 20:12:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:13:00 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:13:00 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:13:38 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:13:38 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:13:46 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:13:46 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:13:54 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:13:54 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:13:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:14:46 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:14:47 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:14:48 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:14:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:14:49 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:14:49 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:14:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:15:46 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:15:46 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:15:49 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:15:49 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:15:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:16:02 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:16:02 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:16:30 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:16:30 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:16:39 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:16:39 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:16:45 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:16:45 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:16:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:17:23 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:17:23 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:17:54 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:17:54 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:17:54 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:17:54 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:17:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:18:11 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:18:11 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:18:48 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:18:48 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:18:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:18:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:18:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:19:01 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:19:01 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:19:46 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:19:46 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:19:51 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:19:51 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:19:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:20:02 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:20:02 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:20:38 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:20:39 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:20:55 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:20:55 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:20:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:21:02 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:21:02 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:21:28 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:21:29 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:21:48 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:21:48 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:21:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:22:02 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:22:02 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:22:24 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:22:24 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:22:38 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:22:38 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:22:43 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:22:43 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:22:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:23:12 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:23:12 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:23:49 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:23:49 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:23:51 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:23:51 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:23:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:24:03 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:24:03 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:24:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:25:03 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:25:04 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:25:06 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:25:07 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:25:54 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:25:54 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:25:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:26:32 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:26:32 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:26:43 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:26:44 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:26:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:27:03 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:27:03 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:27:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:27:36 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:27:50 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:27:50 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:27:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:28:06 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:28:06 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:28:44 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:28:44 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:28:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:29:10 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:29:10 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:29:10 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:29:11 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:29:38 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:29:38 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:29:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:30:13 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:30:13 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:30:19 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:30:20 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:30:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:31:12 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:31:12 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:31:30 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:31:30 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:31:38 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-6-kraft-shipping-box-bundle/328UFS666.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-6-kraft-shipping-box-bundle/328UFS666.html", waiting until "networkidle" 2024-10-07 20:31:38 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/6-x-6-x-6-kraft-shipping-box-bundle/328UFS666.html", waiting until "networkidle" 2024-10-07 20:31:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:32:03 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:32:03 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:32:30 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:32:30 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:32:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:32:59 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:32:59 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:33:22 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:33:22 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:33:43 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:33:43 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:33:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:34:13 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:34:13 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:34:46 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:34:46 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:34:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:35:11 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:35:11 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:35:19 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:35:19 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:35:28 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: NS_ERROR_ABORT Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-heavyweight-canvas-drop-cloth-case/161DP6910CS.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: Page.goto: NS_ERROR_ABORT Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-heavyweight-canvas-drop-cloth-case/161DP6910CS.html", waiting until "networkidle" 2024-10-07 20:35:28 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: Page.goto: NS_ERROR_ABORT Call log: navigating to "https://www.webstaurantstore.com/6-x-9-beige-heavyweight-canvas-drop-cloth-case/161DP6910CS.html", waiting until "networkidle" 2024-10-07 20:35:37 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:35:44 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:35:50 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:35:50 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:35:51 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:35:59 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 3 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:35:59 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:36:00 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:36:01 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:09 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:16 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:16 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:24 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:29 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:29 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:38 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:43 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:44 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:54 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:59 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:36:59 [scrapy.extensions.logstats] INFO: Crawled 15 pages (at 12 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:36:59 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:37:09 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:37:14 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:37:14 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:37:24 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:37:29 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:37:30 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:37:42 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:37:47 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:37:48 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:37:59 [scrapy.extensions.logstats] INFO: Crawled 25 pages (at 10 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:37:59 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:38:05 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:38:06 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:38:18 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:38:24 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:38:24 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:38:36 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:38:41 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:38:41 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:38:53 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:38:59 [scrapy.extensions.logstats] INFO: Crawled 35 pages (at 10 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:39:00 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:39:00 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:39:12 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:39:18 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:39:18 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:39:30 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:39:35 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:39:36 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:39:47 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:39:54 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:39:54 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:39:59 [scrapy.extensions.logstats] INFO: Crawled 46 pages (at 11 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:40:07 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:12 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:12 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:21 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:26 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:26 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:35 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:41 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:41 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:53 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:58 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:59 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:40:59 [scrapy.extensions.logstats] INFO: Crawled 58 pages (at 12 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:41:09 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:41:15 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:41:16 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:41:28 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:41:32 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:41:33 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:41:45 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:41:49 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:41:49 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:41:59 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:41:59 [scrapy.extensions.logstats] INFO: Crawled 68 pages (at 10 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:42:05 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:06 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:16 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:21 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:26 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:27 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:36 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:42 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:42 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:52 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:57 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:57 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:42:59 [scrapy.extensions.logstats] INFO: Crawled 80 pages (at 12 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:43:09 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:43:13 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:43:14 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:43:24 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:43:27 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:43:28 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:43:39 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:43:44 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:43:44 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:43:55 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:43:59 [scrapy.extensions.logstats] INFO: Crawled 90 pages (at 10 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:44:01 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:03 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:13 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:18 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:19 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:27 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:32 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:33 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:41 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:44 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:46 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:54 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:58 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:58 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:44:59 [scrapy.extensions.logstats] INFO: Crawled 104 pages (at 14 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:45:07 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:11 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:12 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:21 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:25 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:26 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:33 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:38 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:38 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:46 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:51 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:51 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:45:59 [scrapy.extensions.logstats] INFO: Crawled 116 pages (at 12 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:46:00 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:04 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:05 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:13 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:18 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:19 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:26 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:31 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:31 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:40 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:45 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:46 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:46:59 [scrapy.extensions.logstats] INFO: Crawled 128 pages (at 12 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:47:07 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:09 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:17 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:18 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:26 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:30 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:34 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:39 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:41 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:47:42 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:47:45 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:53 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:57 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:57 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:47:59 [scrapy.extensions.logstats] INFO: Crawled 140 pages (at 12 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:48:07 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:48:12 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:48:13 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:48:23 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:48:28 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:48:29 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:50:04 [scrapy.extensions.logstats] INFO: Crawled 146 pages (at 6 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:50:37 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-gold-metal-lid-with-plastisol-liner/999L63400GM.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-gold-metal-lid-with-plastisol-liner/999L63400GM.html", waiting until "networkidle" 2024-10-07 20:50:37 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-unlined-black-ribbed-plastic-cap-pack/999L6340RUBP.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-unlined-black-ribbed-plastic-cap-pack/999L6340RUBP.html", waiting until "networkidle" 2024-10-07 20:50:37 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:50:37 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-gold-metal-lid-with-plastisol-liner/999L63400GM.html", waiting until "networkidle" 2024-10-07 20:50:37 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-unlined-black-ribbed-plastic-cap-pack/999L6340RUBP.html", waiting until "networkidle" 2024-10-07 20:50:59 [scrapy.extensions.logstats] INFO: Crawled 147 pages (at 1 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:51:13 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:51:13 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:51:31 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:51:37 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:51:47 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:51:59 [scrapy.extensions.logstats] INFO: Crawled 152 pages (at 5 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:52:39 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-unlined-white-ribbed-plastic-cap-pack/999L6340RUWP.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-unlined-white-ribbed-plastic-cap-pack/999L6340RUWP.html", waiting until "networkidle" 2024-10-07 20:52:41 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-unlined-white-ribbed-plastic-cap-pack/999L6340RUWP.html", waiting until "networkidle" 2024-10-07 20:52:59 [scrapy.extensions.logstats] INFO: Crawled 152 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:53:16 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-unlined-white-ribbed-plastic-cap/500L63400RUW.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-unlined-white-ribbed-plastic-cap/500L63400RUW.html", waiting until "networkidle" 2024-10-07 20:53:16 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-unlined-white-ribbed-plastic-cap/500L63400RUW.html", waiting until "networkidle" 2024-10-07 20:53:48 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-white-ribbed-plastic-cap-with-foam-liner/500L63400RFW.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-white-ribbed-plastic-cap-with-foam-liner/500L63400RFW.html", waiting until "networkidle" 2024-10-07 20:53:49 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-400-white-ribbed-plastic-cap-with-foam-liner/500L63400RFW.html", waiting until "networkidle" 2024-10-07 20:53:59 [scrapy.extensions.logstats] INFO: Crawled 152 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:54:04 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:54:05 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:54:40 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:54:50 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-485-black-dual-flapper-induction-lined-spice-lid-with-7-holes-pack/999L63485BI.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-485-black-dual-flapper-induction-lined-spice-lid-with-7-holes-pack/999L63485BI.html", waiting until "networkidle" 2024-10-07 20:54:59 [scrapy.extensions.logstats] INFO: Crawled 152 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:55:12 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 20:55:12 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-485-black-dual-flapper-induction-lined-spice-lid-with-7-holes-pack/999L63485BI.html", waiting until "networkidle" 2024-10-07 20:55:59 [scrapy.extensions.logstats] INFO: Crawled 152 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:56:01 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:56:54 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:56:59 [scrapy.extensions.logstats] INFO: Crawled 154 pages (at 2 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:57:01 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:57:09 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:57:15 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:57:21 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:57:28 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:57:54 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-07 20:57:59 [scrapy.extensions.logstats] INFO: Crawled 160 pages (at 6 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 20:58:36 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible - locator resolved to 3 elements. Proceeding with the first one: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible - locator resolved to 3 elements. Proceeding with the first one: A hand holding a white po…/>
Traceback (most recent call last):
  File Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible - locator resolved to 3 elements. Proceeding with the first one: A hand holding a white po…/>

2024-10-07 21:00:45 [scrapy-playwright] WARNING: Closing page due to failed request: <GET https://www.webstaurantstore.com/63-485-white-polypropylene-spice-cap-with-foam-liner-pack/999LF63485WF.html> exc_type=<class 'playwright._impl._errors.TimeoutError'> exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded.
Call log:
waiting for locator( Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 21:01:59 [scrapy.extensions.logstats] INFO: Crawled 160 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:02:02 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-485-white-unlined-polypropylene-spice-cap-pack/999LF63485WU.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-485-white-unlined-polypropylene-spice-cap-pack/999LF63485WU.html", waiting until "networkidle" 2024-10-07 21:02:04 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible - locator resolved to visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-485-white-unlined-polypropylene-spice-cap-pack/999LF63485WU.html", waiting until "networkidle" 2024-10-07 21:02:23 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible - locator resolved to visible exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-cc-polypropylene-scoop-with-long-handle-pack/999SCP630NL.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-cc-polypropylene-scoop-with-long-handle-pack/999SCP630NL.html", waiting until "networkidle" 2024-10-07 21:05:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:05:10 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-cc-polypropylene-scoop-with-short-handle-case/500SCP630NS.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-cc-polypropylene-scoop-with-short-handle-case/500SCP630NS.html", waiting until "networkidle" 2024-10-07 21:05:47 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 21:05:56 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-cc-polypropylene-scoop-with-long-handle-pack/999SCP630NL.html", waiting until "networkidle" 2024-10-07 21:05:56 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63-cc-polypropylene-scoop-with-short-handle-case/500SCP630NS.html", waiting until "networkidle" 2024-10-07 21:05:56 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 479, in _download_request_with_page await self._apply_page_methods(page, request, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 625, in _apply_page_methods pm.result = await _maybe_await(method(*pm.args, **pm.kwargs)) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 21, in _maybe_await return await obj File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector await self._impl_obj.wait_for_selector( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 392, in wait_for_selector return await self._main_frame.wait_for_selector(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector await self._channel.send("waitForSelector", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 30000ms exceeded. Call log: waiting for locator("#GalleryImage") to be visible 2024-10-07 21:05:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:07:14 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:09:04 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:09:50 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-and-red-inductionlined-dual-flapper-lid-with-7-holes/641SPCK12R.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-and-red-inductionlined-dual-flapper-lid-with-7-holes/641SPCK12R.html", waiting until "networkidle" 2024-10-07 21:09:50 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-and-white-inductionlined-dual-flapper-lid-with-7-holes/641SPCK12W.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-and-white-inductionlined-dual-flapper-lid-with-7-holes/641SPCK12W.html", waiting until "networkidle" 2024-10-07 21:09:50 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-black-lid/641SPCK12FK.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-black-lid/641SPCK12FK.html", waiting until "networkidle" 2024-10-07 21:09:51 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-and-red-inductionlined-dual-flapper-lid-with-7-holes/641SPCK12R.html", waiting until "networkidle" 2024-10-07 21:09:51 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-and-white-inductionlined-dual-flapper-lid-with-7-holes/641SPCK12W.html", waiting until "networkidle" 2024-10-07 21:09:51 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-black-lid/641SPCK12FK.html", waiting until "networkidle" 2024-10-07 21:09:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:10:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:11:55 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-blue-lid/641SPCK12FB.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-blue-lid/641SPCK12FB.html", waiting until "networkidle" 2024-10-07 21:11:59 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-red-lid/641SPCK12FR.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-red-lid/641SPCK12FR.html", waiting until "networkidle" 2024-10-07 21:11:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:11:59 [scrapy-playwright] WARNING: Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-white-lid/641SPCK12FW.html", waiting until "networkidle" Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-white-lid/641SPCK12FW.html", waiting until "networkidle" 2024-10-07 21:12:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:13:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:15:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:15:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:16:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:18:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:18:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:19:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:20:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:21:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:23:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:23:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:25:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:25:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:27:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:28:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:28:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:29:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:30:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:32:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:33:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:34:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:35:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:36:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:36:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:38:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:39:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:39:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:41:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:42:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:42:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:44:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:45:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:46:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:47:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:47:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:49:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:50:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:50:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:52:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:52:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:53:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:55:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:56:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:57:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:58:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 21:58:59 [scrapy.extensions.closespider] INFO: Closing spider since no items were produced in the last 7200 seconds. 2024-10-07 21:58:59 [scrapy.core.engine] INFO: Closing spider (closespider_timeout_no_item) 2024-10-07 21:58:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:00:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:01:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:01:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:03:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:03:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:05:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:05:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:07:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:07:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:09:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:09:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:11:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:11:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:13:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:14:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:15:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:15:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:17:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:18:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:19:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:20:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:21:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:22:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:23:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:24:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:25:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:26:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:27:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:27:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:29:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:30:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:31:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:32:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:33:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:34:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:35:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:36:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:37:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:38:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:39:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:40:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:41:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:41:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:43:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:44:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:45:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:46:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:47:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:48:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:49:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:50:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:51:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:52:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:53:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:54:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:55:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:56:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:57:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:58:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 22:59:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:00:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:01:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:02:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:03:04 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:04:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:05:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:06:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:07:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:08:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:09:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:10:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:11:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:12:04 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:13:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:14:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:15:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:16:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:17:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:18:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:19:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:20:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:20:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:22:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:23:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:24:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:25:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:26:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:27:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:28:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:29:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:30:04 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:31:04 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:32:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:33:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:34:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:35:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:36:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:37:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:37:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:39:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:40:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:41:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:42:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:43:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:44:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:45:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:46:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:47:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:48:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:49:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:50:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:51:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:52:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:53:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:54:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:55:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:56:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:57:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:58:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-07 23:58:59 [scrapy.extensions.closespider] INFO: Closing spider since no items were produced in the last 7200 seconds. 2024-10-07 23:59:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:00:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:01:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:02:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:03:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:04:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:05:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:06:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:07:04 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:08:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:09:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:10:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:11:04 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:12:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:13:04 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:14:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:15:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:16:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:17:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:18:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:19:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:20:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:21:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:22:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:23:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:24:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:25:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:26:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:27:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:28:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:29:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:30:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:31:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:32:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:33:03 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:34:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:35:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:36:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:36:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:38:00 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:39:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:40:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:41:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:42:01 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:43:02 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:43:59 [scrapy-playwright] INFO: Launching browser firefox 2024-10-08 00:43:59 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-blue-lid/641SPCK12FB.html", waiting until "networkidle" 2024-10-08 00:43:59 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:43:59 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-red-lid/641SPCK12FR.html", waiting until "networkidle" 2024-10-08 00:43:59 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1999, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 519, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1251, in adapt extracted: _SelfResultT | Failure = result.result() File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 378, in _download_request return await self._download_request_with_retry(request=request, spider=spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 431, in _download_request_with_retry return await self._download_request_with_page(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 460, in _download_request_with_page response, download = await self._get_response_and_download(request, page, spider) File "/usr/local/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 560, in _get_response_and_download response = await page.goto(url=request.url, **page_goto_kwargs) File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 8657, in goto await self._impl_obj.goto( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 519, in goto return await self._main_frame.goto(**locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 145, in goto await self._channel.send("goto", locals_to_params(locals())) File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 59, in send return await self._connection.wrap_api_call( File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.TimeoutError: Page.goto: Timeout 120000ms exceeded. Call log: navigating to "https://www.webstaurantstore.com/63485-12-oz-round-plastic-spice-container-with-flat-white-lid/641SPCK12FW.html", waiting until "networkidle" 2024-10-08 00:44:01 [scrapy-playwright] INFO: Browser firefox launched 2024-10-08 00:44:03 [asyncio] ERROR: Task was destroyed but it is pending! task: wait_for= cb=[Deferred.fromFuture..adapt() at /usr/local/lib/python3.11/site-packages/twisted/internet/defer.py:1249]> 2024-10-08 00:44:03 [asyncio] ERROR: Task was destroyed but it is pending! task: wait_for= cb=[Deferred.fromFuture..adapt() at /usr/local/lib/python3.11/site-packages/twisted/internet/defer.py:1249]> 2024-10-08 00:44:16 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:44:22 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <407 https://www.webstaurantstore.com/63485-black-dual-flapper-spice-lid-with-7-holes-case/500L63485BU.html>: HTTP status code is not handled or not allowed 2024-10-08 00:44:22 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <407 https://www.webstaurantstore.com/64-oz-black-10-x-10-x-3-square-microwaveable-plastic-hinged-take-out-container-case/126296185418.html>: HTTP status code is not handled or not allowed 2024-10-08 00:44:31 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:44:36 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:44:37 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:44:49 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:44:54 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:44:54 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:44:59 [scrapy.extensions.logstats] INFO: Crawled 171 pages (at 9 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:45:02 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:10 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:11 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:21 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:27 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:27 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:36 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:41 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:42 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:52 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:57 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:58 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:45:59 [scrapy.extensions.logstats] INFO: Crawled 183 pages (at 12 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:46:06 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:46:12 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:46:12 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:46:21 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:46:22 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:46:23 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 295, in aiter_errback yield await it.__anext__() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 374, in __anext__ return await self.data.__anext__() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 355, in _async_chain async for o in as_async_generator(it): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator async for r in it: File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async async for r in result or (): File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 118, in process_async async for r in iterable: File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/spiders/webstaurant.py", line 45, in parse_product async for item in page.get_items(): File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/webstaurant.py", line 28, in get_items yield await page.to_item() ^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1728330955.egg/catalog_extraction/pages/__init__.py", line 60, in to_item return await item_from_fields( ^^^^^^^^^^^^^^^^ NameError: name 'item_from_fields' is not defined 2024-10-08 00:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 6 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 00:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:10:02 [scrapy.crawler] INFO: Received SIGTERM, shutting down gracefully. Send again to force 2024-10-08 01:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:58:59 [scrapy.extensions.closespider] INFO: Closing spider since no items were produced in the last 7200 seconds. 2024-10-08 01:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 01:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 02:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:58:59 [scrapy.extensions.closespider] INFO: Closing spider since no items were produced in the last 7200 seconds. 2024-10-08 03:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 03:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 04:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:58:59 [scrapy.extensions.closespider] INFO: Closing spider since no items were produced in the last 7200 seconds. 2024-10-08 05:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 05:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 06:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:58:59 [scrapy.extensions.closespider] INFO: Closing spider since no items were produced in the last 7200 seconds. 2024-10-08 07:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 07:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 08:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:58:59 [scrapy.extensions.closespider] INFO: Closing spider since no items were produced in the last 7200 seconds. 2024-10-08 09:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 09:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 10:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:58:59 [scrapy.extensions.closespider] INFO: Closing spider since no items were produced in the last 7200 seconds. 2024-10-08 11:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 11:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 12:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:58:59 [scrapy.extensions.closespider] INFO: Closing spider since no items were produced in the last 7200 seconds. 2024-10-08 13:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 13:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:25:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:26:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:27:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:28:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:29:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:30:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:31:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:32:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:33:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:34:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:35:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:36:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:37:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:38:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:39:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:40:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:41:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:42:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:43:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:44:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:45:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:46:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:47:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:48:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:49:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:50:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:51:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:52:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:53:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:54:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:55:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:56:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:57:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:58:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 14:59:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:00:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:01:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:02:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:03:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:04:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:05:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:06:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:07:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:08:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:09:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:10:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:11:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:12:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:13:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:14:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:15:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:16:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:17:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:18:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:19:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:20:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:21:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:22:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:23:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-10-08 15:24:59 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 0 items (at 0 items/min)