2025-11-29 19:45:08 [scrapy.utils.log] (PID: 151) INFO: Scrapy 2.12.0 started (bot: catalog_extraction) 2025-11-29 19:45:08 [scrapy.utils.log] (PID: 151) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.13 (main, Jun 10 2025, 23:54:42) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36 2025-11-29 19:45:08 [twisted] (PID: 151) CRITICAL: Unhandled error in Deferred: 2025-11-29 19:45:08 [twisted] (PID: 151) CRITICAL: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks result = context.run(gen.send, result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/crawler.py", line 149, in crawl self.spider = self._create_spider(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/crawler.py", line 163, in _create_spider return self.spidercls.from_crawler(self, *args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 227, in from_crawler raise NotConfigured( # Temporarily splitting rendering and non rendering spiders scrapy.exceptions.NotConfigured: This spider requires rendering and should be executed in the secondary scrapyd server (scrapy-playwright.tryresponse-dev.com).