2025-11-08 13:45:12 [scrapy.utils.log] (PID: 130) INFO: Scrapy 2.12.0 started (bot: catalog_extraction)
2025-11-08 13:45:12 [scrapy.utils.log] (PID: 130) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.13 (main, Jun 10 2025, 23:54:42) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36
2025-11-08 13:45:12 [ecoenclose] (PID: 130) INFO: Starting extraction spider ecoenclose...
2025-11-08 13:45:12 [scrapy.addons] (PID: 130) INFO: Enabled addons:
[]
2025-11-08 13:45:12 [py.warnings] (PID: 130) WARNING: /usr/local/lib/python3.11/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting.
It will be removed in a future version of Scrapy.
  return cls(crawler)

2025-11-08 13:45:12 [scrapy.extensions.telnet] (PID: 130) INFO: Telnet Password: 3c6f4a6b6a8aa6e6
2025-11-08 13:45:12 [py.warnings] (PID: 130) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-08 13:45:12 [scrapy.middleware] (PID: 130) INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.closespider.CloseSpider',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'spidermon.contrib.scrapy.extensions.Spidermon']
2025-11-08 13:45:12 [scrapy.crawler] (PID: 130) INFO: Overridden settings:
{'BOT_NAME': 'catalog_extraction',
 'CONCURRENT_ITEMS': 250,
 'CONCURRENT_REQUESTS': 24,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/ecoenclose/21db50a0bca911f08d4f4200a9fe0102.log',
 'LOG_FORMAT': '%(asctime)s [%(name)s] (PID: %(process)d) %(levelname)s: '
               '%(message)s',
 'LOG_LEVEL': 'INFO',
 'NEWSPIDER_MODULE': 'catalog_extraction.spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['catalog_extraction.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': None}
2025-11-08 13:45:13 [scrapy_poet.injection] (PID: 130) INFO: Loading providers:
 [<class 'scrapy_poet.page_input_providers.HttpRequestProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpResponseProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpClientProvider'>,
 <class 'scrapy_poet.page_input_providers.PageParamsProvider'>,
 <class 'scrapy_poet.page_input_providers.RequestUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.ResponseUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.StatsProvider'>]
2025-11-08 13:45:13 [scrapy.middleware] (PID: 130) INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scraping_utils.middlewares.downloaders.ProxyManagerDownloaderMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scraping_utils.middlewares.downloaders.HeadersSpooferDownloaderMiddleware',
 'scrapy_poet.InjectionMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy_poet.DownloaderStatsMiddleware']
2025-11-08 13:45:13 [NotFoundHandlerSpiderMiddleware] (PID: 130) INFO: NotFoundHandlerSpiderMiddleware running on PRODUCTION environment.
2025-11-08 13:45:13 [scrapy.middleware] (PID: 130) INFO: Enabled spider middlewares:
['catalog_extraction.middlewares.NotFoundHandlerSpiderMiddleware',
 'catalog_extraction.middlewares.FixtureSavingMiddleware',
 'scrapy_poet.RetryMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2025-11-08 13:45:13 [scrapy.middleware] (PID: 130) INFO: Enabled item pipelines:
['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline',
 'catalog_extraction.pipelines.DiscontinuedProductsAdjustmentPipeline',
 'catalog_extraction.pipelines.PriceRoundingPipeline',
 'scraping_utils.pipelines.AttachSupplierPipeline',
 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline']
2025-11-08 13:45:13 [scrapy.core.engine] (PID: 130) INFO: Spider opened
2025-11-08 13:45:13 [scrapy.extensions.closespider] (PID: 130) INFO: Spider will stop when no items are produced after 1800 seconds.
2025-11-08 13:45:13 [scrapy.extensions.logstats] (PID: 130) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-11-08 13:45:13 [scrapy.extensions.telnet] (PID: 130) INFO: Telnet console listening on 127.0.0.1:6025
2025-11-08 13:45:14 [ProxyManagerDownloaderMiddleware] (PID: 130) INFO: Using brd-customer-hl_13cda1e4-zone-main_datacenter_proxy as the default proxy for ProxyManagerDownloaderMiddleware.
2025-11-08 13:45:14 [scrapy.spidermiddlewares.httperror] (PID: 130) INFO: Ignoring response <403 https://www.ecoenclose.com/shop/spiropack-eco/>: HTTP status code is not handled or not allowed
2025-11-08 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cello-tape-eco-friendly-packing-tape-industrially-compostable-2-x-72-yds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/sway-packaging already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:15 [scrapy.core.scraper] (PID: 130) ERROR: Spider error processing <GET https://www.ecoenclose.com/decorative-100-recycled-tissue-paper-blue-stripes-print-20-x-30/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/decorative-100-recycled-tissue-paper-blue-stripes-print-20-x-30/ returned 404 status code.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=149eec55-aa94-4752-a4a3-0933b3250159 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=a607fdfb-dd15-43b5-9dbf-a1fddad89139 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=6d8ce464-f48f-4779-a8fd-8172db90fdc2 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=99b9c5f4-db34-425c-92b0-ebc05ecdbace already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/enterprise already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/shop/flexi-hex/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/shop/protective-packaging-void-fill/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/clearance-100-recycled-poly-mailers-trial-run-rcs100-10x13/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:19 [scrapy.core.scraper] (PID: 130) ERROR: Spider error processing <GET https://www.ecoenclose.com/ecogeek-t-shirt-printed-with-algae-ink/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/ecogeek-t-shirt-printed-with-algae-ink/ returned 404 status code.
2025-11-08 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:19 [scrapy.core.scraper] (PID: 130) ERROR: Spider error processing <GET https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-info/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-info/ returned 404 status code.
2025-11-08 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:19 [scrapy.core.scraper] (PID: 130) ERROR: Spider error processing <GET https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-square-4-x-4-x-4/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-square-4-x-4-x-4/ returned 404 status code.
2025-11-08 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=e02f31f7-6593-4618-b932-2477c3041ca7 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:20 [scrapy.core.scraper] (PID: 130) ERROR: Spider error processing <GET https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-ink/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-ink/ returned 404 status code.
2025-11-08 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:20 [scrapy.core.scraper] (PID: 130) ERROR: Spider error processing <GET https://www.ecoenclose.com/we-care-cards-with-qr-code/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/we-care-cards-with-qr-code/ returned 404 status code.
2025-11-08 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:20 [scrapy.core.scraper] (PID: 130) ERROR: Spider error processing <GET https://www.ecoenclose.com/clearance-100-recycled-poly-mailers-trial-run-rcs100-10x13/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/clearance-100-recycled-poly-mailers-trial-run-rcs100-10x13/ returned 404 status code.
2025-11-08 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/2-5-zero-waste-sticker-we-care-12-stickers-per-sheet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/ecox-mailer-packaging-for-the-planet-algae-ink-12-x-15-case-of-250-units/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/ecox-mailer-packaging-for-the-planet-algae-ink-10-x-13-case-of-250-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=0daf25c8-e446-49dd-836e-f4f50e4f0c78 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/ecox-mailer-this-is-algae-ink-algae-ink-10-x-13-case-of-250-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=f0515dff-100c-4f70-87f9-69ff83e01736 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/shop/ecox-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/shop/ecox-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/shop/ecox-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:22 [scrapy.core.scraper] (PID: 130) ERROR: Spider error processing <GET https://www.ecoenclose.com/2-5-zero-waste-sticker-we-care-12-stickers-per-sheet/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/2-5-zero-waste-sticker-we-care-12-stickers-per-sheet/ returned 404 status code.
2025-11-08 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/shop/pouches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=a0144c40-9c74-4a0e-98b4-8183340e8f1e already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/samples/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:24 [scrapy.core.scraper] (PID: 130) ERROR: Spider error processing <GET https://www.ecoenclose.com/reenclose-reusable-mailers-sample> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/reenclose-reusable-mailers-sample returned 404 status code.
2025-11-08 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:25 [scrapy.core.scraper] (PID: 130) ERROR: Spider error processing <GET https://www.ecoenclose.com/samples/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/ecoenclose.py", line 56, in parse
    product_ids = [int(item.get()) for item in response.css("div::attr(data-id)")]
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/ecoenclose.py", line 56, in <listcomp>
    product_ids = [int(item.get()) for item in response.css("div::attr(data-id)")]
                   ^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'sample-kits-by-product'
2025-11-08 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/ecox-mailer-this-is-algae-ink-algae-ink-12-x-15-case-of-250-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/shop/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/reenclose-reusable-mailers-100-recycled-polyester-bundle-of-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:25 [scrapy.core.scraper] (PID: 130) ERROR: Spider error processing <GET https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-gable-top-5-x-2-5-x-7/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-gable-top-5-x-2-5-x-7/ returned 404 status code.
2025-11-08 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/shop/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/shop/ecox-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/shop/reusable-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=5cf057a3-e435-45c0-90a8-daf86246b974 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 130) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-08 13:45:27 [scrapy.core.engine] (PID: 130) INFO: Closing spider (finished)
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] ------------------------------ MONITORS ------------------------------
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... OK
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.)
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] Error Count Monitor/test_stat_monitor... FAIL
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... OK
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... OK
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... OK
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... OK
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... SKIPPED (Unable to find 'downloader/exception_count' in job stats.)
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-08 13:45:27 [ecoenclose] (PID: 130) ERROR: [Spidermon] 
======================================================================
FAIL: Error Count Monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'log_count/ERROR' to be '<=' to '3.0'. Current value: '11'

2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] 11 monitors in 0.004s
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] FAILED (failures=1, skipped=2)
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] -------------------------- FINISHED ACTIONS --------------------------
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] 0 actions in 0.000s
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] OK
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] --------------------------- PASSED ACTIONS ---------------------------
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] 0 actions in 0.000s
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] OK
2025-11-08 13:45:27 [ecoenclose] (PID: 130) INFO: [Spidermon] --------------------------- FAILED ACTIONS ---------------------------
2025-11-08 13:45:27 [spidermon.contrib.actions.slack] (PID: 130) WARNING: bot cannot finder user in slack org member list - default icon url used
2025-11-08 13:45:28 [ecoenclose] (PID: 130) INFO: [Spidermon] CustomTemplateSendSlackMessageSpiderFinished... OK
2025-11-08 13:45:28 [ecoenclose] (PID: 130) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-08 13:45:28 [ecoenclose] (PID: 130) INFO: [Spidermon] 1 action in 0.398s
2025-11-08 13:45:28 [ecoenclose] (PID: 130) INFO: [Spidermon] OK
2025-11-08 13:45:28 [ecoenclose] (PID: 130) INFO: 10 URLs returned ProductNotFound.
2025-11-08 13:45:29 [ecoenclose] (PID: 130) INFO: URL https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-gable-top-5-x-2-5-x-7/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-08 13:45:29 [ecoenclose] (PID: 130) INFO: URL https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-square-4-x-4-x-4/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-08 13:45:29 [ecoenclose] (PID: 130) INFO: URL https://www.ecoenclose.com/decorative-100-recycled-tissue-paper-blue-stripes-print-20-x-30/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-08 13:45:29 [ecoenclose] (PID: 130) INFO: URL https://www.ecoenclose.com/ecogeek-t-shirt-printed-with-algae-ink/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-08 13:45:29 [ecoenclose] (PID: 130) INFO: URL https://www.ecoenclose.com/reenclose-reusable-mailers-sample is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-08 13:45:29 [ecoenclose] (PID: 130) INFO: URL https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-info/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-08 13:45:29 [ecoenclose] (PID: 130) INFO: URL https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-ink/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-08 13:45:29 [ecoenclose] (PID: 130) INFO: URL https://www.ecoenclose.com/we-care-cards-with-qr-code/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-08 13:45:29 [ecoenclose] (PID: 130) WARNING: 10 URLs were not found in the `catalog_urls` table.
2025-11-08 13:45:29 [ecoenclose] (PID: 130) INFO: URLs not found and not flagged: {'https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-gable-top-5-x-2-5-x-7/', 'https://www.ecoenclose.com/decorative-100-recycled-tissue-paper-blue-stripes-print-20-x-30/', 'https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-info/', 'https://www.ecoenclose.com/ecogeek-t-shirt-printed-with-algae-ink/', 'https://www.ecoenclose.com/2-5-zero-waste-sticker-we-care-12-stickers-per-sheet/', 'https://www.ecoenclose.com/we-care-cards-with-qr-code/', 'https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-square-4-x-4-x-4/', 'https://www.ecoenclose.com/clearance-100-recycled-poly-mailers-trial-run-rcs100-10x13/', 'https://www.ecoenclose.com/reenclose-reusable-mailers-sample', 'https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-ink/'}
2025-11-08 13:45:29 [ecoenclose] (PID: 130) INFO: Finished processing 'not found' URLs in the `catalog_urls` table.
2025-11-08 13:45:29 [scrapy.extensions.feedexport] (PID: 130) INFO: Stored bq feed (154 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:1
2025-11-08 13:45:29 [scrapy.statscollectors] (PID: 130) INFO: Dumping Scrapy stats:
{'HeadersSpooferDownloaderMiddleware/spoofed': 194,
 'NotFoundHandlerSpiderMiddleware/HttpError': 1,
 'NotFoundHandlerSpiderMiddleware/ProductNotFound': 10,
 'NotFoundHandlerSpiderMiddleware/ValueError': 4,
 'NotFoundHandlerSpiderMiddleware/not_found/404_response': 10,
 'NotFoundHandlerSpiderMiddleware/not_found/ignored': 8,
 'NotFoundHandlerSpiderMiddleware/not_found/retrieved': 8,
 'big_query/url': 108,
 'downloader/request_bytes': 429398,
 'downloader/request_count': 194,
 'downloader/request_method_count/GET': 141,
 'downloader/request_method_count/POST': 53,
 'downloader/response_bytes': 8397728,
 'downloader/response_count': 194,
 'downloader/response_status_count/200': 150,
 'downloader/response_status_count/301': 20,
 'downloader/response_status_count/302': 13,
 'downloader/response_status_count/403': 1,
 'downloader/response_status_count/404': 10,
 'dupefilter/filtered': 5,
 'elapsed_time_seconds': 14.500938,
 'feedexport/success_count/BigQueryFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 11, 8, 13, 45, 27, 722777, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 34550653,
 'httpcompression/response_count': 161,
 'httperror/response_ignored_count': 1,
 'httperror/response_ignored_status_count/403': 1,
 'item_scraped_count': 154,
 'items_per_minute': None,
 'log_count/ERROR': 12,
 'log_count/INFO': 55,
 'log_count/WARNING': 90,
 'memusage/max': 126029824,
 'memusage/startup': 126029824,
 'poet/injector/catalog_extraction.pages.ecoenclose.EcoencloseProductsPageObject': 53,
 'product_status/not_available_online': 18,
 'proxy_manager/ignored/proxy_defined': 33,
 'proxy_manager/processed': 161,
 'request_depth_max': 1,
 'response_received_count': 161,
 'responses_per_minute': None,
 'scheduler/dequeued': 194,
 'scheduler/dequeued/memory': 194,
 'scheduler/enqueued': 194,
 'scheduler/enqueued/memory': 194,
 'spider_exceptions/ProductNotFound': 10,
 'spider_exceptions/ValueError': 1,
 'spidermon/validation/fields': 3234,
 'spidermon/validation/items': 154,
 'spidermon/validation/validators': 1,
 'spidermon/validation/validators/item/jsonschema': True,
 'spidermon_field_coverage/dict/brand': 1.0,
 'spidermon_field_coverage/dict/categories': 1.0,
 'spidermon_field_coverage/dict/countryOfOrigin': 1.0,
 'spidermon_field_coverage/dict/description': 1.0,
 'spidermon_field_coverage/dict/imageUrl': 1.0,
 'spidermon_field_coverage/dict/inStock': 1.0,
 'spidermon_field_coverage/dict/isFreeShipping': 1.0,
 'spidermon_field_coverage/dict/leadTime': 1.0,
 'spidermon_field_coverage/dict/manufacturer': 1.0,
 'spidermon_field_coverage/dict/manufacturerSku': 1.0,
 'spidermon_field_coverage/dict/name': 1.0,
 'spidermon_field_coverage/dict/packagingIncrement': 1.0,
 'spidermon_field_coverage/dict/prices': 1.0,
 'spidermon_field_coverage/dict/productStatus': 1.0,
 'spidermon_field_coverage/dict/relatedSkus': 1.0,
 'spidermon_field_coverage/dict/specifications': 1.0,
 'spidermon_field_coverage/dict/supplier': 1.0,
 'spidermon_field_coverage/dict/supplierSku': 1.0,
 'spidermon_field_coverage/dict/uom': 1.0,
 'spidermon_field_coverage/dict/url': 1.0,
 'spidermon_field_coverage/dict/weight': 1.0,
 'spidermon_item_scraped_count': 154,
 'spidermon_item_scraped_count/dict': 154,
 'spidermon_item_scraped_count/dict/brand': 154,
 'spidermon_item_scraped_count/dict/categories': 154,
 'spidermon_item_scraped_count/dict/countryOfOrigin': 154,
 'spidermon_item_scraped_count/dict/description': 154,
 'spidermon_item_scraped_count/dict/imageUrl': 154,
 'spidermon_item_scraped_count/dict/inStock': 154,
 'spidermon_item_scraped_count/dict/isFreeShipping': 154,
 'spidermon_item_scraped_count/dict/leadTime': 154,
 'spidermon_item_scraped_count/dict/manufacturer': 154,
 'spidermon_item_scraped_count/dict/manufacturerSku': 154,
 'spidermon_item_scraped_count/dict/name': 154,
 'spidermon_item_scraped_count/dict/packagingIncrement': 154,
 'spidermon_item_scraped_count/dict/prices': 154,
 'spidermon_item_scraped_count/dict/productStatus': 154,
 'spidermon_item_scraped_count/dict/relatedSkus': 154,
 'spidermon_item_scraped_count/dict/specifications': 154,
 'spidermon_item_scraped_count/dict/supplier': 154,
 'spidermon_item_scraped_count/dict/supplierSku': 154,
 'spidermon_item_scraped_count/dict/uom': 154,
 'spidermon_item_scraped_count/dict/url': 154,
 'spidermon_item_scraped_count/dict/weight': 154,
 'start_requests/big_query': 108,
 'start_time': datetime.datetime(2025, 11, 8, 13, 45, 13, 221839, tzinfo=datetime.timezone.utc)}
2025-11-08 13:45:29 [scrapy.core.engine] (PID: 130) INFO: Spider closed (finished)