2025-11-15 13:45:09 [scrapy.utils.log] (PID: 72) INFO: Scrapy 2.12.0 started (bot: catalog_extraction)
2025-11-15 13:45:09 [scrapy.utils.log] (PID: 72) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.13 (main, Jun 10 2025, 23:54:42) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36
2025-11-15 13:45:10 [ecoenclose] (PID: 72) INFO: Starting extraction spider ecoenclose...
2025-11-15 13:45:10 [scrapy.addons] (PID: 72) INFO: Enabled addons:
[]
2025-11-15 13:45:10 [py.warnings] (PID: 72) WARNING: /usr/local/lib/python3.11/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting.
It will be removed in a future version of Scrapy.
  return cls(crawler)

2025-11-15 13:45:10 [scrapy.extensions.telnet] (PID: 72) INFO: Telnet Password: 93047b628005553c
2025-11-15 13:45:10 [py.warnings] (PID: 72) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-15 13:45:10 [scrapy.middleware] (PID: 72) INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.closespider.CloseSpider',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'spidermon.contrib.scrapy.extensions.Spidermon']
2025-11-15 13:45:10 [scrapy.crawler] (PID: 72) INFO: Overridden settings:
{'BOT_NAME': 'catalog_extraction',
 'CONCURRENT_ITEMS': 250,
 'CONCURRENT_REQUESTS': 24,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/ecoenclose/4b1d85fcc22911f09c134200a9fe0102.log',
 'LOG_FORMAT': '%(asctime)s [%(name)s] (PID: %(process)d) %(levelname)s: '
               '%(message)s',
 'LOG_LEVEL': 'INFO',
 'NEWSPIDER_MODULE': 'catalog_extraction.spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['catalog_extraction.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': None}
2025-11-15 13:45:10 [scrapy_poet.injection] (PID: 72) INFO: Loading providers:
 [<class 'scrapy_poet.page_input_providers.HttpRequestProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpResponseProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpClientProvider'>,
 <class 'scrapy_poet.page_input_providers.PageParamsProvider'>,
 <class 'scrapy_poet.page_input_providers.RequestUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.ResponseUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.StatsProvider'>]
2025-11-15 13:45:10 [scrapy.middleware] (PID: 72) INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scraping_utils.middlewares.downloaders.ProxyManagerDownloaderMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scraping_utils.middlewares.downloaders.HeadersSpooferDownloaderMiddleware',
 'scrapy_poet.InjectionMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy_poet.DownloaderStatsMiddleware']
2025-11-15 13:45:10 [NotFoundHandlerSpiderMiddleware] (PID: 72) INFO: NotFoundHandlerSpiderMiddleware running on PRODUCTION environment.
2025-11-15 13:45:10 [scrapy.middleware] (PID: 72) INFO: Enabled spider middlewares:
['catalog_extraction.middlewares.NotFoundHandlerSpiderMiddleware',
 'catalog_extraction.middlewares.FixtureSavingMiddleware',
 'scrapy_poet.RetryMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2025-11-15 13:45:10 [scrapy.middleware] (PID: 72) INFO: Enabled item pipelines:
['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline',
 'catalog_extraction.pipelines.DiscontinuedProductsAdjustmentPipeline',
 'catalog_extraction.pipelines.PriceRoundingPipeline',
 'scraping_utils.pipelines.AttachSupplierPipeline',
 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline']
2025-11-15 13:45:10 [scrapy.core.engine] (PID: 72) INFO: Spider opened
2025-11-15 13:45:11 [scrapy.extensions.closespider] (PID: 72) INFO: Spider will stop when no items are produced after 1800 seconds.
2025-11-15 13:45:11 [scrapy.extensions.logstats] (PID: 72) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-11-15 13:45:11 [scrapy.extensions.telnet] (PID: 72) INFO: Telnet console listening on 127.0.0.1:6024
2025-11-15 13:45:12 [ProxyManagerDownloaderMiddleware] (PID: 72) INFO: Using brd-customer-hl_13cda1e4-zone-main_datacenter_proxy as the default proxy for ProxyManagerDownloaderMiddleware.
2025-11-15 13:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/ecox-mailer-packaging-for-the-planet-algae-ink-10-x-13-case-of-250-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:12 [scrapy.spidermiddlewares.httperror] (PID: 72) INFO: Ignoring response <403 https://www.ecoenclose.com/cart.php?action=add&product_id=122>: HTTP status code is not handled or not allowed
2025-11-15 13:45:13 [scrapy.spidermiddlewares.httperror] (PID: 72) INFO: Ignoring response <403 https://www.ecoenclose.com/resources/plastic-to-paper>: HTTP status code is not handled or not allowed
2025-11-15 13:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:13 [scrapy.core.scraper] (PID: 72) ERROR: Spider error processing <GET https://www.ecoenclose.com/decorative-100-recycled-tissue-paper-blue-stripes-print-20-x-30/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/decorative-100-recycled-tissue-paper-blue-stripes-print-20-x-30/ returned 404 status code.
2025-11-15 13:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=89c5d3b0-cb97-41b0-beaf-c1cb81739a4a already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/clearance-100-recycled-poly-mailers-trial-run-rcs100-10x13/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cello-tape-eco-friendly-packing-tape-industrially-compostable-2-x-72-yds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cart.php already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/sway-packaging already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:14 [scrapy.core.scraper] (PID: 72) ERROR: Spider error processing <GET https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-gable-top-5-x-2-5-x-7/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-gable-top-5-x-2-5-x-7/ returned 404 status code.
2025-11-15 13:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/shop/ecox-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:14 [scrapy.core.scraper] (PID: 72) ERROR: Spider error processing <GET https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-info/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-info/ returned 404 status code.
2025-11-15 13:45:15 [scrapy.core.scraper] (PID: 72) ERROR: Spider error processing <GET https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-ink/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-ink/ returned 404 status code.
2025-11-15 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:15 [scrapy.core.scraper] (PID: 72) ERROR: Spider error processing <GET https://www.ecoenclose.com/clearance-100-recycled-poly-mailers-trial-run-rcs100-10x13/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/clearance-100-recycled-poly-mailers-trial-run-rcs100-10x13/ returned 404 status code.
2025-11-15 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=807e8459-1786-4c54-a5b1-6d57e219e8fe already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:17 [scrapy.core.scraper] (PID: 72) ERROR: Spider error processing <GET https://www.ecoenclose.com/reenclose-reusable-mailers-sample> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/reenclose-reusable-mailers-sample returned 404 status code.
2025-11-15 13:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/samples/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/ecox-mailer-packaging-for-the-planet-algae-ink-12-x-15-case-of-250-units/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=05834bdf-af78-4695-9dfa-70e38d4a3b93 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/enterprise already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/shop/ecox-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cart.php already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:20 [scrapy.core.scraper] (PID: 72) ERROR: Spider error processing <GET https://www.ecoenclose.com/samples/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/ecoenclose.py", line 56, in parse
    product_ids = [int(item.get()) for item in response.css("div::attr(data-id)")]
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/ecoenclose.py", line 56, in <listcomp>
    product_ids = [int(item.get()) for item in response.css("div::attr(data-id)")]
                   ^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'sample-kits-by-product'
2025-11-15 13:45:20 [scrapy.core.scraper] (PID: 72) ERROR: Spider error processing <GET https://www.ecoenclose.com/ecogeek-t-shirt-printed-with-algae-ink/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/ecogeek-t-shirt-printed-with-algae-ink/ returned 404 status code.
2025-11-15 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=6d807409-f775-4b36-b408-e2a6d7b35daf already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/reenclose-reusable-mailers-100-recycled-polyester-bundle-of-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=2a3534e6-1c7d-4360-b6c1-91c6361c0e71 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/2-5-zero-waste-sticker-we-care-12-stickers-per-sheet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [scrapy.core.scraper] (PID: 72) ERROR: Spider error processing <GET https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-square-4-x-4-x-4/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-square-4-x-4-x-4/ returned 404 status code.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=3201315d-e588-4aa1-a471-0e416a55a921 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/ecox-mailer-this-is-algae-ink-algae-ink-10-x-13-case-of-250-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/shop/flexi-hex/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/shop/spiropack-nest-eco/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cart.php already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/shop/reusable-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/shop/protective-packaging-void-fill/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/shop/pouches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/ecox-mailer-this-is-algae-ink-algae-ink-12-x-15-case-of-250-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/shop/ecox-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:23 [scrapy.core.scraper] (PID: 72) ERROR: Spider error processing <GET https://www.ecoenclose.com/2-5-zero-waste-sticker-we-care-12-stickers-per-sheet/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/2-5-zero-waste-sticker-we-care-12-stickers-per-sheet/ returned 404 status code.
2025-11-15 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/shop/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/shop/ecox-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/shop/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=73ec7669-c1b7-4530-9b01-ed46e4d131ac already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/cart.php?suggest=35167a70-8e06-40bd-8eae-d4520ab40f04 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:26 [scrapy.core.scraper] (PID: 72) ERROR: Spider error processing <GET https://www.ecoenclose.com/we-care-cards-with-qr-code/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.ecoenclose.com/we-care-cards-with-qr-code/ returned 404 status code.
2025-11-15 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 72) WARNING: Request https://www.ecoenclose.com/graphql already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-15 13:45:27 [scrapy.core.engine] (PID: 72) INFO: Closing spider (finished)
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] ------------------------------ MONITORS ------------------------------
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.)
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] Error Count Monitor/test_stat_monitor... FAIL
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... SKIPPED (Unable to find 'downloader/exception_count' in job stats.)
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-15 13:45:27 [ecoenclose] (PID: 72) ERROR: [Spidermon] 
======================================================================
FAIL: Error Count Monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'log_count/ERROR' to be '<=' to '3.0'. Current value: '11'

2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] 11 monitors in 0.004s
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] FAILED (failures=1, skipped=2)
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] -------------------------- FINISHED ACTIONS --------------------------
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] 0 actions in 0.000s
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] --------------------------- PASSED ACTIONS ---------------------------
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] 0 actions in 0.000s
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] --------------------------- FAILED ACTIONS ---------------------------
2025-11-15 13:45:27 [spidermon.contrib.actions.slack] (PID: 72) WARNING: bot cannot finder user in slack org member list - default icon url used
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] CustomTemplateSendSlackMessageSpiderFinished... OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] 1 action in 0.426s
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: [Spidermon] OK
2025-11-15 13:45:27 [ecoenclose] (PID: 72) INFO: 10 URLs returned ProductNotFound.
2025-11-15 13:45:28 [ecoenclose] (PID: 72) INFO: URL https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-gable-top-5-x-2-5-x-7/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-15 13:45:28 [ecoenclose] (PID: 72) INFO: URL https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-square-4-x-4-x-4/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-15 13:45:28 [ecoenclose] (PID: 72) INFO: URL https://www.ecoenclose.com/decorative-100-recycled-tissue-paper-blue-stripes-print-20-x-30/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-15 13:45:28 [ecoenclose] (PID: 72) INFO: URL https://www.ecoenclose.com/ecogeek-t-shirt-printed-with-algae-ink/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-15 13:45:28 [ecoenclose] (PID: 72) INFO: URL https://www.ecoenclose.com/reenclose-reusable-mailers-sample is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-15 13:45:28 [ecoenclose] (PID: 72) INFO: URL https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-info/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-15 13:45:28 [ecoenclose] (PID: 72) INFO: URL https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-ink/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-15 13:45:28 [ecoenclose] (PID: 72) INFO: URL https://www.ecoenclose.com/we-care-cards-with-qr-code/ is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-15 13:45:28 [ecoenclose] (PID: 72) WARNING: 10 URLs were not found in the `catalog_urls` table.
2025-11-15 13:45:28 [ecoenclose] (PID: 72) INFO: URLs not found and not flagged: {'https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-gable-top-5-x-2-5-x-7/', 'https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-info/', 'https://www.ecoenclose.com/decorative-100-recycled-tissue-paper-blue-stripes-print-20-x-30/', 'https://www.ecoenclose.com/we-care-cards-with-qr-code/', 'https://www.ecoenclose.com/100-recycled-retail-box-with-seaweed-window-square-4-x-4-x-4/', 'https://www.ecoenclose.com/ecogeek-t-shirt-printed-with-algae-ink/', 'https://www.ecoenclose.com/2-5-zero-waste-sticker-we-care-12-stickers-per-sheet/', 'https://www.ecoenclose.com/reenclose-reusable-mailers-sample', 'https://www.ecoenclose.com/we-care-cards-with-qr-code-algae-ink/', 'https://www.ecoenclose.com/clearance-100-recycled-poly-mailers-trial-run-rcs100-10x13/'}
2025-11-15 13:45:28 [ecoenclose] (PID: 72) INFO: Finished processing 'not found' URLs in the `catalog_urls` table.
2025-11-15 13:45:29 [scrapy.extensions.feedexport] (PID: 72) INFO: Stored bq feed (156 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:1
2025-11-15 13:45:29 [scrapy.statscollectors] (PID: 72) INFO: Dumping Scrapy stats:
{'HeadersSpooferDownloaderMiddleware/spoofed': 195,
 'NotFoundHandlerSpiderMiddleware/HttpError': 2,
 'NotFoundHandlerSpiderMiddleware/ProductNotFound': 10,
 'NotFoundHandlerSpiderMiddleware/ValueError': 4,
 'NotFoundHandlerSpiderMiddleware/not_found/404_response': 10,
 'NotFoundHandlerSpiderMiddleware/not_found/ignored': 8,
 'NotFoundHandlerSpiderMiddleware/not_found/retrieved': 8,
 'big_query/url': 108,
 'downloader/request_bytes': 431281,
 'downloader/request_count': 195,
 'downloader/request_method_count/GET': 141,
 'downloader/request_method_count/POST': 54,
 'downloader/response_bytes': 8574391,
 'downloader/response_count': 195,
 'downloader/response_status_count/200': 150,
 'downloader/response_status_count/301': 21,
 'downloader/response_status_count/302': 12,
 'downloader/response_status_count/403': 2,
 'downloader/response_status_count/404': 10,
 'dupefilter/filtered': 5,
 'elapsed_time_seconds': 16.25608,
 'feedexport/success_count/BigQueryFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 11, 15, 13, 45, 27, 260343, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 35682816,
 'httpcompression/response_count': 162,
 'httperror/response_ignored_count': 2,
 'httperror/response_ignored_status_count/403': 2,
 'item_scraped_count': 156,
 'items_per_minute': None,
 'log_count/ERROR': 12,
 'log_count/INFO': 56,
 'log_count/WARNING': 91,
 'memusage/max': 125902848,
 'memusage/startup': 125902848,
 'poet/injector/catalog_extraction.pages.ecoenclose.EcoencloseProductsPageObject': 54,
 'product_status/not_available_online': 18,
 'proxy_manager/ignored/proxy_defined': 33,
 'proxy_manager/processed': 162,
 'request_depth_max': 1,
 'response_received_count': 162,
 'responses_per_minute': None,
 'scheduler/dequeued': 195,
 'scheduler/dequeued/memory': 195,
 'scheduler/enqueued': 195,
 'scheduler/enqueued/memory': 195,
 'spider_exceptions/ProductNotFound': 10,
 'spider_exceptions/ValueError': 1,
 'spidermon/validation/fields': 3276,
 'spidermon/validation/items': 156,
 'spidermon/validation/validators': 1,
 'spidermon/validation/validators/item/jsonschema': True,
 'spidermon_field_coverage/dict/brand': 1.0,
 'spidermon_field_coverage/dict/categories': 1.0,
 'spidermon_field_coverage/dict/countryOfOrigin': 1.0,
 'spidermon_field_coverage/dict/description': 1.0,
 'spidermon_field_coverage/dict/imageUrl': 1.0,
 'spidermon_field_coverage/dict/inStock': 1.0,
 'spidermon_field_coverage/dict/isFreeShipping': 1.0,
 'spidermon_field_coverage/dict/leadTime': 1.0,
 'spidermon_field_coverage/dict/manufacturer': 1.0,
 'spidermon_field_coverage/dict/manufacturerSku': 1.0,
 'spidermon_field_coverage/dict/name': 1.0,
 'spidermon_field_coverage/dict/packagingIncrement': 1.0,
 'spidermon_field_coverage/dict/prices': 1.0,
 'spidermon_field_coverage/dict/productStatus': 1.0,
 'spidermon_field_coverage/dict/relatedSkus': 1.0,
 'spidermon_field_coverage/dict/specifications': 1.0,
 'spidermon_field_coverage/dict/supplier': 1.0,
 'spidermon_field_coverage/dict/supplierSku': 1.0,
 'spidermon_field_coverage/dict/uom': 1.0,
 'spidermon_field_coverage/dict/url': 1.0,
 'spidermon_field_coverage/dict/weight': 1.0,
 'spidermon_item_scraped_count': 156,
 'spidermon_item_scraped_count/dict': 156,
 'spidermon_item_scraped_count/dict/brand': 156,
 'spidermon_item_scraped_count/dict/categories': 156,
 'spidermon_item_scraped_count/dict/countryOfOrigin': 156,
 'spidermon_item_scraped_count/dict/description': 156,
 'spidermon_item_scraped_count/dict/imageUrl': 156,
 'spidermon_item_scraped_count/dict/inStock': 156,
 'spidermon_item_scraped_count/dict/isFreeShipping': 156,
 'spidermon_item_scraped_count/dict/leadTime': 156,
 'spidermon_item_scraped_count/dict/manufacturer': 156,
 'spidermon_item_scraped_count/dict/manufacturerSku': 156,
 'spidermon_item_scraped_count/dict/name': 156,
 'spidermon_item_scraped_count/dict/packagingIncrement': 156,
 'spidermon_item_scraped_count/dict/prices': 156,
 'spidermon_item_scraped_count/dict/productStatus': 156,
 'spidermon_item_scraped_count/dict/relatedSkus': 156,
 'spidermon_item_scraped_count/dict/specifications': 156,
 'spidermon_item_scraped_count/dict/supplier': 156,
 'spidermon_item_scraped_count/dict/supplierSku': 156,
 'spidermon_item_scraped_count/dict/uom': 156,
 'spidermon_item_scraped_count/dict/url': 156,
 'spidermon_item_scraped_count/dict/weight': 156,
 'start_requests/big_query': 108,
 'start_time': datetime.datetime(2025, 11, 15, 13, 45, 11, 4263, tzinfo=datetime.timezone.utc)}
2025-11-15 13:45:29 [scrapy.core.engine] (PID: 72) INFO: Spider closed (finished)